[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:55.981521 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:34813
I20260709 13:07:55.983222 26158 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:55.984328 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:56.002702 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.002703 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.002910 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:56.004060 26158 server_base.cc:1061] running on GCE node
I20260709 13:07:57.248535 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:57.248806 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:57.248960 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602477248945 us; error 0 us; skew 500 ppm
I20260709 13:07:57.249776 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:57.255851 26158 webserver.cc:533] Webserver started at http://127.25.139.190:39161/ using document root <none> and password file <none>
I20260709 13:07:57.256772 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:57.256980 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:57.257400 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:57.263567 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "f40ccd14007e436faa1958c8aa8bd1e7"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.272414 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:57.278126 26173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:57.279773 26158 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:07:57.280140 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "f40ccd14007e436faa1958c8aa8bd1e7"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.280491 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:57.336511 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:57.338068 26158 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:57.338503 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:57.413385 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:34813
I20260709 13:07:57.413488 26224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:34813 every 8 connection(s)
I20260709 13:07:57.421497 26225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.443794 26225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: Bootstrap starting.
I20260709 13:07:57.449952 26225 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.452000 26225 log.cc:826] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:57.457170 26225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: No bootstrap required, opened a new log
I20260709 13:07:57.478390 26225 raft_consensus.cc:359] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER }
I20260709 13:07:57.479041 26225 raft_consensus.cc:385] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.479645 26225 raft_consensus.cc:740] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f40ccd14007e436faa1958c8aa8bd1e7, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.480899 26225 consensus_queue.cc:260] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER }
I20260709 13:07:57.481539 26225 raft_consensus.cc:399] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:57.481879 26225 raft_consensus.cc:493] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:57.482286 26225 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.487092 26225 raft_consensus.cc:515] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER }
I20260709 13:07:57.488062 26225 leader_election.cc:304] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f40ccd14007e436faa1958c8aa8bd1e7; no voters: 
I20260709 13:07:57.489995 26225 leader_election.cc:290] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:57.490365 26228 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:57.492822 26228 raft_consensus.cc:697] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 1 LEADER]: Becoming Leader. State: Replica: f40ccd14007e436faa1958c8aa8bd1e7, State: Running, Role: LEADER
I20260709 13:07:57.493865 26228 consensus_queue.cc:237] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER }
I20260709 13:07:57.495090 26225 sys_catalog.cc:565] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:57.506021 26230 sys_catalog.cc:455] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER } }
I20260709 13:07:57.505841 26229 sys_catalog.cc:455] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f40ccd14007e436faa1958c8aa8bd1e7. Latest consensus state: current_term: 1 leader_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f40ccd14007e436faa1958c8aa8bd1e7" member_type: VOTER } }
I20260709 13:07:57.506697 26230 sys_catalog.cc:458] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:57.506750 26229 sys_catalog.cc:458] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:57.510205 26237 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:57.522962 26237 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:57.526554 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:57.542296 26237 catalog_manager.cc:1383] Generated new cluster ID: a374270a97344cdfb9183538cd511756
I20260709 13:07:57.542608 26237 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:57.583621 26237 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:57.585294 26237 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:57.602114 26237 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: Generated new TSK 0
I20260709 13:07:57.603440 26237 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:57.657941 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:57.668864 26247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:57.670467 26248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:57.674490 26250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:57.675045 26158 server_base.cc:1061] running on GCE node
I20260709 13:07:57.675990 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:57.676250 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:57.676461 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602477676442 us; error 0 us; skew 500 ppm
I20260709 13:07:57.677166 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:57.682353 26158 webserver.cc:533] Webserver started at http://127.25.139.129:35479/ using document root <none> and password file <none>
I20260709 13:07:57.682996 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:57.683321 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:57.683652 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:57.684990 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "baefebef5daf4ce9bd4eed367909d5d0"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.692028 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:07:57.697834 26255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:57.699043 26158 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:57.699465 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "baefebef5daf4ce9bd4eed367909d5d0"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.699774 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:57.717820 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:57.719354 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:57.722285 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:57.727206 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:57.727489 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:57.727834 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:57.727990 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:57.842626 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:36877
I20260709 13:07:57.842705 26317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:36877 every 8 connection(s)
I20260709 13:07:57.850513 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:57.862887 26322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:57.864521 26323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:57.868580 26158 server_base.cc:1061] running on GCE node
W20260709 13:07:57.869410 26325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:57.870616 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:57.870865 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:57.871079 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602477871056 us; error 0 us; skew 500 ppm
I20260709 13:07:57.871944 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:57.875590 26158 webserver.cc:533] Webserver started at http://127.25.139.130:36481/ using document root <none> and password file <none>
I20260709 13:07:57.876298 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:57.876590 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:57.876935 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:57.878283 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.885080 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:07:57.891197 26330 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:57.891779 26318 heartbeater.cc:344] Connected to a master server at 127.25.139.190:34813
I20260709 13:07:57.892144 26158 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:07:57.892330 26318 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:57.892469 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
format_stamp: "Formatted at 2026-07-09 13:07:57 on dist-test-slave-v5z2"
I20260709 13:07:57.892838 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:57.893573 26318 heartbeater.cc:507] Master 127.25.139.190:34813 requested a full tablet report, sending...
I20260709 13:07:57.897490 26190 ts_manager.cc:194] Registered new tserver with Master: baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877)
I20260709 13:07:57.901096 26190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50390
I20260709 13:07:57.917480 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:57.918920 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:57.921198 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:57.924401 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:57.924664 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:57.924914 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:57.925091 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.024072 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:33871
I20260709 13:07:58.024287 26392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:33871 every 8 connection(s)
I20260709 13:07:58.029825 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:58.038228 26396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.042405 26397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.047857 26393 heartbeater.cc:344] Connected to a master server at 127.25.139.190:34813
I20260709 13:07:58.048322 26393 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:58.048772 26399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.049433 26393 heartbeater.cc:507] Master 127.25.139.190:34813 requested a full tablet report, sending...
I20260709 13:07:58.050771 26158 server_base.cc:1061] running on GCE node
I20260709 13:07:58.051865 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:58.051828 26190 ts_manager.cc:194] Registered new tserver with Master: f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
W20260709 13:07:58.052212 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:58.052410 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602478052392 us; error 0 us; skew 500 ppm
I20260709 13:07:58.053143 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:58.053689 26190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50406
I20260709 13:07:58.056308 26158 webserver.cc:533] Webserver started at http://127.25.139.131:43011/ using document root <none> and password file <none>
I20260709 13:07:58.056948 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:58.057168 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:58.057447 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.058470 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "86bd6e0313e748f99a134b7fb1f060b5"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-v5z2"
I20260709 13:07:58.063424 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:58.067070 26404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.067978 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:58.068301 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "86bd6e0313e748f99a134b7fb1f060b5"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-v5z2"
I20260709 13:07:58.068601 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:58.086897 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:58.088255 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:58.090432 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:58.093461 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:58.093713 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.093962 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:58.094149 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.192857 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:41175
I20260709 13:07:58.193049 26466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:41175 every 8 connection(s)
I20260709 13:07:58.211659 26467 heartbeater.cc:344] Connected to a master server at 127.25.139.190:34813
I20260709 13:07:58.212131 26467 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:58.213011 26467 heartbeater.cc:507] Master 127.25.139.190:34813 requested a full tablet report, sending...
I20260709 13:07:58.215036 26190 ts_manager.cc:194] Registered new tserver with Master: 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:58.215409 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014631223s
I20260709 13:07:58.216477 26190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50410
I20260709 13:07:58.276410 26190 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50422:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:58.280484 26190 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:58.378480 26282 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6b4add6451416d96cec9231ae64def (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.380582 26282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6b4add6451416d96cec9231ae64def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.378450 26283 tablet_service.cc:1511] Processing CreateTablet for tablet 0addee29216b4f8b84c0f7e606a74e76 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.381837 26283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0addee29216b4f8b84c0f7e606a74e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.382179 26280 tablet_service.cc:1511] Processing CreateTablet for tablet 2b386bc085524223a3733507eb7368cb (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.380626 26281 tablet_service.cc:1511] Processing CreateTablet for tablet 3d08c10d924d485696b43f83e3e08a12 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.385983 26281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d08c10d924d485696b43f83e3e08a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.387805 26280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b386bc085524223a3733507eb7368cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.403270 26279 tablet_service.cc:1511] Processing CreateTablet for tablet caff12beb7de4b9eb31475adead162fa (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.405380 26279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caff12beb7de4b9eb31475adead162fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.425278 26278 tablet_service.cc:1511] Processing CreateTablet for tablet ec6433f8b1e84996903842e307baf116 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.427035 26278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6433f8b1e84996903842e307baf116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.434880 26432 tablet_service.cc:1511] Processing CreateTablet for tablet 0addee29216b4f8b84c0f7e606a74e76 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.436421 26432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0addee29216b4f8b84c0f7e606a74e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.453505 26431 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6b4add6451416d96cec9231ae64def (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.455044 26431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6b4add6451416d96cec9231ae64def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.464792 26277 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:58.466245 26428 tablet_service.cc:1511] Processing CreateTablet for tablet caff12beb7de4b9eb31475adead162fa (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.472000 26429 tablet_service.cc:1511] Processing CreateTablet for tablet 2b386bc085524223a3733507eb7368cb (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.475015 26277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.471251 26430 tablet_service.cc:1511] Processing CreateTablet for tablet 3d08c10d924d485696b43f83e3e08a12 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.484601 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caff12beb7de4b9eb31475adead162fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.483325 26427 tablet_service.cc:1511] Processing CreateTablet for tablet ec6433f8b1e84996903842e307baf116 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.502938 26430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d08c10d924d485696b43f83e3e08a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.509805 26353 tablet_service.cc:1511] Processing CreateTablet for tablet ec6433f8b1e84996903842e307baf116 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.507249 26358 tablet_service.cc:1511] Processing CreateTablet for tablet 0addee29216b4f8b84c0f7e606a74e76 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.507108 26357 tablet_service.cc:1511] Processing CreateTablet for tablet 0c6b4add6451416d96cec9231ae64def (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.511759 26354 tablet_service.cc:1511] Processing CreateTablet for tablet caff12beb7de4b9eb31475adead162fa (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.518702 26358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0addee29216b4f8b84c0f7e606a74e76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.512235 26355 tablet_service.cc:1511] Processing CreateTablet for tablet 2b386bc085524223a3733507eb7368cb (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.516656 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6433f8b1e84996903842e307baf116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.515350 26356 tablet_service.cc:1511] Processing CreateTablet for tablet 3d08c10d924d485696b43f83e3e08a12 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.534104 26353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6433f8b1e84996903842e307baf116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.525126 26352 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 13:07:58.539767 26238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:58.542098 26486 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.542907 26357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c6b4add6451416d96cec9231ae64def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.542955 26485 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:58.545760 26431 tablet_service.cc:1511] Processing CreateTablet for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:58.548619 26354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caff12beb7de4b9eb31475adead162fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.542734 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b386bc085524223a3733507eb7368cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.552934 26352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.554693 26356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d08c10d924d485696b43f83e3e08a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.560561 26355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b386bc085524223a3733507eb7368cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.567134 26351 tablet_service.cc:1511] Processing CreateTablet for tablet ff182aea9d3a4304b12adee145e7dbb2 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.563716 26431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4eb35a5328cb4cccac67ca8bbd7d6c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.570688 26351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff182aea9d3a4304b12adee145e7dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.575273 26278 tablet_service.cc:1511] Processing CreateTablet for tablet ff182aea9d3a4304b12adee145e7dbb2 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.596468 26432 tablet_service.cc:1511] Processing CreateTablet for tablet ff182aea9d3a4304b12adee145e7dbb2 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.598168 26432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff182aea9d3a4304b12adee145e7dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.611009 26485 tablet_bootstrap.cc:654] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.624037 26278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff182aea9d3a4304b12adee145e7dbb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.623711 26279 tablet_service.cc:1511] Processing CreateTablet for tablet c4d44f2ecff94e8fb67912f511748612 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.625589 26279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d44f2ecff94e8fb67912f511748612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.638078 26350 tablet_service.cc:1511] Processing CreateTablet for tablet c4d44f2ecff94e8fb67912f511748612 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.640360 26350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d44f2ecff94e8fb67912f511748612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.643633 26428 tablet_service.cc:1511] Processing CreateTablet for tablet c4d44f2ecff94e8fb67912f511748612 (DEFAULT_TABLE table=test-workload [id=c77dbb69449b403aa8865dec97fd9ba7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.644968 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4d44f2ecff94e8fb67912f511748612. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.688239 26485 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:58.689597 26485 ts_tablet_manager.cc:1403] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.012s
I20260709 13:07:58.699549 26488 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:58.719308 26486 tablet_bootstrap.cc:654] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.721909 26485 raft_consensus.cc:359] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.724041 26485 raft_consensus.cc:385] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.724421 26485 raft_consensus.cc:740] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.725279 26485 consensus_queue.cc:260] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.753381 26486 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.753885 26486 ts_tablet_manager.cc:1403] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.212s	user 0.008s	sys 0.016s
I20260709 13:07:58.759521 26318 heartbeater.cc:499] Master 127.25.139.190:34813 was elected leader, sending a full tablet report...
I20260709 13:07:58.759931 26485 ts_tablet_manager.cc:1434] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.063s	user 0.011s	sys 0.013s
I20260709 13:07:58.761363 26485 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:58.759934 26488 tablet_bootstrap.cc:654] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.765139 26486 raft_consensus.cc:359] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:58.766096 26486 raft_consensus.cc:385] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.766502 26486 raft_consensus.cc:740] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.767309 26486 consensus_queue.cc:260] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:58.772794 26485 tablet_bootstrap.cc:654] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.799034 26488 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:58.799082 26486 ts_tablet_manager.cc:1434] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.045s	user 0.019s	sys 0.017s
I20260709 13:07:58.799846 26488 ts_tablet_manager.cc:1403] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.014s
I20260709 13:07:58.800328 26467 heartbeater.cc:499] Master 127.25.139.190:34813 was elected leader, sending a full tablet report...
I20260709 13:07:58.800758 26486 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.803006 26488 raft_consensus.cc:359] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.803797 26488 raft_consensus.cc:385] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.804088 26488 raft_consensus.cc:740] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.805335 26488 consensus_queue.cc:260] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.807945 26486 tablet_bootstrap.cc:654] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.814307 26485 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:58.814109 26393 heartbeater.cc:499] Master 127.25.139.190:34813 was elected leader, sending a full tablet report...
I20260709 13:07:58.815359 26485 ts_tablet_manager.cc:1403] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.009s
I20260709 13:07:58.819398 26486 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.819924 26486 ts_tablet_manager.cc:1403] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:07:58.820987 26488 ts_tablet_manager.cc:1434] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:07:58.821969 26488 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:58.823307 26486 raft_consensus.cc:359] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.824034 26486 raft_consensus.cc:385] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.824322 26486 raft_consensus.cc:740] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.825069 26486 consensus_queue.cc:260] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.827769 26486 ts_tablet_manager.cc:1434] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:58.828655 26486 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.829190 26488 tablet_bootstrap.cc:654] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.818944 26485 raft_consensus.cc:359] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.831326 26485 raft_consensus.cc:385] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.831671 26485 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.832470 26485 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.834996 26486 tablet_bootstrap.cc:654] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.835119 26485 ts_tablet_manager.cc:1434] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:07:58.836141 26485 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:58.844929 26485 tablet_bootstrap.cc:654] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.846750 26486 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.847263 26486 ts_tablet_manager.cc:1403] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:07:58.850092 26486 raft_consensus.cc:359] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
W20260709 13:07:58.850764 26319 tablet.cc:2406] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:58.850935 26486 raft_consensus.cc:385] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.851269 26486 raft_consensus.cc:740] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.852027 26486 consensus_queue.cc:260] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.854264 26486 ts_tablet_manager.cc:1434] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:58.855507 26486 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.855932 26490 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.856480 26490 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.859666 26490 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:58.861387 26488 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:58.861919 26488 ts_tablet_manager.cc:1403] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.001s
I20260709 13:07:58.862437 26486 tablet_bootstrap.cc:654] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.864941 26488 raft_consensus.cc:359] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.865737 26488 raft_consensus.cc:385] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.866070 26488 raft_consensus.cc:740] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.867007 26485 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:58.867532 26485 ts_tablet_manager.cc:1403] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.005s
I20260709 13:07:58.870814 26488 consensus_queue.cc:260] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.872644 26485 raft_consensus.cc:359] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.873452 26485 raft_consensus.cc:385] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.873780 26485 raft_consensus.cc:740] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.874548 26485 consensus_queue.cc:260] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.875731 26486 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.876226 26486 ts_tablet_manager.cc:1403] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:07:58.877157 26488 ts_tablet_manager.cc:1434] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 13:07:58.878149 26488 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:58.879076 26486 raft_consensus.cc:359] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.879812 26486 raft_consensus.cc:385] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.880127 26486 raft_consensus.cc:740] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.880903 26486 consensus_queue.cc:260] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.882380 26485 ts_tablet_manager.cc:1434] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:58.883351 26485 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:58.883747 26486 ts_tablet_manager.cc:1434] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:58.884743 26486 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.890305 26485 tablet_bootstrap.cc:654] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.891700 26486 tablet_bootstrap.cc:654] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.905292 26486 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.905946 26486 ts_tablet_manager.cc:1403] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:07:58.912266 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:58.914603 26486 raft_consensus.cc:359] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
W20260709 13:07:58.915103 26257 leader_election.cc:343] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.915490 26486 raft_consensus.cc:385] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.915814 26486 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.916549 26486 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.919015 26491 raft_consensus.cc:493] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.919796 26491 raft_consensus.cc:515] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.923787 26488 tablet_bootstrap.cc:654] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.926009 26485 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:58.926744 26485 ts_tablet_manager.cc:1403] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.014s
I20260709 13:07:58.930969 26491 leader_election.cc:290] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:58.930863 26485 raft_consensus.cc:359] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:58.932248 26485 raft_consensus.cc:385] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.933099 26485 raft_consensus.cc:740] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.943110 26486 ts_tablet_manager.cc:1434] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.037s	user 0.012s	sys 0.019s
I20260709 13:07:58.944526 26486 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.946540 26488 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:58.947105 26488 ts_tablet_manager.cc:1403] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.004s
I20260709 13:07:58.934899 26485 consensus_queue.cc:260] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:58.950732 26488 raft_consensus.cc:359] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.951752 26488 raft_consensus.cc:385] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.951767 26486 tablet_bootstrap.cc:654] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.952298 26488 raft_consensus.cc:740] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.953310 26488 consensus_queue.cc:260] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.955869 26488 ts_tablet_manager.cc:1434] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:58.956504 26485 ts_tablet_manager.cc:1434] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:07:58.957012 26488 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:58.964807 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
W20260709 13:07:58.975387 26257 leader_election.cc:343] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.976073 26257 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0; no voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:58.979100 26490 raft_consensus.cc:2749] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.980471 26488 tablet_bootstrap.cc:654] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.984540 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:58.985566 26293 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 0.
I20260709 13:07:58.987578 26486 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:58.988137 26486 ts_tablet_manager.cc:1403] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.025s
I20260709 13:07:58.988651 26407 leader_election.cc:304] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:07:58.991310 26504 raft_consensus.cc:2804] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.991816 26504 raft_consensus.cc:493] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.991412 26486 raft_consensus.cc:359] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:58.992189 26504 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.992455 26486 raft_consensus.cc:385] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.992913 26486 raft_consensus.cc:740] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.993477 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:58.993752 26486 consensus_queue.cc:260] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
W20260709 13:07:58.995132 26406 leader_election.cc:343] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.996681 26486 ts_tablet_manager.cc:1434] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:07:58.997853 26486 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:58.999186 26485 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:59.001443 26494 raft_consensus.cc:493] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.002005 26494 raft_consensus.cc:515] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.005316 26494 leader_election.cc:290] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.007473 26486 tablet_bootstrap.cc:654] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.008462 26490 raft_consensus.cc:493] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.008124 26504 raft_consensus.cc:515] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.012580 26490 raft_consensus.cc:515] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.021917 26490 leader_election.cc:290] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.023247 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.023931 26368 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 0.
I20260709 13:07:59.025367 26488 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.025859 26488 ts_tablet_manager.cc:1403] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.008s
I20260709 13:07:59.026206 26485 tablet_bootstrap.cc:654] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.026474 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.024084 26504 leader_election.cc:290] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.027745 26257 leader_election.cc:304] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:07:59.028757 26490 raft_consensus.cc:2804] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:59.028940 26257 leader_election.cc:343] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.029312 26490 raft_consensus.cc:493] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.029763 26490 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.030225 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.032241 26293 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.037793 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
W20260709 13:07:59.040143 26406 leader_election.cc:343] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.043802 26490 raft_consensus.cc:515] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.046316 26490 leader_election.cc:290] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.048503 26488 raft_consensus.cc:359] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.049284 26488 raft_consensus.cc:385] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.049566 26488 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.048650 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:07:59.053622 26504 raft_consensus.cc:493] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.053802 26257 leader_election.cc:343] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.054250 26504 raft_consensus.cc:515] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:59.055675 26488 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.064114 26486 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:59.064224 26504 leader_election.cc:290] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.061434 26293 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 1.
I20260709 13:07:59.064687 26486 ts_tablet_manager.cc:1403] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.000s
I20260709 13:07:59.067400 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.068814 26292 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 0.
I20260709 13:07:59.069471 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:07:59.070259 26368 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.070361 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.071983 26488 ts_tablet_manager.cc:1434] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.001s
I20260709 13:07:59.072510 26486 raft_consensus.cc:359] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.067734 26407 leader_election.cc:304] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.074188 26486 raft_consensus.cc:385] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.074682 26486 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.075363 26407 leader_election.cc:304] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:07:59.075448 26486 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
W20260709 13:07:59.075999 26406 leader_election.cc:343] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.075487 26504 raft_consensus.cc:2804] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.076437 26491 raft_consensus.cc:2804] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.077675 26491 raft_consensus.cc:493] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.079435 26491 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.086870 26368 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 1.
I20260709 13:07:59.088160 26257 leader_election.cc:304] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:07:59.089320 26490 raft_consensus.cc:2804] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.098317 26491 raft_consensus.cc:515] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:59.096257 26488 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:59.106652 26491 leader_election.cc:290] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.107407 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.108016 26292 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.111871 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
W20260709 13:07:59.116093 26406 leader_election.cc:343] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.117444 26485 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:59.118057 26504 raft_consensus.cc:697] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:07:59.118973 26485 ts_tablet_manager.cc:1403] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.003s
I20260709 13:07:59.119448 26490 raft_consensus.cc:697] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:07:59.120484 26504 consensus_queue.cc:237] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.124470 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
W20260709 13:07:59.126298 26333 leader_election.cc:343] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.126504 26486 ts_tablet_manager.cc:1434] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.062s	user 0.002s	sys 0.010s
I20260709 13:07:59.129175 26486 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:59.128439 26490 consensus_queue.cc:237] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.131958 26292 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 1.
I20260709 13:07:59.133299 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.134609 26442 raft_consensus.cc:2468] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 0.
I20260709 13:07:59.136157 26407 leader_election.cc:304] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.136976 26332 leader_election.cc:304] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.139459 26494 raft_consensus.cc:2804] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.139920 26516 raft_consensus.cc:2804] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.140233 26494 raft_consensus.cc:493] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.140163 26488 tablet_bootstrap.cc:654] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.140833 26494 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.141388 26516 raft_consensus.cc:697] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:07:59.143050 26516 consensus_queue.cc:237] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:59.145530 26485 raft_consensus.cc:359] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.152201 26485 raft_consensus.cc:385] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.154779 26485 raft_consensus.cc:740] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.157613 26485 consensus_queue.cc:260] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.160964 26485 ts_tablet_manager.cc:1434] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.004s
I20260709 13:07:59.162065 26485 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:59.161957 26494 raft_consensus.cc:515] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.162760 26486 tablet_bootstrap.cc:654] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.166512 26504 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.167959 26504 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.172459 26494 leader_election.cc:290] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.173538 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.173867 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:07:59.174276 26504 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.174501 26442 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:59.179924 26333 leader_election.cc:343] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.181595 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.182976 26292 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 0.
I20260709 13:07:59.181921 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.186204 26407 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:07:59.185792 26521 raft_consensus.cc:493] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.187901 26504 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.188355 26504 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.188750 26504 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.188222 26521 raft_consensus.cc:515] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.191761 26521 leader_election.cc:290] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
W20260709 13:07:59.192731 26406 leader_election.cc:343] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.195134 26488 tablet_bootstrap.cc:492] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.195643 26488 ts_tablet_manager.cc:1403] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.015s
I20260709 13:07:59.193415 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.197602 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.197940 26292 raft_consensus.cc:2468] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 0.
W20260709 13:07:59.199481 26332 leader_election.cc:343] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.200488 26442 raft_consensus.cc:2468] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 1.
I20260709 13:07:59.200482 26333 leader_election.cc:304] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:07:59.200258 26488 raft_consensus.cc:359] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.202907 26488 raft_consensus.cc:385] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.203285 26488 raft_consensus.cc:740] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.204633 26521 raft_consensus.cc:2804] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.205011 26521 raft_consensus.cc:493] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.205346 26521 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.207304 26332 leader_election.cc:304] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.207185 26488 consensus_queue.cc:260] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.207669 26504 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.208418 26494 raft_consensus.cc:2804] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.209779 26504 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.211771 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.212492 26292 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.213079 26485 tablet_bootstrap.cc:654] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.219786 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
W20260709 13:07:59.222708 26406 leader_election.cc:343] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.227798 26486 tablet_bootstrap.cc:492] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:59.228365 26486 ts_tablet_manager.cc:1403] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.008s
I20260709 13:07:59.232528 26486 raft_consensus.cc:359] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.233047 26488 ts_tablet_manager.cc:1434] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:07:59.233300 26486 raft_consensus.cc:385] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.233613 26486 raft_consensus.cc:740] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.234315 26486 consensus_queue.cc:260] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.238972 26486 ts_tablet_manager.cc:1434] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:59.240091 26486 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: Bootstrap starting.
I20260709 13:07:59.234082 26488 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:59.237982 26189 catalog_manager.cc:5697] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.243741 26485 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:59.234557 26494 raft_consensus.cc:697] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:07:59.245878 26485 ts_tablet_manager.cc:1403] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.009s
I20260709 13:07:59.236856 26188 catalog_manager.cc:5697] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.246479 26494 consensus_queue.cc:237] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.250864 26525 raft_consensus.cc:493] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.257532 26486 tablet_bootstrap.cc:654] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.258159 26488 tablet_bootstrap.cc:654] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.252825 26525 raft_consensus.cc:515] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.262271 26292 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 1.
I20260709 13:07:59.263540 26524 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.264328 26407 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.264029 26524 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.266397 26504 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.264837 26521 raft_consensus.cc:515] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.267359 26504 raft_consensus.cc:697] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:07:59.267967 26485 raft_consensus.cc:359] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.269332 26504 consensus_queue.cc:237] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.269938 26485 raft_consensus.cc:385] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.270251 26485 raft_consensus.cc:740] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.270344 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.271060 26485 consensus_queue.cc:260] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
W20260709 13:07:59.271795 26333 leader_election.cc:343] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.272262 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.269258 26524 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.275602 26442 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 0.
I20260709 13:07:59.276612 26485 ts_tablet_manager.cc:1434] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:07:59.276868 26516 raft_consensus.cc:493] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.277320 26516 raft_consensus.cc:515] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.279564 26332 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.280050 26521 leader_election.cc:290] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.281556 26521 raft_consensus.cc:2804] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.279600 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.284622 26516 leader_election.cc:290] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.284839 26292 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.284891 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:07:59.285566 26442 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.282545 26521 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.290838 26521 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.294620 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.295481 26293 raft_consensus.cc:2468] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 0.
I20260709 13:07:59.298171 26485 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:59.300801 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.300935 26407 leader_election.cc:304] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:07:59.305600 26516 raft_consensus.cc:2804] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.305969 26516 raft_consensus.cc:493] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.302202 26525 leader_election.cc:290] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.306329 26516 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.308631 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.310045 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
W20260709 13:07:59.309109 26406 leader_election.cc:343] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.311997 26293 raft_consensus.cc:2393] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f08a9bfae86d43f79fa054db0cb6bf62 in current term 1: Already voted for candidate 86bd6e0313e748f99a134b7fb1f060b5 in this term.
I20260709 13:07:59.314885 26515 raft_consensus.cc:493] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.315646 26515 raft_consensus.cc:515] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.317404 26488 tablet_bootstrap.cc:492] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.319199 26333 leader_election.cc:304] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f08a9bfae86d43f79fa054db0cb6bf62; no voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.321465 26525 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.319940 26488 ts_tablet_manager.cc:1403] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.086s	user 0.007s	sys 0.006s
I20260709 13:07:59.324913 26515 leader_election.cc:290] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.325156 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.327080 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
W20260709 13:07:59.328336 26407 leader_election.cc:343] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.329293 26442 raft_consensus.cc:2468] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 1.
W20260709 13:07:59.329842 26406 leader_election.cc:343] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.330302 26406 leader_election.cc:304] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5; no voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.332037 26515 raft_consensus.cc:2749] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.332297 26332 leader_election.cc:304] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:07:59.333422 26494 raft_consensus.cc:2804] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.334299 26494 raft_consensus.cc:697] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:07:59.335137 26494 consensus_queue.cc:237] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.336305 26485 tablet_bootstrap.cc:654] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.338227 26292 raft_consensus.cc:2468] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 1.
I20260709 13:07:59.338011 26516 raft_consensus.cc:515] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.340179 26486 tablet_bootstrap.cc:492] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: No bootstrap required, opened a new log
I20260709 13:07:59.340651 26486 ts_tablet_manager.cc:1403] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent bootstrapping tablet: real 0.101s	user 0.014s	sys 0.009s
I20260709 13:07:59.349521 26516 leader_election.cc:290] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.350556 26521 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.351701 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:07:59.349970 26525 raft_consensus.cc:2749] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.354372 26292 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.356595 26488 raft_consensus.cc:359] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.360041 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:07:59.358070 26488 raft_consensus.cc:385] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:59.362931 26406 leader_election.cc:343] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.363062 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
W20260709 13:07:59.364984 26333 leader_election.cc:343] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.366406 26486 raft_consensus.cc:359] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.367041 26486 raft_consensus.cc:385] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.367340 26486 raft_consensus.cc:740] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.368008 26486 consensus_queue.cc:260] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.363674 26488 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.369483 26488 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.371447 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:07:59.372061 26442 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.370153 26521 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.373401 26488 ts_tablet_manager.cc:1434] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:07:59.373430 26292 raft_consensus.cc:2468] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 1.
I20260709 13:07:59.374576 26488 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:59.379905 26442 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 1.
I20260709 13:07:59.381117 26332 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.382498 26486 ts_tablet_manager.cc:1434] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 13:07:59.384804 26407 leader_election.cc:304] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.385682 26516 raft_consensus.cc:2804] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.386162 26516 raft_consensus.cc:697] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:07:59.386978 26516 consensus_queue.cc:237] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.383709 26521 raft_consensus.cc:2804] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.391100 26521 raft_consensus.cc:697] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:07:59.393299 26485 tablet_bootstrap.cc:492] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:59.394544 26485 ts_tablet_manager.cc:1403] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.017s
I20260709 13:07:59.398628 26521 consensus_queue.cc:237] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.402169 26488 tablet_bootstrap.cc:654] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.400484 26188 catalog_manager.cc:5697] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 0 to 1, leader changed from <none> to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.405259 26188 catalog_manager.cc:5697] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 0 to 1, leader changed from <none> to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.407370 26485 raft_consensus.cc:359] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.408391 26485 raft_consensus.cc:385] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.408763 26485 raft_consensus.cc:740] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.411616 26485 consensus_queue.cc:260] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.416162 26485 ts_tablet_manager.cc:1434] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:07:59.419114 26485 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:59.418080 26488 tablet_bootstrap.cc:492] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.421736 26187 catalog_manager.cc:5697] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.422498 26488 ts_tablet_manager.cc:1403] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.001s
I20260709 13:07:59.425348 26187 catalog_manager.cc:5697] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.427052 26488 raft_consensus.cc:359] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:59.427894 26488 raft_consensus.cc:385] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.428215 26488 raft_consensus.cc:740] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.429018 26488 consensus_queue.cc:260] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:07:59.434355 26488 ts_tablet_manager.cc:1434] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:07:59.438808 26485 tablet_bootstrap.cc:654] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.444341 26488 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:59.449787 26189 catalog_manager.cc:5697] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 0 to 1, leader changed from <none> to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.451864 26485 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:59.451969 26488 tablet_bootstrap.cc:654] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.452517 26485 ts_tablet_manager.cc:1403] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.002s
I20260709 13:07:59.455520 26485 raft_consensus.cc:359] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.456302 26485 raft_consensus.cc:385] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.456648 26485 raft_consensus.cc:740] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.463835 26190 catalog_manager.cc:5697] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.457432 26485 consensus_queue.cc:260] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.472134 26485 ts_tablet_manager.cc:1434] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:07:59.475086 26485 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: Bootstrap starting.
I20260709 13:07:59.477083 26488 tablet_bootstrap.cc:492] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.477722 26488 ts_tablet_manager.cc:1403] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.012s
I20260709 13:07:59.480474 26488 raft_consensus.cc:359] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.481181 26488 raft_consensus.cc:385] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.481448 26488 raft_consensus.cc:740] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.482209 26488 consensus_queue.cc:260] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.484149 26485 tablet_bootstrap.cc:654] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.487010 26488 ts_tablet_manager.cc:1434] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:59.487962 26488 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: Bootstrap starting.
I20260709 13:07:59.496744 26488 tablet_bootstrap.cc:654] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.501945 26485 tablet_bootstrap.cc:492] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: No bootstrap required, opened a new log
I20260709 13:07:59.502487 26485 ts_tablet_manager.cc:1403] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.006s
I20260709 13:07:59.503015 26488 tablet_bootstrap.cc:492] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: No bootstrap required, opened a new log
I20260709 13:07:59.503566 26488 ts_tablet_manager.cc:1403] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:07:59.505064 26485 raft_consensus.cc:359] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.505817 26485 raft_consensus.cc:385] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.505618 26488 raft_consensus.cc:359] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.506139 26485 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.506361 26488 raft_consensus.cc:385] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.506724 26488 raft_consensus.cc:740] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.506865 26485 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.509004 26485 ts_tablet_manager.cc:1434] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:07:59.507965 26488 consensus_queue.cc:260] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.512192 26488 ts_tablet_manager.cc:1434] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:07:59.548633 26238 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:59.575120 26516 raft_consensus.cc:493] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.575740 26516 raft_consensus.cc:515] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.577721 26516 leader_election.cc:290] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:07:59.578766 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.579466 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.580284 26368 raft_consensus.cc:2393] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 86bd6e0313e748f99a134b7fb1f060b5 in current term 1: Already voted for candidate baefebef5daf4ce9bd4eed367909d5d0 in this term.
I20260709 13:07:59.581312 26406 leader_election.cc:304] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5; no voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.581312 26516 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.582248 26515 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.589509 26515 raft_consensus.cc:2749] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.598218 26368 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.606948 26504 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.614434 26521 raft_consensus.cc:493] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.614977 26521 raft_consensus.cc:515] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.618944 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.619912 26293 raft_consensus.cc:2393] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f08a9bfae86d43f79fa054db0cb6bf62 in current term 1: Already voted for candidate 86bd6e0313e748f99a134b7fb1f060b5 in this term.
I20260709 13:07:59.621176 26521 leader_election.cc:290] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.621378 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.623099 26332 leader_election.cc:304] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f08a9bfae86d43f79fa054db0cb6bf62; no voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.624284 26521 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.631495 26521 raft_consensus.cc:2749] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.632018 26504 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.644282 26504 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.664219 26521 consensus_queue.cc:1048] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.674562 26293 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.683435 26494 consensus_queue.cc:1048] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.698159 26490 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.720705 26556 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.774760 26557 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.775295 26557 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.777189 26557 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.778105 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.778246 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.779096 26442 raft_consensus.cc:2393] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baefebef5daf4ce9bd4eed367909d5d0 in current term 1: Already voted for candidate f08a9bfae86d43f79fa054db0cb6bf62 in this term.
I20260709 13:07:59.780171 26257 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0; no voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.780864 26557 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.786741 26490 raft_consensus.cc:493] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.787259 26490 raft_consensus.cc:515] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.788406 26557 raft_consensus.cc:2749] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.789021 26490 leader_election.cc:290] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.789904 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" is_pre_election: true
I20260709 13:07:59.790535 26368 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 0.
I20260709 13:07:59.790813 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.791462 26442 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 0.
I20260709 13:07:59.791671 26257 leader_election.cc:304] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:07:59.792415 26490 raft_consensus.cc:2804] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.792778 26490 raft_consensus.cc:493] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.793103 26490 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.797962 26490 raft_consensus.cc:515] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.799950 26490 leader_election.cc:290] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.800761 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:07:59.801370 26368 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.801549 26494 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.802006 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:07:59.802639 26442 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.810076 26368 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 1.
I20260709 13:07:59.810978 26442 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 1.
I20260709 13:07:59.811792 26257 leader_election.cc:304] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:07:59.812839 26490 raft_consensus.cc:2804] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.813333 26490 raft_consensus.cc:697] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:07:59.814237 26490 consensus_queue.cc:237] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.825361 26504 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.829149 26521 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.852187 26188 catalog_manager.cc:5697] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.857956 26521 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.858507 26521 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:07:59.861896 26521 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:07:59.862071 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5" is_pre_election: true
I20260709 13:07:59.865216 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0" is_pre_election: true
I20260709 13:07:59.862953 26368 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.874873 26333 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f08a9bfae86d43f79fa054db0cb6bf62; no voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.878139 26521 raft_consensus.cc:2749] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.880370 26515 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.900652 26521 consensus_queue.cc:1048] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.929239 26494 consensus_queue.cc:1048] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.944859 26441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:07:59.945463 26441 raft_consensus.cc:606] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.953994 26441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:07:59.954218 26515 consensus_queue.cc:1048] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.954630 26441 raft_consensus.cc:606] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.958817 26515 consensus_queue.cc:1048] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.971323 26441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:07:59.972064 26441 raft_consensus.cc:606] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:07:59.980722 26441 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:07:59.982434 26441 raft_consensus.cc:606] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:07:59.989609 26504 raft_consensus.cc:993] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:07:59.990129 26504 raft_consensus.cc:1081] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:07:59.992107 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59678
I20260709 13:07:59.992750 26368 raft_consensus.cc:493] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.994163 26368 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.001416 26368 raft_consensus.cc:515] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.005299 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:00.006124 26293 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.011683 26368 leader_election.cc:290] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 2 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:00.012539 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caff12beb7de4b9eb31475adead162fa" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:00.013804 26441 raft_consensus.cc:3055] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.014267 26441 raft_consensus.cc:740] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:00.014974 26293 raft_consensus.cc:2468] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 2.
I20260709 13:08:00.016247 26333 leader_election.cc:304] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:00.015381 26441 consensus_queue.cc:260] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.017127 26494 raft_consensus.cc:2804] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.017720 26494 raft_consensus.cc:697] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:00.018322 26441 raft_consensus.cc:3060] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.018859 26494 consensus_queue.cc:237] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.026942 26515 raft_consensus.cc:993] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.027599 26515 raft_consensus.cc:1081] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.027652 26441 raft_consensus.cc:2468] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 2.
I20260709 13:08:00.030088 26293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43988
I20260709 13:08:00.030920 26293 raft_consensus.cc:493] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.031533 26293 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.033140 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
mode: GRACEFUL
new_leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:44004
I20260709 13:08:00.030134 26187 catalog_manager.cc:5697] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 1 to 2, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.033855 26292 raft_consensus.cc:606] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Received request to transfer leadership to TS 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:08:00.041806 26293 raft_consensus.cc:515] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:00.045713 26293 leader_election.cc:290] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Requested vote from peers 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:00.046626 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:00.047312 26441 raft_consensus.cc:3055] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.047129 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:00.047796 26441 raft_consensus.cc:740] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:00.048053 26368 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.048831 26441 consensus_queue.cc:260] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:00.050169 26441 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.053934 26368 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.055409 26257 leader_election.cc:304] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:00.056381 26490 raft_consensus.cc:2804] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.056936 26490 raft_consensus.cc:697] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:00.057214 26441 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.058001 26490 consensus_queue.cc:237] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:00.066332 26187 catalog_manager.cc:5697] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 1 to 2, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.223539 26515 raft_consensus.cc:993] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.224107 26504 raft_consensus.cc:1081] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.225965 26293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43988
I20260709 13:08:00.226593 26293 raft_consensus.cc:493] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.226991 26293 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.234275 26293 raft_consensus.cc:515] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.237352 26293 leader_election.cc:290] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:00.238250 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:00.238888 26368 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.238962 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:00.239674 26441 raft_consensus.cc:3055] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.240067 26441 raft_consensus.cc:740] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:00.240947 26441 consensus_queue.cc:260] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.243494 26504 raft_consensus.cc:993] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.244038 26504 raft_consensus.cc:1081] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:00.245105 26441 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.247197 26368 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.251129 26293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43988
I20260709 13:08:00.251868 26293 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.252285 26293 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.254205 26441 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.254148 26257 leader_election.cc:304] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:00.255375 26490 raft_consensus.cc:2804] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.255956 26490 raft_consensus.cc:697] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:00.256910 26490 consensus_queue.cc:237] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.260142 26293 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.262817 26293 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:00.264374 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:00.264907 26187 catalog_manager.cc:5697] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 1 to 2, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.266023 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:00.266636 26368 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.268536 26441 raft_consensus.cc:3055] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.268936 26441 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:00.269881 26441 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.271400 26441 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.274238 26368 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.275576 26257 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:00.276491 26490 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.277101 26490 raft_consensus.cc:697] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:00.278642 26490 consensus_queue.cc:237] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.279687 26441 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:00.289634 26188 catalog_manager.cc:5697] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 1 to 2, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.297731 26490 consensus_queue.cc:1048] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.314396 26490 consensus_queue.cc:1048] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.323894 26490 raft_consensus.cc:993] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: : Instructing follower 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:00.324354 26557 raft_consensus.cc:1081] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Signalling peer 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:00.326078 26441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:50638
I20260709 13:08:00.326784 26441 raft_consensus.cc:493] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.327216 26441 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.332278 26441 raft_consensus.cc:515] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.334918 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:00.335094 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4d44f2ecff94e8fb67912f511748612" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:00.335618 26293 raft_consensus.cc:3055] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.335703 26441 leader_election.cc:290] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 2 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:00.336125 26293 raft_consensus.cc:740] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:00.335618 26368 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.336951 26293 consensus_queue.cc:260] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.337970 26293 raft_consensus.cc:3060] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.344373 26293 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 2.
I20260709 13:08:00.345541 26368 raft_consensus.cc:2468] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 2.
I20260709 13:08:00.345618 26407 leader_election.cc:304] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:00.346606 26516 raft_consensus.cc:2804] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.347121 26516 raft_consensus.cc:697] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:00.347988 26516 consensus_queue.cc:237] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:00.354852 26187 catalog_manager.cc:5697] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 1 to 2, leader changed from baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129) to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.407999 26293 raft_consensus.cc:1275] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.409469 26524 consensus_queue.cc:1048] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.418556 26441 raft_consensus.cc:1275] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.420470 26521 consensus_queue.cc:1048] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.549522 26368 raft_consensus.cc:1275] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.551069 26557 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.568434 26441 raft_consensus.cc:1275] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.569844 26557 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.791661 26368 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.793035 26557 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.800788 26441 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.803862 26490 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.808842 26367 raft_consensus.cc:1275] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.809032 26368 raft_consensus.cc:1275] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.810820 26516 consensus_queue.cc:1048] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.814113 26490 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.833477 26441 raft_consensus.cc:1275] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.833703 26293 raft_consensus.cc:1275] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.842283 26557 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.841812 26515 consensus_queue.cc:1048] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:03.067111 26158 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:08:03.067981 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.088320 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
mode: GRACEFUL
new_leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:58802
I20260709 13:08:03.088883 26292 raft_consensus.cc:606] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Received request to transfer leadership to TS 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:08:03.099519 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:03.100095 26368 raft_consensus.cc:606] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Received request to transfer leadership to TS 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:08:03.101289 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:03.102044 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:03.110795 26582 raft_consensus.cc:993] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: : Instructing follower 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:03.111299 26490 raft_consensus.cc:1081] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Signalling peer 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:03.112862 26442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:50638
I20260709 13:08:03.113371 26442 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.113659 26442 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.118278 26442 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.119990 26442 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 3 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:03.120965 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:03.121122 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:03.121596 26292 raft_consensus.cc:3055] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:03.121752 26368 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.121919 26292 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:03.122768 26292 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.123746 26292 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.126456 26368 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 3.
I20260709 13:08:03.127506 26406 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:03.128262 26578 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:03.128495 26292 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 3.
I20260709 13:08:03.129631 26578 raft_consensus.cc:697] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:03.130448 26578 consensus_queue.cc:237] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.137850 26188 catalog_manager.cc:5697] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 2 to 3, leader changed from baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129) to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.277254 26525 raft_consensus.cc:993] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:03.277658 26589 raft_consensus.cc:1081] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Signalling peer 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:03.279263 26442 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:50648
I20260709 13:08:03.279796 26442 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.280144 26442 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.284890 26442 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.286607 26442 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 2 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:03.287542 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:03.287873 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:03.288132 26292 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.288400 26368 raft_consensus.cc:3055] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:03.288692 26368 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:03.289279 26368 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.290143 26368 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:03.293416 26292 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 2.
I20260709 13:08:03.294062 26368 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 2.
I20260709 13:08:03.294595 26407 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:03.295533 26578 raft_consensus.cc:2804] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:03.296006 26578 raft_consensus.cc:697] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:03.296865 26578 consensus_queue.cc:237] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:03.307291 26188 catalog_manager.cc:5697] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 1 to 2, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.590019 26292 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.591284 26578 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.607523 26368 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.609999 26594 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.836218 26292 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.837534 26594 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.845969 26368 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.847474 26594 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:04.102938 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:04.114356 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:44004
I20260709 13:08:04.115005 26292 raft_consensus.cc:606] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:08:04.120394 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:44004
I20260709 13:08:04.121045 26292 raft_consensus.cc:606] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:08:04.126251 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:44004
I20260709 13:08:04.126819 26292 raft_consensus.cc:606] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:08:04.131914 26442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:08:04.132534 26442 raft_consensus.cc:606] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:08:04.145136 26442 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
mode: GRACEFUL
new_leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:50654
I20260709 13:08:04.145735 26442 raft_consensus.cc:606] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Received request to transfer leadership to TS f08a9bfae86d43f79fa054db0cb6bf62
I20260709 13:08:04.308708 26490 raft_consensus.cc:993] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.309152 26599 raft_consensus.cc:1081] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.310681 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59664
I20260709 13:08:04.311249 26368 raft_consensus.cc:493] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.311599 26368 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.316243 26368 raft_consensus.cc:515] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:04.317763 26368 leader_election.cc:290] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:04.318670 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:04.318943 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0addee29216b4f8b84c0f7e606a74e76" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:04.319150 26292 raft_consensus.cc:3055] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:04.319497 26292 raft_consensus.cc:740] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:04.319554 26442 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.320170 26292 consensus_queue.cc:260] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:04.321099 26292 raft_consensus.cc:3060] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.324802 26442 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.325848 26292 raft_consensus.cc:2468] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.325917 26332 leader_election.cc:304] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:04.326781 26589 raft_consensus.cc:2804] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:04.327785 26589 raft_consensus.cc:697] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:04.328642 26589 consensus_queue.cc:237] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } }
I20260709 13:08:04.335235 26188 catalog_manager.cc:5697] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 2 to 3, leader changed from baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 3 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.394186 26594 raft_consensus.cc:993] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.394614 26578 raft_consensus.cc:1081] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.396077 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59678
I20260709 13:08:04.396512 26368 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.396812 26368 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:04.400592 26368 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.402061 26368 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 4 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:04.402858 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:04.403219 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:04.403476 26292 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:04.403765 26442 raft_consensus.cc:3055] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:04.404079 26442 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:04.404865 26442 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.406073 26442 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:04.410147 26292 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 4.
I20260709 13:08:04.411384 26333 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:04.412150 26589 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:04.412348 26442 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 4.
I20260709 13:08:04.412631 26589 raft_consensus.cc:697] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:04.413595 26589 consensus_queue.cc:237] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.419821 26188 catalog_manager.cc:5697] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 3 to 4, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 4 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.441882 26490 raft_consensus.cc:993] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.442312 26599 raft_consensus.cc:1081] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.444150 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59664
I20260709 13:08:04.444788 26368 raft_consensus.cc:493] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.445174 26368 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.451843 26368 raft_consensus.cc:515] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.453538 26368 leader_election.cc:290] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:04.454528 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:04.454725 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c6b4add6451416d96cec9231ae64def" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:04.454986 26442 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.455346 26292 raft_consensus.cc:3055] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:04.455657 26292 raft_consensus.cc:740] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:04.456360 26292 consensus_queue.cc:260] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.457342 26292 raft_consensus.cc:3060] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.459331 26442 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.460453 26332 leader_election.cc:304] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:04.461377 26589 raft_consensus.cc:2804] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:04.461874 26589 raft_consensus.cc:697] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:04.462706 26589 consensus_queue.cc:237] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.464514 26292 raft_consensus.cc:2468] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.466563 26578 raft_consensus.cc:993] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.467043 26594 raft_consensus.cc:1081] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.468655 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59678
I20260709 13:08:04.469134 26368 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.469496 26368 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.476161 26368 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.478387 26368 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:04.478506 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:04.479290 26292 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.479454 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:04.480104 26442 raft_consensus.cc:3055] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:04.479516 26188 catalog_manager.cc:5697] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 2 to 3, leader changed from baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 3 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.480412 26442 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:04.481165 26442 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.482280 26442 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:04.485952 26292 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.487083 26333 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baefebef5daf4ce9bd4eed367909d5d0, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:04.487929 26589 raft_consensus.cc:2804] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:04.488468 26589 raft_consensus.cc:697] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:04.488776 26442 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 3.
I20260709 13:08:04.489195 26589 consensus_queue.cc:237] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.496546 26188 catalog_manager.cc:5697] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 2 to 3, leader changed from 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 3 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.622228 26490 raft_consensus.cc:993] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: : Instructing follower f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.622802 26490 raft_consensus.cc:1081] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Signalling peer f08a9bfae86d43f79fa054db0cb6bf62 to start an election
I20260709 13:08:04.624554 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
 from {username='slave'} at 127.0.0.1:59664
I20260709 13:08:04.625082 26368 raft_consensus.cc:493] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.625362 26368 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:04.629451 26368 raft_consensus.cc:515] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.630996 26368 leader_election.cc:290] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 2 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:04.632004 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:04.632041 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:04.632717 26442 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:04.632717 26292 raft_consensus.cc:3055] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:04.633188 26292 raft_consensus.cc:740] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:04.633896 26292 consensus_queue.cc:260] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.634948 26292 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:04.639070 26442 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 2.
I20260709 13:08:04.640105 26332 leader_election.cc:304] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, f08a9bfae86d43f79fa054db0cb6bf62; no voters: 
I20260709 13:08:04.640935 26589 raft_consensus.cc:2804] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:04.640916 26292 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f08a9bfae86d43f79fa054db0cb6bf62 in term 2.
I20260709 13:08:04.642481 26589 raft_consensus.cc:697] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Becoming Leader. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:04.643285 26589 consensus_queue.cc:237] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:04.649585 26188 catalog_manager.cc:5697] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 reported cstate change: term changed from 1 to 2, leader changed from baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129) to f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.722972 26442 raft_consensus.cc:1275] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.724237 26589 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.734623 26292 raft_consensus.cc:1275] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.736094 26589 consensus_queue.cc:1048] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.885586 26442 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.886775 26589 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.895720 26292 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.897446 26600 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.961633 26292 raft_consensus.cc:1275] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.963043 26600 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.971822 26442 raft_consensus.cc:1275] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:04.973664 26607 consensus_queue.cc:1048] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:05.006842 26292 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:05.008315 26600 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:05.017493 26441 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:05.019232 26607 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:05.025586 26292 raft_consensus.cc:1275] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.027748 26607 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.037619 26441 raft_consensus.cc:1275] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer f08a9bfae86d43f79fa054db0cb6bf62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.039448 26600 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.150279 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.157752 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:07.158447 26368 raft_consensus.cc:606] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:08:07.161413 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:07.162091 26368 raft_consensus.cc:606] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Received request to transfer leadership to TS 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:08:07.164575 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:07.165037 26368 raft_consensus.cc:606] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:08:07.167310 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec6433f8b1e84996903842e307baf116"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:07.167764 26368 raft_consensus.cc:606] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Received request to transfer leadership to TS baefebef5daf4ce9bd4eed367909d5d0
I20260709 13:08:07.170225 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
mode: GRACEFUL
new_leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:35938
I20260709 13:08:07.170701 26368 raft_consensus.cc:606] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Received request to transfer leadership to TS 86bd6e0313e748f99a134b7fb1f060b5
I20260709 13:08:07.171732 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:07.172197 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:07.198642 26600 raft_consensus.cc:993] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.199281 26624 raft_consensus.cc:1081] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.200788 26292 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b386bc085524223a3733507eb7368cb"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43992
I20260709 13:08:07.201047 26600 raft_consensus.cc:993] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.201339 26292 raft_consensus.cc:493] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.201545 26624 raft_consensus.cc:1081] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.201866 26292 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:07.203502 26293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43992
I20260709 13:08:07.203980 26293 raft_consensus.cc:493] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.204279 26293 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.207404 26292 raft_consensus.cc:515] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.209369 26292 leader_election.cc:290] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 5 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:07.209484 26293 raft_consensus.cc:515] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.210238 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:07.210714 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b386bc085524223a3733507eb7368cb" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:07.210994 26368 raft_consensus.cc:3055] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:07.211265 26442 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:07.211356 26368 raft_consensus.cc:740] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:07.212313 26368 consensus_queue.cc:260] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.212981 26293 leader_election.cc:290] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:07.213605 26368 raft_consensus.cc:3060] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:07.214144 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:07.214627 26441 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.218202 26442 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 5.
I20260709 13:08:07.219982 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4eb35a5328cb4cccac67ca8bbd7d6c4b" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:07.220024 26257 leader_election.cc:304] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:07.220394 26368 raft_consensus.cc:2468] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 5.
I20260709 13:08:07.220408 26441 raft_consensus.cc:2468] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:07.220723 26367 raft_consensus.cc:3055] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.221094 26367 raft_consensus.cc:740] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:07.221999 26367 consensus_queue.cc:260] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.222879 26626 raft_consensus.cc:2804] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:07.223143 26257 leader_election.cc:304] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:07.223520 26367 raft_consensus.cc:3060] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.224123 26626 raft_consensus.cc:697] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 5 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:07.225057 26627 raft_consensus.cc:2804] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.225143 26626 consensus_queue.cc:237] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.225852 26627 raft_consensus.cc:697] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:07.227368 26627 consensus_queue.cc:237] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.232858 26367 raft_consensus.cc:2468] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:07.242553 26188 catalog_manager.cc:5697] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 4 to 5, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 5 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.261917 26188 catalog_manager.cc:5697] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 1 to 2, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.336777 26600 raft_consensus.cc:993] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:07.337275 26600 raft_consensus.cc:1081] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Signalling peer 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:07.339092 26441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:50648
I20260709 13:08:07.339730 26441 raft_consensus.cc:493] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.340126 26441 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.345233 26441 raft_consensus.cc:515] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.347218 26441 leader_election.cc:290] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 3 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:07.348358 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:07.348618 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d08c10d924d485696b43f83e3e08a12" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:07.349107 26293 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.349234 26367 raft_consensus.cc:3055] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.349655 26367 raft_consensus.cc:740] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:07.350558 26367 consensus_queue.cc:260] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.352029 26367 raft_consensus.cc:3060] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.355880 26293 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 3.
I20260709 13:08:07.357196 26407 leader_election.cc:304] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:07.357821 26367 raft_consensus.cc:2468] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 3.
I20260709 13:08:07.358162 26594 raft_consensus.cc:2804] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.359620 26594 raft_consensus.cc:697] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:07.360529 26594 consensus_queue.cc:237] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.368165 26188 catalog_manager.cc:5697] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 2 to 3, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.374411 26624 raft_consensus.cc:993] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:07.374869 26600 raft_consensus.cc:1081] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Signalling peer 86bd6e0313e748f99a134b7fb1f060b5 to start an election
I20260709 13:08:07.376536 26441 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2"
dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
 from {username='slave'} at 127.0.0.1:50648
I20260709 13:08:07.377097 26441 raft_consensus.cc:493] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.377441 26441 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.381865 26441 raft_consensus.cc:515] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.383526 26441 leader_election.cc:290] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 4 election: Requested vote from peers baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877), f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871)
I20260709 13:08:07.384486 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
I20260709 13:08:07.384706 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff182aea9d3a4304b12adee145e7dbb2" candidate_uuid: "86bd6e0313e748f99a134b7fb1f060b5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:07.385005 26293 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.385308 26367 raft_consensus.cc:3055] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:07.385671 26367 raft_consensus.cc:740] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:07.386452 26367 consensus_queue.cc:260] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.387547 26367 raft_consensus.cc:3060] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:07.390185 26293 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 4.
I20260709 13:08:07.391479 26407 leader_election.cc:304] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:07.392484 26594 raft_consensus.cc:2804] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:07.393038 26594 raft_consensus.cc:697] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 LEADER]: Becoming Leader. State: Replica: 86bd6e0313e748f99a134b7fb1f060b5, State: Running, Role: LEADER
I20260709 13:08:07.393494 26367 raft_consensus.cc:2468] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86bd6e0313e748f99a134b7fb1f060b5 in term 4.
I20260709 13:08:07.393851 26594 consensus_queue.cc:237] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.402158 26188 catalog_manager.cc:5697] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 reported cstate change: term changed from 3 to 4, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "86bd6e0313e748f99a134b7fb1f060b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.445346 26624 raft_consensus.cc:993] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: : Instructing follower baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.445791 26600 raft_consensus.cc:1081] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Signalling peer baefebef5daf4ce9bd4eed367909d5d0 to start an election
I20260709 13:08:07.447485 26293 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec6433f8b1e84996903842e307baf116"
dest_uuid: "baefebef5daf4ce9bd4eed367909d5d0"
 from {username='slave'} at 127.0.0.1:43992
I20260709 13:08:07.448040 26293 raft_consensus.cc:493] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.448383 26293 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.452603 26293 raft_consensus.cc:515] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.454214 26293 leader_election.cc:290] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Requested vote from peers f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871), 86bd6e0313e748f99a134b7fb1f060b5 (127.25.139.131:41175)
I20260709 13:08:07.455560 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "86bd6e0313e748f99a134b7fb1f060b5"
I20260709 13:08:07.455412 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6433f8b1e84996903842e307baf116" candidate_uuid: "baefebef5daf4ce9bd4eed367909d5d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f08a9bfae86d43f79fa054db0cb6bf62"
I20260709 13:08:07.456081 26441 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.456130 26367 raft_consensus.cc:3055] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.456525 26367 raft_consensus.cc:740] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f08a9bfae86d43f79fa054db0cb6bf62, State: Running, Role: LEADER
I20260709 13:08:07.457273 26367 consensus_queue.cc:260] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.458271 26367 raft_consensus.cc:3060] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.460745 26441 raft_consensus.cc:2468] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:07.461889 26257 leader_election.cc:304] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86bd6e0313e748f99a134b7fb1f060b5, baefebef5daf4ce9bd4eed367909d5d0; no voters: 
I20260709 13:08:07.462678 26627 raft_consensus.cc:2804] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.463243 26627 raft_consensus.cc:697] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Becoming Leader. State: Replica: baefebef5daf4ce9bd4eed367909d5d0, State: Running, Role: LEADER
I20260709 13:08:07.464552 26367 raft_consensus.cc:2468] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baefebef5daf4ce9bd4eed367909d5d0 in term 2.
I20260709 13:08:07.464190 26627 consensus_queue.cc:237] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } }
I20260709 13:08:07.472340 26188 catalog_manager.cc:5697] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 reported cstate change: term changed from 1 to 2, leader changed from f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130) to baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "baefebef5daf4ce9bd4eed367909d5d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.671561 26367 raft_consensus.cc:1275] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.672863 26627 consensus_queue.cc:1048] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.683789 26441 raft_consensus.cc:1275] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.685381 26627 consensus_queue.cc:1048] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:07.726727 26441 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 5 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:07.728010 26627 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.737124 26367 raft_consensus.cc:1275] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 5 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:07.738751 26628 consensus_queue.cc:1048] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:07.889374 26367 raft_consensus.cc:1275] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:07.890733 26594 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:07.901312 26293 raft_consensus.cc:1275] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:07.905246 26647 consensus_queue.cc:1048] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:07.915679 26293 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:07.916992 26647 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baefebef5daf4ce9bd4eed367909d5d0" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.929517 26367 raft_consensus.cc:1275] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Refusing update from remote peer 86bd6e0313e748f99a134b7fb1f060b5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:07.931263 26594 consensus_queue.cc:1048] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:08.077502 26441 raft_consensus.cc:1275] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:08.078863 26626 consensus_queue.cc:1048] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86bd6e0313e748f99a134b7fb1f060b5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 41175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.081753 26367 raft_consensus.cc:1275] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Refusing update from remote peer baefebef5daf4ce9bd4eed367909d5d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:08.083345 26628 consensus_queue.cc:1048] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f08a9bfae86d43f79fa054db0cb6bf62" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:08.173045 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.178838 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:08:08.203649 26333 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:08.205582 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:08.206540 26158 tablet_replica.cc:333] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.207649 26158 raft_consensus.cc:2243] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.208300 26158 raft_consensus.cc:2272] T ff182aea9d3a4304b12adee145e7dbb2 P baefebef5daf4ce9bd4eed367909d5d0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:08.211117 26333 consensus_peers.cc:597] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 -> Peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Couldn't send request to peer baefebef5daf4ce9bd4eed367909d5d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.211774 26158 tablet_replica.cc:333] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.212349 26158 raft_consensus.cc:2243] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.213028 26158 raft_consensus.cc:2272] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.214977 26158 tablet_replica.cc:333] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.215529 26158 raft_consensus.cc:2243] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.215941 26158 raft_consensus.cc:2272] T caff12beb7de4b9eb31475adead162fa P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.217459 26158 tablet_replica.cc:333] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.217922 26158 raft_consensus.cc:2243] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.218602 26158 raft_consensus.cc:2272] T ec6433f8b1e84996903842e307baf116 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.220536 26158 tablet_replica.cc:333] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.221051 26158 raft_consensus.cc:2243] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.221522 26158 raft_consensus.cc:2272] T c4d44f2ecff94e8fb67912f511748612 P baefebef5daf4ce9bd4eed367909d5d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.223263 26158 tablet_replica.cc:333] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.223718 26158 raft_consensus.cc:2243] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.224159 26158 raft_consensus.cc:2272] T 0addee29216b4f8b84c0f7e606a74e76 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.225776 26158 tablet_replica.cc:333] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.226238 26158 raft_consensus.cc:2243] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.226631 26158 raft_consensus.cc:2272] T 3d08c10d924d485696b43f83e3e08a12 P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.228741 26158 tablet_replica.cc:333] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.229220 26158 raft_consensus.cc:2243] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.229907 26158 raft_consensus.cc:2272] T 2b386bc085524223a3733507eb7368cb P baefebef5daf4ce9bd4eed367909d5d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.231985 26158 tablet_replica.cc:333] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0: stopping tablet replica
I20260709 13:08:08.232417 26158 raft_consensus.cc:2243] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.232792 26158 raft_consensus.cc:2272] T 0c6b4add6451416d96cec9231ae64def P baefebef5daf4ce9bd4eed367909d5d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.336745 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
W20260709 13:08:08.336862 26333 consensus_peers.cc:597] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 -> Peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Couldn't send request to peer baefebef5daf4ce9bd4eed367909d5d0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.340301 26407 consensus_peers.cc:597] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 -> Peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Couldn't send request to peer baefebef5daf4ce9bd4eed367909d5d0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.340778 26407 consensus_peers.cc:597] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 -> Peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Couldn't send request to peer baefebef5daf4ce9bd4eed367909d5d0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.356496 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
W20260709 13:08:08.378017 26406 consensus_peers.cc:597] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 -> Peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Couldn't send request to peer f08a9bfae86d43f79fa054db0cb6bf62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:08.386081 26406 consensus_peers.cc:597] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 -> Peer f08a9bfae86d43f79fa054db0cb6bf62 (127.25.139.130:33871): Couldn't send request to peer f08a9bfae86d43f79fa054db0cb6bf62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.392804 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:08.394104 26158 tablet_replica.cc:333] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.394951 26158 raft_consensus.cc:2243] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.395555 26158 raft_consensus.cc:2272] T c4d44f2ecff94e8fb67912f511748612 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.398324 26158 tablet_replica.cc:333] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.399072 26158 raft_consensus.cc:2243] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:08:08.399081 26407 consensus_peers.cc:597] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 -> Peer baefebef5daf4ce9bd4eed367909d5d0 (127.25.139.129:36877): Couldn't send request to peer baefebef5daf4ce9bd4eed367909d5d0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36877: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:08.400179 26158 raft_consensus.cc:2272] T 0addee29216b4f8b84c0f7e606a74e76 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.402226 26158 tablet_replica.cc:333] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.402787 26158 raft_consensus.cc:2243] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.403270 26158 raft_consensus.cc:2272] T 2b386bc085524223a3733507eb7368cb P f08a9bfae86d43f79fa054db0cb6bf62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.405473 26158 tablet_replica.cc:333] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.406024 26158 raft_consensus.cc:2243] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.406785 26158 raft_consensus.cc:2272] T 0c6b4add6451416d96cec9231ae64def P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.408483 26158 tablet_replica.cc:333] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.408957 26158 raft_consensus.cc:2243] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.409363 26158 raft_consensus.cc:2272] T ff182aea9d3a4304b12adee145e7dbb2 P f08a9bfae86d43f79fa054db0cb6bf62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.411741 26158 tablet_replica.cc:333] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.412357 26158 raft_consensus.cc:2243] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.412808 26158 raft_consensus.cc:2272] T 3d08c10d924d485696b43f83e3e08a12 P f08a9bfae86d43f79fa054db0cb6bf62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.414999 26158 tablet_replica.cc:333] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.415601 26158 raft_consensus.cc:2243] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.416378 26158 raft_consensus.cc:2272] T caff12beb7de4b9eb31475adead162fa P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.418331 26158 tablet_replica.cc:333] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.418853 26158 raft_consensus.cc:2243] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.419327 26158 raft_consensus.cc:2272] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.421408 26158 tablet_replica.cc:333] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62: stopping tablet replica
I20260709 13:08:08.421972 26158 raft_consensus.cc:2243] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.422389 26158 raft_consensus.cc:2272] T ec6433f8b1e84996903842e307baf116 P f08a9bfae86d43f79fa054db0cb6bf62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.450744 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
I20260709 13:08:08.468717 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
I20260709 13:08:08.499119 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:08.499850 26158 tablet_replica.cc:333] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.500414 26158 raft_consensus.cc:2243] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.501127 26158 raft_consensus.cc:2272] T 3d08c10d924d485696b43f83e3e08a12 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.503841 26158 tablet_replica.cc:333] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.504354 26158 raft_consensus.cc:2243] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.504736 26158 raft_consensus.cc:2272] T ec6433f8b1e84996903842e307baf116 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.507375 26158 tablet_replica.cc:333] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.507834 26158 raft_consensus.cc:2243] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.508213 26158 raft_consensus.cc:2272] T 2b386bc085524223a3733507eb7368cb P 86bd6e0313e748f99a134b7fb1f060b5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.510332 26158 tablet_replica.cc:333] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.510800 26158 raft_consensus.cc:2243] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.511608 26158 raft_consensus.cc:2272] T ff182aea9d3a4304b12adee145e7dbb2 P 86bd6e0313e748f99a134b7fb1f060b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.513895 26158 tablet_replica.cc:333] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.514353 26158 raft_consensus.cc:2243] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.514721 26158 raft_consensus.cc:2272] T 4eb35a5328cb4cccac67ca8bbd7d6c4b P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.517043 26158 tablet_replica.cc:333] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.517553 26158 raft_consensus.cc:2243] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.517977 26158 raft_consensus.cc:2272] T caff12beb7de4b9eb31475adead162fa P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.519888 26158 tablet_replica.cc:333] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.520340 26158 raft_consensus.cc:2243] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.520747 26158 raft_consensus.cc:2272] T 0c6b4add6451416d96cec9231ae64def P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.522754 26158 tablet_replica.cc:333] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.523257 26158 raft_consensus.cc:2243] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.523983 26158 raft_consensus.cc:2272] T c4d44f2ecff94e8fb67912f511748612 P 86bd6e0313e748f99a134b7fb1f060b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.525683 26158 tablet_replica.cc:333] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5: stopping tablet replica
I20260709 13:08:08.526134 26158 raft_consensus.cc:2243] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:08.526551 26158 raft_consensus.cc:2272] T 0addee29216b4f8b84c0f7e606a74e76 P 86bd6e0313e748f99a134b7fb1f060b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.554797 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:08:08.572294 26158 master.cc:562] Master@127.25.139.190:34813 shutting down...
I20260709 13:08:08.646399 26245 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:08:08.688272 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:08.688794 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:08.689200 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P f40ccd14007e436faa1958c8aa8bd1e7: stopping tablet replica
I20260709 13:08:08.709537 26158 master.cc:584] Master@127.25.139.190:34813 shutdown complete.
86bd6e0313e748f99a134b7fb1f060b5  1
baefebef5daf4ce9bd4eed367909d5d0  4
f08a9bfae86d43f79fa054db0cb6bf62  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12774 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:08:08.752506 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:42481
I20260709 13:08:08.753765 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:08.758960 26658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:08.760707 26661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:08.760804 26659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:08.760903 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:08.762089 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:08.762269 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:08.762380 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602488762370 us; error 0 us; skew 500 ppm
I20260709 13:08:08.762830 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:08.765177 26158 webserver.cc:533] Webserver started at http://127.25.139.190:35693/ using document root <none> and password file <none>
I20260709 13:08:08.765655 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:08.765805 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:08.766029 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:08.767089 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "a93ba37efa194669908d8bec9dacb377"
format_stamp: "Formatted at 2026-07-09 13:08:08 on dist-test-slave-v5z2"
I20260709 13:08:08.771670 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:08.775116 26666 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:08.776046 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:08.776306 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "a93ba37efa194669908d8bec9dacb377"
format_stamp: "Formatted at 2026-07-09 13:08:08 on dist-test-slave-v5z2"
I20260709 13:08:08.776544 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:08.789157 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:08.790503 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:08.837131 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:42481
I20260709 13:08:08.837251 26717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:42481 every 8 connection(s)
I20260709 13:08:08.841627 26718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:08.852309 26718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377: Bootstrap starting.
I20260709 13:08:08.857407 26718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:08.861971 26718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377: No bootstrap required, opened a new log
I20260709 13:08:08.864101 26718 raft_consensus.cc:359] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER }
I20260709 13:08:08.864470 26718 raft_consensus.cc:385] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:08.864763 26718 raft_consensus.cc:740] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a93ba37efa194669908d8bec9dacb377, State: Initialized, Role: FOLLOWER
I20260709 13:08:08.865331 26718 consensus_queue.cc:260] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER }
I20260709 13:08:08.865767 26718 raft_consensus.cc:399] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:08.865995 26718 raft_consensus.cc:493] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:08.866258 26718 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:08.870299 26718 raft_consensus.cc:515] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER }
I20260709 13:08:08.870849 26718 leader_election.cc:304] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a93ba37efa194669908d8bec9dacb377; no voters: 
I20260709 13:08:08.872145 26718 leader_election.cc:290] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:08.872510 26721 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:08.874135 26721 raft_consensus.cc:697] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 1 LEADER]: Becoming Leader. State: Replica: a93ba37efa194669908d8bec9dacb377, State: Running, Role: LEADER
I20260709 13:08:08.874958 26721 consensus_queue.cc:237] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER }
I20260709 13:08:08.875244 26718 sys_catalog.cc:565] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:08.880019 26723 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a93ba37efa194669908d8bec9dacb377. Latest consensus state: current_term: 1 leader_uuid: "a93ba37efa194669908d8bec9dacb377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER } }
I20260709 13:08:08.880812 26723 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:08.882941 26722 sys_catalog.cc:455] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a93ba37efa194669908d8bec9dacb377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a93ba37efa194669908d8bec9dacb377" member_type: VOTER } }
I20260709 13:08:08.883827 26722 sys_catalog.cc:458] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:08.886902 26730 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:08.892750 26730 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:08.894047 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:08.901724 26730 catalog_manager.cc:1383] Generated new cluster ID: 2bc57999d4c6403a882d0070c5e8aa8f
I20260709 13:08:08.902091 26730 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:08.927970 26730 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:08.929231 26730 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:08.943400 26730 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377: Generated new TSK 0
I20260709 13:08:08.944106 26730 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:08.960659 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:08.967115 26739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:08.967743 26740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:08.970233 26158 server_base.cc:1061] running on GCE node
W20260709 13:08:08.970525 26742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:08.971577 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:08.971846 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:08.972038 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602488972022 us; error 0 us; skew 500 ppm
I20260709 13:08:08.972508 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:08.974753 26158 webserver.cc:533] Webserver started at http://127.25.139.129:40179/ using document root <none> and password file <none>
I20260709 13:08:08.975268 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:08.975435 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:08.975648 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:08.976781 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "0d2ef7d68b00428eb27455b54249aac6"
format_stamp: "Formatted at 2026-07-09 13:08:08 on dist-test-slave-v5z2"
I20260709 13:08:08.982429 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:08.985980 26747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:08.986810 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:08.987116 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "0d2ef7d68b00428eb27455b54249aac6"
format_stamp: "Formatted at 2026-07-09 13:08:08 on dist-test-slave-v5z2"
I20260709 13:08:08.987483 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:09.000411 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:09.001684 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:09.003353 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:09.005609 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:09.005846 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.006090 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:09.006280 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.048115 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:42111
I20260709 13:08:09.048301 26809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:42111 every 8 connection(s)
I20260709 13:08:09.053314 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:09.061879 26814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:09.063668 26815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:09.066541 26817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:09.067121 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:09.068303 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:09.068555 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:09.068734 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602489068718 us; error 0 us; skew 500 ppm
I20260709 13:08:09.069443 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:09.072613 26158 webserver.cc:533] Webserver started at http://127.25.139.130:37253/ using document root <none> and password file <none>
I20260709 13:08:09.072806 26810 heartbeater.cc:344] Connected to a master server at 127.25.139.190:42481
I20260709 13:08:09.073155 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:09.073211 26810 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:09.073441 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:09.073760 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:09.074096 26810 heartbeater.cc:507] Master 127.25.139.190:42481 requested a full tablet report, sending...
I20260709 13:08:09.075505 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "7102af04472b45fea26b3cf86f8acafe"
format_stamp: "Formatted at 2026-07-09 13:08:09 on dist-test-slave-v5z2"
I20260709 13:08:09.076377 26683 ts_manager.cc:194] Registered new tserver with Master: 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111)
I20260709 13:08:09.078896 26683 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51762
I20260709 13:08:09.082048 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:08:09.085243 26822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.086027 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:09.086278 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "7102af04472b45fea26b3cf86f8acafe"
format_stamp: "Formatted at 2026-07-09 13:08:09 on dist-test-slave-v5z2"
I20260709 13:08:09.086522 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:09.104290 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:09.105454 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:09.106906 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:09.109050 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:09.109225 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.109534 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:09.109694 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.152849 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:37873
I20260709 13:08:09.152953 26884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:37873 every 8 connection(s)
I20260709 13:08:09.157723 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:09.165215 26888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:09.166901 26889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:09.170899 26891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:09.171725 26885 heartbeater.cc:344] Connected to a master server at 127.25.139.190:42481
I20260709 13:08:09.171928 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:09.172400 26885 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:09.172983 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:09.173251 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:09.173454 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602489173436 us; error 0 us; skew 500 ppm
I20260709 13:08:09.173372 26885 heartbeater.cc:507] Master 127.25.139.190:42481 requested a full tablet report, sending...
I20260709 13:08:09.174190 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:09.176071 26683 ts_manager.cc:194] Registered new tserver with Master: 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:09.177471 26158 webserver.cc:533] Webserver started at http://127.25.139.131:37713/ using document root <none> and password file <none>
I20260709 13:08:09.177731 26683 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51764
I20260709 13:08:09.178102 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:09.178467 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:09.178771 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:09.180456 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "43440284ac85466d808ba517a4c706b0"
format_stamp: "Formatted at 2026-07-09 13:08:09 on dist-test-slave-v5z2"
I20260709 13:08:09.185619 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:08:09.189711 26896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.190649 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:09.191043 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "43440284ac85466d808ba517a4c706b0"
format_stamp: "Formatted at 2026-07-09 13:08:09 on dist-test-slave-v5z2"
I20260709 13:08:09.191447 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:09.205376 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:09.206678 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:09.208340 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:09.210736 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:09.211006 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.211297 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:09.211489 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:09.254305 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:40531
I20260709 13:08:09.254400 26958 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:40531 every 8 connection(s)
I20260709 13:08:09.268390 26959 heartbeater.cc:344] Connected to a master server at 127.25.139.190:42481
I20260709 13:08:09.268846 26959 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:09.269570 26959 heartbeater.cc:507] Master 127.25.139.190:42481 requested a full tablet report, sending...
I20260709 13:08:09.271652 26683 ts_manager.cc:194] Registered new tserver with Master: 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:09.272199 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014699149s
I20260709 13:08:09.273129 26683 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51778
I20260709 13:08:09.299952 26683 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51792:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:09.303274 26683 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:09.386410 26924 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8fc82001d49a6ae34887f5e5d3de6 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:09.388528 26924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8fc82001d49a6ae34887f5e5d3de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.390691 26921 tablet_service.cc:1511] Processing CreateTablet for tablet d6a0c6598dab4f13b119d424a28d9942 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:09.391129 26923 tablet_service.cc:1511] Processing CreateTablet for tablet 99775683f19743b99dff361620aa59e4 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:09.389146 26922 tablet_service.cc:1511] Processing CreateTablet for tablet faf93b6ad00f4635804a9b526453cba3 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:09.392561 26921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a0c6598dab4f13b119d424a28d9942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.393333 26923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99775683f19743b99dff361620aa59e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.394536 26922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf93b6ad00f4635804a9b526453cba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.406116 26775 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8fc82001d49a6ae34887f5e5d3de6 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:09.407493 26775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8fc82001d49a6ae34887f5e5d3de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.413893 26922 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb0c4e1fee24f22b394b1dbada67acd (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:09.414958 26920 tablet_service.cc:1511] Processing CreateTablet for tablet 873b080b66854bc5a56c58471a9f26c7 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:09.415532 26922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb0c4e1fee24f22b394b1dbada67acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.416441 26920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b080b66854bc5a56c58471a9f26c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.418783 26774 tablet_service.cc:1511] Processing CreateTablet for tablet 99775683f19743b99dff361620aa59e4 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:09.420713 26774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99775683f19743b99dff361620aa59e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.427645 26773 tablet_service.cc:1511] Processing CreateTablet for tablet faf93b6ad00f4635804a9b526453cba3 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:09.429368 26773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf93b6ad00f4635804a9b526453cba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.437116 26772 tablet_service.cc:1511] Processing CreateTablet for tablet d6a0c6598dab4f13b119d424a28d9942 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:09.437548 26771 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb0c4e1fee24f22b394b1dbada67acd (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:09.438830 26772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a0c6598dab4f13b119d424a28d9942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.439556 26770 tablet_service.cc:1511] Processing CreateTablet for tablet 873b080b66854bc5a56c58471a9f26c7 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:09.440968 26846 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb0c4e1fee24f22b394b1dbada67acd (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:08:09.441980 26850 tablet_service.cc:1511] Processing CreateTablet for tablet 45d8fc82001d49a6ae34887f5e5d3de6 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:08:09.442468 26846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb0c4e1fee24f22b394b1dbada67acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.443439 26850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d8fc82001d49a6ae34887f5e5d3de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.444523 26845 tablet_service.cc:1511] Processing CreateTablet for tablet 873b080b66854bc5a56c58471a9f26c7 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:08:09.446074 26845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b080b66854bc5a56c58471a9f26c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.448493 26849 tablet_service.cc:1511] Processing CreateTablet for tablet 99775683f19743b99dff361620aa59e4 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:08:09.448851 26921 tablet_service.cc:1511] Processing CreateTablet for tablet 6510e8a0942545c8bf2c1f1b4db0d782 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:09.450161 26921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6510e8a0942545c8bf2c1f1b4db0d782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.450767 26771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb0c4e1fee24f22b394b1dbada67acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.450934 26848 tablet_service.cc:1511] Processing CreateTablet for tablet faf93b6ad00f4635804a9b526453cba3 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:08:09.453627 26847 tablet_service.cc:1511] Processing CreateTablet for tablet d6a0c6598dab4f13b119d424a28d9942 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:08:09.455531 26770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 873b080b66854bc5a56c58471a9f26c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.458873 26769 tablet_service.cc:1511] Processing CreateTablet for tablet 6510e8a0942545c8bf2c1f1b4db0d782 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:09.459615 26849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99775683f19743b99dff361620aa59e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.460340 26769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6510e8a0942545c8bf2c1f1b4db0d782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.463542 26848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf93b6ad00f4635804a9b526453cba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.467566 26847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6a0c6598dab4f13b119d424a28d9942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.468567 26844 tablet_service.cc:1511] Processing CreateTablet for tablet 6510e8a0942545c8bf2c1f1b4db0d782 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:08:09.469964 26974 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.470120 26844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6510e8a0942545c8bf2c1f1b4db0d782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.473173 26919 tablet_service.cc:1511] Processing CreateTablet for tablet 857b1d2eee1a4eb8bfac3db8a51b4204 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:09.473575 26768 tablet_service.cc:1511] Processing CreateTablet for tablet 857b1d2eee1a4eb8bfac3db8a51b4204 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:09.474645 26919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857b1d2eee1a4eb8bfac3db8a51b4204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.474874 26768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857b1d2eee1a4eb8bfac3db8a51b4204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.487442 26843 tablet_service.cc:1511] Processing CreateTablet for tablet 857b1d2eee1a4eb8bfac3db8a51b4204 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:08:09.488983 26843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857b1d2eee1a4eb8bfac3db8a51b4204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.490250 26974 tablet_bootstrap.cc:654] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.499009 26842 tablet_service.cc:1511] Processing CreateTablet for tablet 07d13fda78e0416ea0ce3a7cbdb74132 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:09.500618 26842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d13fda78e0416ea0ce3a7cbdb74132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.497691 26767 tablet_service.cc:1511] Processing CreateTablet for tablet 07d13fda78e0416ea0ce3a7cbdb74132 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:09.504746 26767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d13fda78e0416ea0ce3a7cbdb74132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.519486 26766 tablet_service.cc:1511] Processing CreateTablet for tablet 1c854a59db1f473db3eda59af3823ccf (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:09.521080 26766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c854a59db1f473db3eda59af3823ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.520936 26921 tablet_service.cc:1511] Processing CreateTablet for tablet 07d13fda78e0416ea0ce3a7cbdb74132 (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:08:09.522918 26921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07d13fda78e0416ea0ce3a7cbdb74132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.537200 26975 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:09.540489 26923 tablet_service.cc:1511] Processing CreateTablet for tablet 1c854a59db1f473db3eda59af3823ccf (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:09.552518 26841 tablet_service.cc:1511] Processing CreateTablet for tablet 1c854a59db1f473db3eda59af3823ccf (DEFAULT_TABLE table=test-workload [id=e680248043f841ba962c6ba005b159aa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:08:09.555575 26923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c854a59db1f473db3eda59af3823ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.560292 26841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c854a59db1f473db3eda59af3823ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:09.586489 26975 tablet_bootstrap.cc:654] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.606256 26974 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:09.607007 26974 ts_tablet_manager.cc:1403] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.137s	user 0.032s	sys 0.045s
I20260709 13:08:09.610809 26974 raft_consensus.cc:359] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.642572 26974 raft_consensus.cc:385] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.643441 26974 raft_consensus.cc:740] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.643106 26977 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:09.646345 26975 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:09.646874 26975 ts_tablet_manager.cc:1403] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.035s
I20260709 13:08:09.646936 26974 consensus_queue.cc:260] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.650131 26975 raft_consensus.cc:359] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.650903 26975 raft_consensus.cc:385] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.651222 26975 raft_consensus.cc:740] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.651984 26975 consensus_queue.cc:260] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.658457 26959 heartbeater.cc:499] Master 127.25.139.190:42481 was elected leader, sending a full tablet report...
I20260709 13:08:09.658612 26977 tablet_bootstrap.cc:654] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.659687 26974 ts_tablet_manager.cc:1434] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:08:09.660964 26974 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.664387 26810 heartbeater.cc:499] Master 127.25.139.190:42481 was elected leader, sending a full tablet report...
I20260709 13:08:09.664911 26975 ts_tablet_manager.cc:1434] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:08:09.665892 26975 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:09.668659 26974 tablet_bootstrap.cc:654] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.675805 26974 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:09.676164 26975 tablet_bootstrap.cc:654] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.676403 26974 ts_tablet_manager.cc:1403] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.002s
I20260709 13:08:09.682399 26974 raft_consensus.cc:359] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.683279 26974 raft_consensus.cc:385] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.683601 26974 raft_consensus.cc:740] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.684559 26974 consensus_queue.cc:260] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.685175 26977 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:09.685717 26977 ts_tablet_manager.cc:1403] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.007s
I20260709 13:08:09.687310 26974 ts_tablet_manager.cc:1434] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:09.688360 26974 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.689281 26977 raft_consensus.cc:359] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.690078 26977 raft_consensus.cc:385] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.690414 26977 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.691442 26977 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.697921 26974 tablet_bootstrap.cc:654] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.701722 26977 ts_tablet_manager.cc:1434] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.007s
I20260709 13:08:09.701845 26885 heartbeater.cc:499] Master 127.25.139.190:42481 was elected leader, sending a full tablet report...
I20260709 13:08:09.703305 26977 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:09.713577 26977 tablet_bootstrap.cc:654] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.715317 26975 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:09.715842 26975 ts_tablet_manager.cc:1403] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.019s
I20260709 13:08:09.723325 26975 raft_consensus.cc:359] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.724479 26975 raft_consensus.cc:385] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.724866 26975 raft_consensus.cc:740] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.726728 26980 raft_consensus.cc:493] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.727335 26980 raft_consensus.cc:515] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.729245 26974 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:09.729815 26974 ts_tablet_manager.cc:1403] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.024s
I20260709 13:08:09.735034 26980 leader_election.cc:290] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:09.725828 26975 consensus_queue.cc:260] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.741060 26975 ts_tablet_manager.cc:1434] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:08:09.745054 26974 raft_consensus.cc:359] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.745940 26974 raft_consensus.cc:385] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.746308 26974 raft_consensus.cc:740] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.746524 26977 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:09.743667 26975 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:09.747469 26977 ts_tablet_manager.cc:1403] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.013s
I20260709 13:08:09.750577 26977 raft_consensus.cc:359] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.751564 26977 raft_consensus.cc:385] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.751952 26977 raft_consensus.cc:740] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.752918 26977 consensus_queue.cc:260] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.753269 26974 consensus_queue.cc:260] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.754350 26975 tablet_bootstrap.cc:654] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.755597 26977 ts_tablet_manager.cc:1434] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:09.755829 26974 ts_tablet_manager.cc:1434] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:08:09.756695 26977 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:09.763823 26977 tablet_bootstrap.cc:654] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.770944 26974 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.771979 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8fc82001d49a6ae34887f5e5d3de6" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
W20260709 13:08:09.773671 26748 leader_election.cc:343] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:09.775594 26977 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:09.776067 26977 ts_tablet_manager.cc:1403] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:08:09.776510 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8fc82001d49a6ae34887f5e5d3de6" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:09.777246 26934 raft_consensus.cc:2468] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:09.779070 26749 leader_election.cc:304] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:09.779291 26977 raft_consensus.cc:359] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.780021 26977 raft_consensus.cc:385] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.780310 26977 raft_consensus.cc:740] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.780366 26980 raft_consensus.cc:2804] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:09.780380 26974 tablet_bootstrap.cc:654] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.781231 26977 consensus_queue.cc:260] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.780791 26980 raft_consensus.cc:493] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.782536 26980 raft_consensus.cc:3060] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:09.783957 26977 ts_tablet_manager.cc:1434] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:09.785032 26977 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:09.791144 26975 tablet_bootstrap.cc:492] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:09.791976 26977 tablet_bootstrap.cc:654] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.791960 26975 ts_tablet_manager.cc:1403] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.010s
I20260709 13:08:09.796226 26975 raft_consensus.cc:359] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.796792 26975 raft_consensus.cc:385] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.797076 26975 raft_consensus.cc:740] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.797786 26975 consensus_queue.cc:260] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.797850 26980 raft_consensus.cc:515] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.801571 26975 ts_tablet_manager.cc:1434] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:09.802542 26975 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:09.802388 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8fc82001d49a6ae34887f5e5d3de6" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:09.802994 26934 raft_consensus.cc:3060] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:09.806668 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d8fc82001d49a6ae34887f5e5d3de6" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:09.808354 26979 raft_consensus.cc:493] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.809020 26979 raft_consensus.cc:515] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
W20260709 13:08:09.812183 26748 leader_election.cc:343] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:09.815984 26975 tablet_bootstrap.cc:654] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.819775 26979 leader_election.cc:290] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:09.821362 26980 leader_election.cc:290] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Requested vote from peers 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:09.829100 26974 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:09.829759 26974 ts_tablet_manager.cc:1403] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.029s
I20260709 13:08:09.829843 26934 raft_consensus.cc:2468] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:09.831359 26749 leader_election.cc:304] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:09.833040 26980 raft_consensus.cc:2804] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:09.833524 26974 raft_consensus.cc:359] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.834247 26974 raft_consensus.cc:385] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.834606 26974 raft_consensus.cc:740] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.836023 26977 tablet_bootstrap.cc:492] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:09.833559 26980 raft_consensus.cc:697] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:09.836515 26977 ts_tablet_manager.cc:1403] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.005s
I20260709 13:08:09.837224 26975 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:09.837762 26975 ts_tablet_manager.cc:1403] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:08:09.837405 26980 consensus_queue.cc:237] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:09.840322 26977 raft_consensus.cc:359] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.840618 26975 raft_consensus.cc:359] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.841110 26977 raft_consensus.cc:385] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.841251 26975 raft_consensus.cc:385] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.841429 26977 raft_consensus.cc:740] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.841580 26975 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.842514 26975 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.843345 26977 consensus_queue.cc:260] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.844275 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:09.844980 26975 ts_tablet_manager.cc:1434] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:09.846045 26975 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
W20260709 13:08:09.846941 26897 leader_election.cc:343] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:09.852661 26975 tablet_bootstrap.cc:654] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.853065 26977 ts_tablet_manager.cc:1434] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:09.855382 26974 consensus_queue.cc:260] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.866125 26974 ts_tablet_manager.cc:1434] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 13:08:09.867204 26974 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.865864 26992 raft_consensus.cc:493] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.871424 26992 raft_consensus.cc:515] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.874148 26992 leader_election.cc:290] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:09.874639 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:09.875432 26860 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:09.876772 26748 leader_election.cc:304] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:09.878392 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:09.879120 26974 tablet_bootstrap.cc:654] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.879076 26934 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:09.880425 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
W20260709 13:08:09.881969 26897 leader_election.cc:343] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:09.882213 26977 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:09.882385 26897 leader_election.cc:304] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43440284ac85466d808ba517a4c706b0; no voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:09.883178 26979 raft_consensus.cc:2749] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:09.884693 26992 raft_consensus.cc:2804] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:09.885156 26992 raft_consensus.cc:493] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.885587 26992 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:09.889577 26731 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:09.894423 26992 raft_consensus.cc:515] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.895481 26977 tablet_bootstrap.cc:654] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.896642 26974 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:09.896059 26680 catalog_manager.cc:5697] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.897187 26974 ts_tablet_manager.cc:1403] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:08:09.897739 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:09.898370 26860 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:09.900609 26974 raft_consensus.cc:359] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.901427 26974 raft_consensus.cc:385] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.901548 26975 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:09.901773 26974 raft_consensus.cc:740] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.902048 26975 ts_tablet_manager.cc:1403] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.021s
I20260709 13:08:09.902588 26974 consensus_queue.cc:260] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.905594 26974 ts_tablet_manager.cc:1434] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:09.905556 26975 raft_consensus.cc:359] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.906488 26975 raft_consensus.cc:385] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:09.906818 26974 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:09.913569 26974 tablet_bootstrap.cc:654] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.914418 26984 raft_consensus.cc:493] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.906807 26975 raft_consensus.cc:740] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:09.914916 26984 raft_consensus.cc:515] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.915535 26975 consensus_queue.cc:260] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.919198 26975 ts_tablet_manager.cc:1434] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:08:09.920680 26975 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:09.925268 26984 leader_election.cc:290] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:09.930624 26975 tablet_bootstrap.cc:654] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:09.956414 26860 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:09.960088 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:09.976099 26934 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:09.986553 26980 raft_consensus.cc:493] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.987252 26980 raft_consensus.cc:515] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:09.991115 26980 leader_election.cc:290] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:09.960721 26992 leader_election.cc:290] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:09.993285 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:09.994002 26933 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:09.994933 26748 leader_election.cc:304] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:09.995420 26749 leader_election.cc:304] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:09.993975 26934 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:09.996213 26980 raft_consensus.cc:2804] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:09.997902 26992 raft_consensus.cc:2804] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:09.998740 26992 raft_consensus.cc:493] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.000197 26992 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.009198 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:10.013098 26860 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:10.012236 26980 raft_consensus.cc:697] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:10.014647 26980 consensus_queue.cc:237] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.046324 26992 raft_consensus.cc:515] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.057003 26992 leader_election.cc:290] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.059504 26977 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.060055 26977 ts_tablet_manager.cc:1403] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.178s	user 0.047s	sys 0.050s
I20260709 13:08:10.060870 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.060523 26974 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:10.061523 26934 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.061656 26974 ts_tablet_manager.cc:1403] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.155s	user 0.049s	sys 0.099s
I20260709 13:08:10.064924 26974 raft_consensus.cc:359] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.065727 26974 raft_consensus.cc:385] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.063645 26977 raft_consensus.cc:359] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.066294 26974 raft_consensus.cc:740] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.065701 26680 catalog_manager.cc:5697] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.066637 26977 raft_consensus.cc:385] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.067148 26977 raft_consensus.cc:740] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.067157 26974 consensus_queue.cc:260] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.068532 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:10.060042 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.068333 26977 consensus_queue.cc:260] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.070362 26975 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:10.070943 26975 ts_tablet_manager.cc:1403] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.151s	user 0.044s	sys 0.084s
I20260709 13:08:10.071508 26977 ts_tablet_manager.cc:1434] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:08:10.072703 26977 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:10.074450 26933 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
W20260709 13:08:10.075924 26823 leader_election.cc:343] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:10.077612 26974 ts_tablet_manager.cc:1434] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:10.077499 26824 leader_election.cc:304] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:10.078841 26984 raft_consensus.cc:2804] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.079027 26974 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:10.079342 26984 raft_consensus.cc:493] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.079762 26984 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.080646 26977 tablet_bootstrap.cc:654] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.086612 26975 raft_consensus.cc:359] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.087947 26975 raft_consensus.cc:385] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.088459 26975 raft_consensus.cc:740] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.089841 26975 consensus_queue.cc:260] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.092298 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:10.093014 26860 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.093514 26975 ts_tablet_manager.cc:1434] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:08:10.094913 26975 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:10.102145 26984 raft_consensus.cc:515] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.102577 26974 tablet_bootstrap.cc:654] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.105396 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.106012 26934 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
W20260709 13:08:10.107079 26823 leader_election.cc:343] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:10.107888 26749 leader_election.cc:304] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:10.106513 26860 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:10.108757 26992 raft_consensus.cc:2804] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.110188 26992 raft_consensus.cc:697] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:10.110522 26975 tablet_bootstrap.cc:654] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.109951 26984 leader_election.cc:290] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.111100 26992 consensus_queue.cc:237] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.109468 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.115316 26933 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.115821 26974 tablet_bootstrap.cc:492] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:10.116340 26974 ts_tablet_manager.cc:1403] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.002s
I20260709 13:08:10.119553 26974 raft_consensus.cc:359] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.120369 26974 raft_consensus.cc:385] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.120713 26974 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.121554 26974 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.124110 26974 ts_tablet_manager.cc:1434] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:08:10.125152 26974 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:10.127854 26979 raft_consensus.cc:493] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.128399 26979 raft_consensus.cc:515] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.132791 26977 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.134883 26974 tablet_bootstrap.cc:654] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.135682 26977 ts_tablet_manager.cc:1403] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.063s	user 0.035s	sys 0.004s
I20260709 13:08:10.135825 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.137763 26785 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 0.
I20260709 13:08:10.136150 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:10.139948 26860 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 0.
I20260709 13:08:10.141031 26975 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:10.139086 26897 leader_election.cc:304] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:10.141573 26975 ts_tablet_manager.cc:1403] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.014s
I20260709 13:08:10.130575 26979 leader_election.cc:290] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:10.142510 26979 raft_consensus.cc:2804] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.142882 26979 raft_consensus.cc:493] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.143245 26979 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.145623 26683 catalog_manager.cc:5697] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.150312 26977 raft_consensus.cc:359] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.151630 26977 raft_consensus.cc:385] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.152181 26977 raft_consensus.cc:740] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.153358 26977 consensus_queue.cc:260] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.156423 26977 ts_tablet_manager.cc:1434] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.004s
I20260709 13:08:10.157590 26977 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:10.127460 26933 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.154896 26979 raft_consensus.cc:515] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.160385 26979 leader_election.cc:290] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:10.162528 26824 leader_election.cc:304] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:10.162734 26975 raft_consensus.cc:359] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.163456 26975 raft_consensus.cc:385] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.163741 26984 raft_consensus.cc:2804] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.163781 26975 raft_consensus.cc:740] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.165221 26975 consensus_queue.cc:260] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.166069 26977 tablet_bootstrap.cc:654] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.170598 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.171267 26785 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.173163 26975 ts_tablet_manager.cc:1434] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:08:10.174273 26975 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:10.180807 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:10.181466 26860 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.178910 26785 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 1.
I20260709 13:08:10.191341 27017 raft_consensus.cc:493] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.191562 26897 leader_election.cc:304] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:10.191928 27017 raft_consensus.cc:515] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.193789 26984 raft_consensus.cc:697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:10.194417 26860 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 1.
I20260709 13:08:10.194901 26984 consensus_queue.cc:237] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.199349 27017 leader_election.cc:290] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.200764 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
W20260709 13:08:10.202132 26824 leader_election.cc:343] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:10.202200 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.202759 26977 tablet_bootstrap.cc:492] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.199363 26975 tablet_bootstrap.cc:654] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.203342 26977 ts_tablet_manager.cc:1403] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.027s
I20260709 13:08:10.203213 26785 raft_consensus.cc:2468] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
I20260709 13:08:10.204816 26823 leader_election.cc:304] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 43440284ac85466d808ba517a4c706b0
I20260709 13:08:10.192622 27015 raft_consensus.cc:2804] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.206347 27016 raft_consensus.cc:2804] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.206614 27015 raft_consensus.cc:697] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:10.206789 27016 raft_consensus.cc:493] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.207310 27016 raft_consensus.cc:3060] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.207815 27015 consensus_queue.cc:237] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.206593 26977 raft_consensus.cc:359] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:10.211416 26977 raft_consensus.cc:385] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.211792 26977 raft_consensus.cc:740] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.212509 26977 consensus_queue.cc:260] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } }
I20260709 13:08:10.214135 27016 raft_consensus.cc:515] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.215281 26977 ts_tablet_manager.cc:1434] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:10.216684 26977 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:10.217649 26680 catalog_manager.cc:5697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.219342 26974 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:10.219590 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.219828 26974 ts_tablet_manager.cc:1403] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.031s
I20260709 13:08:10.220216 26785 raft_consensus.cc:3060] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.222782 26974 raft_consensus.cc:359] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.223567 26974 raft_consensus.cc:385] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.223881 26974 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.224766 26974 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.225677 26977 tablet_bootstrap.cc:654] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.227607 26974 ts_tablet_manager.cc:1434] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:10.228670 26974 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:10.234316 26785 raft_consensus.cc:2468] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.234915 26974 tablet_bootstrap.cc:654] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.235859 26823 leader_election.cc:304] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.237367 26984 raft_consensus.cc:2804] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.237571 27016 leader_election.cc:290] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.238005 26984 raft_consensus.cc:697] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:10.237759 26975 tablet_bootstrap.cc:492] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:10.240242 26975 ts_tablet_manager.cc:1403] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.066s	user 0.006s	sys 0.006s
I20260709 13:08:10.239269 26984 consensus_queue.cc:237] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.241634 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
W20260709 13:08:10.243974 26824 leader_election.cc:343] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:10.246500 26975 raft_consensus.cc:359] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.247462 26975 raft_consensus.cc:385] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.247828 26975 raft_consensus.cc:740] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.248943 26975 consensus_queue.cc:260] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.255995 26975 ts_tablet_manager.cc:1434] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:08:10.255621 26683 catalog_manager.cc:5697] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.257301 26975 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:10.269058 26977 tablet_bootstrap.cc:492] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.269671 26977 ts_tablet_manager.cc:1403] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.010s
I20260709 13:08:10.280597 26975 tablet_bootstrap.cc:654] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.273372 26977 raft_consensus.cc:359] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.283968 26977 raft_consensus.cc:385] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.284224 26977 raft_consensus.cc:740] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.285034 26977 consensus_queue.cc:260] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.285799 26974 tablet_bootstrap.cc:492] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:10.286232 26974 ts_tablet_manager.cc:1403] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.025s
I20260709 13:08:10.286949 26977 ts_tablet_manager.cc:1434] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:08:10.287985 26977 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:10.288822 26974 raft_consensus.cc:359] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.289515 26974 raft_consensus.cc:385] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.288693 26683 catalog_manager.cc:5697] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.289783 26974 raft_consensus.cc:740] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.290513 26974 consensus_queue.cc:260] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.292583 26974 ts_tablet_manager.cc:1434] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:10.293792 26974 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: Bootstrap starting.
I20260709 13:08:10.294862 26977 tablet_bootstrap.cc:654] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.300338 26974 tablet_bootstrap.cc:654] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.303246 26860 raft_consensus.cc:3060] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.306584 26977 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.307556 26977 ts_tablet_manager.cc:1403] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:08:10.310153 26974 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: No bootstrap required, opened a new log
I20260709 13:08:10.310616 26974 ts_tablet_manager.cc:1403] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:08:10.310386 26977 raft_consensus.cc:359] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.311043 26977 raft_consensus.cc:385] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.311375 26977 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.312115 26977 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.313253 26974 raft_consensus.cc:359] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.313913 26974 raft_consensus.cc:385] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.314163 26974 raft_consensus.cc:740] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.314265 26977 ts_tablet_manager.cc:1434] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:10.315155 26977 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: Bootstrap starting.
I20260709 13:08:10.315004 26974 consensus_queue.cc:260] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.320266 26992 consensus_queue.cc:1048] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.321178 26977 tablet_bootstrap.cc:654] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.320226 26974 ts_tablet_manager.cc:1434] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:10.331434 26977 tablet_bootstrap.cc:492] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: No bootstrap required, opened a new log
I20260709 13:08:10.331838 26977 ts_tablet_manager.cc:1403] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:08:10.333757 26977 raft_consensus.cc:359] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.334273 26977 raft_consensus.cc:385] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.334630 26977 raft_consensus.cc:740] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.335727 26977 consensus_queue.cc:260] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.338595 26977 ts_tablet_manager.cc:1434] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:10.345247 26975 tablet_bootstrap.cc:492] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:10.345728 26975 ts_tablet_manager.cc:1403] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.089s	user 0.035s	sys 0.022s
I20260709 13:08:10.347589 26980 raft_consensus.cc:493] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.348078 26980 raft_consensus.cc:515] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.350275 26980 leader_election.cc:290] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.350971 26975 raft_consensus.cc:359] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.351689 26975 raft_consensus.cc:385] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.351982 26975 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.352196 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:10.352584 26975 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.353003 26934 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:10.352264 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:10.355265 27007 consensus_queue.cc:1048] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:10.355468 26859 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 0.
I20260709 13:08:10.354635 26975 ts_tablet_manager.cc:1434] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:08:10.354689 26749 leader_election.cc:304] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:10.356786 27007 raft_consensus.cc:2804] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.357167 27007 raft_consensus.cc:493] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.357517 27007 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.358035 26975 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: Bootstrap starting.
I20260709 13:08:10.364617 26975 tablet_bootstrap.cc:654] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:10.364820 27007 raft_consensus.cc:515] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.367476 27007 leader_election.cc:290] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.368165 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:10.368849 26859 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.373770 27015 raft_consensus.cc:493] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.374495 27015 raft_consensus.cc:515] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.378188 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.378968 26933 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.378348 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.383612 26785 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 0.
I20260709 13:08:10.385555 26897 leader_election.cc:304] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:10.386351 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:10.386608 26979 raft_consensus.cc:2804] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.386729 27015 leader_election.cc:290] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:10.387073 26860 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 0.
I20260709 13:08:10.387095 26979 raft_consensus.cc:493] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.390072 26979 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.392421 27015 raft_consensus.cc:493] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.392954 27015 raft_consensus.cc:515] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.399107 26859 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:10.400651 26748 leader_election.cc:304] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.402038 27007 raft_consensus.cc:2804] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.400952 26979 raft_consensus.cc:515] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.402801 27007 raft_consensus.cc:697] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:10.403741 27007 consensus_queue.cc:237] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.404516 27015 leader_election.cc:290] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:10.406052 26975 tablet_bootstrap.cc:492] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: No bootstrap required, opened a new log
I20260709 13:08:10.406103 26933 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 1.
I20260709 13:08:10.406822 26975 ts_tablet_manager.cc:1403] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.019s
I20260709 13:08:10.407617 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.408165 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:10.408414 26785 raft_consensus.cc:2393] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 43440284ac85466d808ba517a4c706b0 in current term 1: Already voted for candidate 7102af04472b45fea26b3cf86f8acafe in this term.
I20260709 13:08:10.408645 26860 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.409605 26975 raft_consensus.cc:359] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.410090 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.410364 26975 raft_consensus.cc:385] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:10.410710 26784 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.410739 26975 raft_consensus.cc:740] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Initialized, Role: FOLLOWER
I20260709 13:08:10.411633 26975 consensus_queue.cc:260] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.414192 26975 ts_tablet_manager.cc:1434] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:08:10.415872 26860 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 1.
I20260709 13:08:10.417224 26784 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 1.
I20260709 13:08:10.417189 26897 leader_election.cc:304] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.405915 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07d13fda78e0416ea0ce3a7cbdb74132" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7102af04472b45fea26b3cf86f8acafe" is_pre_election: true
I20260709 13:08:10.418965 27035 raft_consensus.cc:2804] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.419938 26979 leader_election.cc:290] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:10.420398 26897 leader_election.cc:304] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43440284ac85466d808ba517a4c706b0; no voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:10.421267 26979 raft_consensus.cc:3060] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.421516 27035 raft_consensus.cc:697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:10.422526 27035 consensus_queue.cc:237] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.429049 26979 raft_consensus.cc:2749] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:10.428967 26683 catalog_manager.cc:5697] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.432871 26680 catalog_manager.cc:5697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:10.448402 27007 consensus_queue.cc:1048] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.450534 26984 raft_consensus.cc:493] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.451017 26984 raft_consensus.cc:515] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.453249 26984 leader_election.cc:290] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.454061 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.454744 26784 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
I20260709 13:08:10.455063 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:10.455905 26933 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
I20260709 13:08:10.456346 26823 leader_election.cc:304] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.457305 26984 raft_consensus.cc:2804] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.457710 26984 raft_consensus.cc:493] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.457986 26984 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.462384 26992 consensus_queue.cc:1048] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:10.466042 26984 raft_consensus.cc:515] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.469115 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.469794 26784 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.470011 26984 leader_election.cc:290] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.471305 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.472007 26934 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.478083 26784 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.480005 26823 leader_election.cc:304] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.480444 26934 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.481024 26984 raft_consensus.cc:2804] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.481528 26984 raft_consensus.cc:697] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:10.482342 26984 consensus_queue.cc:237] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.491413 26680 catalog_manager.cc:5697] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.607331 27007 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.612624 26984 raft_consensus.cc:493] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.613157 26984 raft_consensus.cc:515] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.617269 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6" is_pre_election: true
I20260709 13:08:10.617471 26984 leader_election.cc:290] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.617893 26784 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
I20260709 13:08:10.618963 26992 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.619194 26823 leader_election.cc:304] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.620466 26984 raft_consensus.cc:2804] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:10.620827 26984 raft_consensus.cc:493] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.621126 26984 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.621502 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0" is_pre_election: true
I20260709 13:08:10.622130 26934 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 0.
I20260709 13:08:10.631098 26984 raft_consensus.cc:515] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.634343 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.634506 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.634887 26984 leader_election.cc:290] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.635046 26784 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.635146 26933 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.641153 26933 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.641153 26784 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 1.
I20260709 13:08:10.642341 26824 leader_election.cc:304] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:10.643151 26984 raft_consensus.cc:2804] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:10.643749 26984 raft_consensus.cc:697] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:10.644448 26984 consensus_queue.cc:237] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.652527 26680 catalog_manager.cc:5697] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.674716 26984 consensus_queue.cc:1048] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.684183 26784 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:10.694590 26984 consensus_queue.cc:1048] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.739789 27035 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.750918 26979 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.774923 26859 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:60084
I20260709 13:08:10.775583 26859 raft_consensus.cc:606] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:10.790385 26933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:08:10.790930 26933 raft_consensus.cc:606] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:10.802188 26933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
mode: GRACEFUL
new_leader_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:08:10.802707 26933 raft_consensus.cc:606] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Received request to transfer leadership to TS 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:10.820732 26784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:36552
I20260709 13:08:10.821429 26784 raft_consensus.cc:606] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Received request to transfer leadership to TS 43440284ac85466d808ba517a4c706b0
I20260709 13:08:10.823953 26984 consensus_queue.cc:1048] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.834504 27016 consensus_queue.cc:1048] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.840631 27015 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.847806 26979 raft_consensus.cc:993] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: : Instructing follower 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:10.848258 26979 raft_consensus.cc:1081] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Signalling peer 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:10.850310 26860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:37132
I20260709 13:08:10.850855 26860 raft_consensus.cc:493] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.851284 26860 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.853099 27015 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.859385 26860 raft_consensus.cc:515] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.862203 26859 raft_consensus.cc:1240] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Rejecting Update request from peer 43440284ac85466d808ba517a4c706b0 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:10.864337 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:10.865098 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:10.865871 26933 raft_consensus.cc:3055] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:10.865974 27015 consensus_queue.cc:1059] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.866215 26933 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:10.866549 26860 leader_election.cc:290] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 2 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:10.867327 26933 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.868505 26933 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.874177 26933 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 2.
W20260709 13:08:10.874634 26979 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:08:10.875998 26824 leader_election.cc:304] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:10.876734 27016 raft_consensus.cc:2804] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:10.877242 27016 raft_consensus.cc:697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:10.878114 27016 consensus_queue.cc:237] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:10.882542 27017 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.887458 26683 catalog_manager.cc:5697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 1 to 2, leader changed from 43440284ac85466d808ba517a4c706b0 (127.25.139.131) to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.902899 27016 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:10.999394 27007 consensus_queue.cc:1048] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:11.012346 26980 consensus_queue.cc:1048] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:11.020970 27042 raft_consensus.cc:993] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:11.021459 27042 raft_consensus.cc:1081] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Signalling peer 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:11.023097 26933 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:54732
I20260709 13:08:11.023734 26933 raft_consensus.cc:493] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.024186 26933 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.029899 26933 raft_consensus.cc:515] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.032145 26933 leader_election.cc:290] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:11.032876 26784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:11.033227 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c854a59db1f473db3eda59af3823ccf" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:11.033962 26784 raft_consensus.cc:3055] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.034294 26860 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.034420 26784 raft_consensus.cc:740] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:11.035286 26784 consensus_queue.cc:260] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.036531 26784 raft_consensus.cc:3060] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.041656 26860 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:11.043027 26897 leader_election.cc:304] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:11.043493 26784 raft_consensus.cc:2468] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:11.044023 26979 raft_consensus.cc:2804] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.044488 26979 raft_consensus.cc:697] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:11.045186 26979 consensus_queue.cc:237] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.051007 26683 catalog_manager.cc:5697] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 1 to 2, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.149066 27016 consensus_queue.cc:1048] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:11.159951 27016 consensus_queue.cc:1048] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:11.167373 26984 raft_consensus.cc:993] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:11.167843 27016 raft_consensus.cc:1081] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:11.169482 26784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33564
I20260709 13:08:11.169970 26784 raft_consensus.cc:493] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.170284 26784 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.175370 26784 raft_consensus.cc:515] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.177155 26784 leader_election.cc:290] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:11.178133 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:11.178853 26860 raft_consensus.cc:3055] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.178272 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6a0c6598dab4f13b119d424a28d9942" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:11.179443 26933 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.179805 26860 raft_consensus.cc:740] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:11.180660 26860 consensus_queue.cc:260] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.181861 26860 raft_consensus.cc:3060] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.186396 26933 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:11.187655 26749 leader_election.cc:304] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:11.188448 27042 raft_consensus.cc:2804] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.188573 26860 raft_consensus.cc:2468] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:11.188876 27042 raft_consensus.cc:697] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:11.189739 27042 consensus_queue.cc:237] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.195883 26681 catalog_manager.cc:5697] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 1 to 2, leader changed from 7102af04472b45fea26b3cf86f8acafe (127.25.139.130) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.368716 27015 raft_consensus.cc:993] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:11.369185 26979 raft_consensus.cc:1081] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:11.370517 26784 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:08:11.371009 26784 raft_consensus.cc:493] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.371389 26784 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.373900 26785 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.376436 26784 raft_consensus.cc:515] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.378539 26784 leader_election.cc:290] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:11.379545 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:11.380012 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:11.380316 26860 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.380569 26933 raft_consensus.cc:3055] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.380941 26933 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:11.380868 26785 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Refusing update from remote peer 7102af04472b45fea26b3cf86f8acafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.381748 26933 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.382612 27017 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.382920 26933 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.387027 26860 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:11.389298 26933 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:11.390306 26748 leader_election.cc:304] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:11.391235 27042 raft_consensus.cc:2804] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.391752 27042 raft_consensus.cc:697] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:11.392613 27042 consensus_queue.cc:237] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:11.396034 26933 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Refusing update from remote peer 7102af04472b45fea26b3cf86f8acafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.398228 27017 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.402277 26683 catalog_manager.cc:5697] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 1 to 2, leader changed from 43440284ac85466d808ba517a4c706b0 (127.25.139.131) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.575091 26933 raft_consensus.cc:1275] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.576429 27042 consensus_queue.cc:1048] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.590020 26860 raft_consensus.cc:1275] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.591501 27064 consensus_queue.cc:1048] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.599858 26785 raft_consensus.cc:1275] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.601100 26979 consensus_queue.cc:1048] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.609457 26860 raft_consensus.cc:1275] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.611013 27015 consensus_queue.cc:1048] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.884227 26860 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.885540 27064 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.896461 26933 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.898046 27042 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.856599 26158 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:08:13.857393 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:13.873800 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:13.874347 26785 raft_consensus.cc:606] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Received request to transfer leadership to TS 43440284ac85466d808ba517a4c706b0
I20260709 13:08:13.876808 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99775683f19743b99dff361620aa59e4"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:13.877359 26785 raft_consensus.cc:606] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Received request to transfer leadership to TS 43440284ac85466d808ba517a4c706b0
I20260709 13:08:13.878351 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:13.878748 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:13.901343 27063 raft_consensus.cc:993] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:13.901940 27063 raft_consensus.cc:1081] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Signalling peer 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:13.903414 26934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:54732
I20260709 13:08:13.903878 26934 raft_consensus.cc:493] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:13.904163 26934 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.909040 26934 raft_consensus.cc:515] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:13.910776 26934 leader_election.cc:290] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 3 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:13.911612 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:13.911859 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:13.912230 26785 raft_consensus.cc:3055] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:13.912370 26860 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.912596 26785 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:13.913411 26785 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:13.914618 26785 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.919286 26860 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 3.
I20260709 13:08:13.920574 26897 leader_election.cc:304] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:13.921094 26785 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 3.
I20260709 13:08:13.921268 27068 raft_consensus.cc:2804] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.922683 27068 raft_consensus.cc:697] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:13.923545 27068 consensus_queue.cc:237] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:13.930444 26680 catalog_manager.cc:5697] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 2 to 3, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.318312 27072 raft_consensus.cc:993] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:14.318851 27063 raft_consensus.cc:1081] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Signalling peer 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:14.320542 26934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99775683f19743b99dff361620aa59e4"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:54732
I20260709 13:08:14.321138 26934 raft_consensus.cc:493] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.321491 26934 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.326316 26934 raft_consensus.cc:515] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.328059 26934 leader_election.cc:290] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:14.328902 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:14.329550 26785 raft_consensus.cc:3055] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.329340 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:14.329886 26785 raft_consensus.cc:740] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:14.330159 26860 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.330740 26785 consensus_queue.cc:260] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.331880 26785 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.335632 26860 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:14.336588 26897 leader_election.cc:304] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:14.337283 26785 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:14.337368 27068 raft_consensus.cc:2804] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.337905 27068 raft_consensus.cc:697] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:14.338800 27068 consensus_queue.cc:237] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.347704 26680 catalog_manager.cc:5697] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 1 to 2, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.398495 26860 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:14.399606 27068 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.412659 26785 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:14.418354 27073 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.822829 26785 raft_consensus.cc:1275] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.824146 27073 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.838160 26860 raft_consensus.cc:1275] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.839792 27082 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.879556 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:14.892522 26934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99775683f19743b99dff361620aa59e4"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:08:14.893141 26934 raft_consensus.cc:606] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:14.903918 26934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:53496
I20260709 13:08:14.904440 26934 raft_consensus.cc:606] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:14.909188 26860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:60084
I20260709 13:08:14.909657 26860 raft_consensus.cc:606] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:14.914533 26860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:60084
I20260709 13:08:14.914994 26860 raft_consensus.cc:606] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:14.919440 26860 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
mode: GRACEFUL
new_leader_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:60084
I20260709 13:08:14.919878 26860 raft_consensus.cc:606] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 LEADER]: Received request to transfer leadership to TS 0d2ef7d68b00428eb27455b54249aac6
I20260709 13:08:14.942940 27069 raft_consensus.cc:993] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:14.943367 27069 raft_consensus.cc:1081] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:14.944695 26785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33564
I20260709 13:08:14.945169 26785 raft_consensus.cc:493] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.945451 26785 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.950500 26785 raft_consensus.cc:515] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.952667 26785 leader_election.cc:290] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:14.953341 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:14.953709 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:14.953985 26859 raft_consensus.cc:3055] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.954316 26934 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.954342 26859 raft_consensus.cc:740] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:14.955374 26859 consensus_queue.cc:260] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.956364 26859 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.960954 26859 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:14.961509 26934 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:14.962102 26748 leader_election.cc:304] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:14.962872 27063 raft_consensus.cc:2804] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.963814 27063 raft_consensus.cc:697] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:14.964561 27063 consensus_queue.cc:237] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:14.971549 26680 catalog_manager.cc:5697] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 1 to 2, leader changed from 7102af04472b45fea26b3cf86f8acafe (127.25.139.130) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.091152 27089 raft_consensus.cc:993] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.091615 27089 raft_consensus.cc:1081] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.093210 26785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33564
I20260709 13:08:15.093663 26785 raft_consensus.cc:493] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:15.093947 26785 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.098603 26785 raft_consensus.cc:515] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.100411 26785 leader_election.cc:290] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 3 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:15.101205 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:15.101481 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:15.101863 26859 raft_consensus.cc:3055] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:15.102075 26934 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.102212 26859 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:15.103120 26859 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.104188 26859 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.106953 26934 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 3.
I20260709 13:08:15.107980 26749 leader_election.cc:304] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:15.108668 27063 raft_consensus.cc:2804] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.109194 27063 raft_consensus.cc:697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:15.110071 26859 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 3.
I20260709 13:08:15.110101 27063 consensus_queue.cc:237] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.117959 26680 catalog_manager.cc:5697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 2 to 3, leader changed from 7102af04472b45fea26b3cf86f8acafe (127.25.139.130) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 3 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.231724 27087 raft_consensus.cc:993] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.232177 27082 raft_consensus.cc:1081] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.233611 26785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99775683f19743b99dff361620aa59e4"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:08:15.234056 26785 raft_consensus.cc:493] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:15.234328 26785 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.238863 26785 raft_consensus.cc:515] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.240757 26785 leader_election.cc:290] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 3 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:15.241784 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:15.242107 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99775683f19743b99dff361620aa59e4" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:15.242422 26859 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.242694 26933 raft_consensus.cc:3055] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:15.243063 26933 raft_consensus.cc:740] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:15.243861 26933 consensus_queue.cc:260] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.244815 26933 raft_consensus.cc:3060] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.247435 26859 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 3.
I20260709 13:08:15.248477 26748 leader_election.cc:304] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:15.249264 27063 raft_consensus.cc:2804] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.249899 26933 raft_consensus.cc:2468] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 3.
I20260709 13:08:15.249671 27063 raft_consensus.cc:697] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:15.251435 27063 consensus_queue.cc:237] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.257449 26680 catalog_manager.cc:5697] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 2 to 3, leader changed from 43440284ac85466d808ba517a4c706b0 (127.25.139.131) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 3 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.285967 27087 raft_consensus.cc:993] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.286438 27082 raft_consensus.cc:1081] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.287977 26785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33554
I20260709 13:08:15.288509 26785 raft_consensus.cc:493] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:15.288913 26785 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.293974 26785 raft_consensus.cc:515] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.295606 26785 leader_election.cc:290] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 4 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:15.296475 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:15.296799 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb0c4e1fee24f22b394b1dbada67acd" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:15.297012 26859 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.297367 26933 raft_consensus.cc:3055] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:15.297647 26933 raft_consensus.cc:740] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:15.298410 26933 consensus_queue.cc:260] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.299448 26933 raft_consensus.cc:3060] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.302127 26859 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 4.
I20260709 13:08:15.303269 26748 leader_election.cc:304] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:15.304082 27063 raft_consensus.cc:2804] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:15.304517 27063 raft_consensus.cc:697] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 4 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:15.304613 26933 raft_consensus.cc:2468] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 4.
I20260709 13:08:15.305333 27063 consensus_queue.cc:237] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.311496 26680 catalog_manager.cc:5697] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 3 to 4, leader changed from 43440284ac85466d808ba517a4c706b0 (127.25.139.131) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 4 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.334772 27069 raft_consensus.cc:993] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: : Instructing follower 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.335361 27089 raft_consensus.cc:1081] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Signalling peer 0d2ef7d68b00428eb27455b54249aac6 to start an election
I20260709 13:08:15.336905 26785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
 from {username='slave'} at 127.0.0.1:33564
I20260709 13:08:15.337356 26785 raft_consensus.cc:493] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:15.337673 26785 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.341812 26785 raft_consensus.cc:515] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.343360 26785 leader_election.cc:290] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Requested vote from peers 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:15.344175 26859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:15.344422 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "0d2ef7d68b00428eb27455b54249aac6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:15.344822 26859 raft_consensus.cc:3055] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:15.344982 26934 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.345197 26859 raft_consensus.cc:740] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:15.346102 26859 consensus_queue.cc:260] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.347098 26859 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.349792 26934 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:15.350767 26749 leader_election.cc:304] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d2ef7d68b00428eb27455b54249aac6, 43440284ac85466d808ba517a4c706b0; no voters: 
I20260709 13:08:15.351529 27063 raft_consensus.cc:2804] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:15.352036 27063 raft_consensus.cc:697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:15.352077 26859 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d2ef7d68b00428eb27455b54249aac6 in term 2.
I20260709 13:08:15.352936 27063 consensus_queue.cc:237] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:15.359992 26680 catalog_manager.cc:5697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 reported cstate change: term changed from 1 to 2, leader changed from 7102af04472b45fea26b3cf86f8acafe (127.25.139.130) to 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "0d2ef7d68b00428eb27455b54249aac6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:15.365688 26859 raft_consensus.cc:1275] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:15.367291 27063 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.377969 26934 raft_consensus.cc:1275] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:15.380558 27063 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.653198 26934 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:15.654623 27090 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.660624 26859 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:15.665459 27063 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.760638 26859 raft_consensus.cc:1275] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:15.762203 27063 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.767863 26934 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:15.770594 27063 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.770910 26934 raft_consensus.cc:1275] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:15.772802 27063 consensus_queue.cc:1048] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:15.784411 26859 raft_consensus.cc:1275] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:15.785934 27103 consensus_queue.cc:1048] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:15.929085 26859 raft_consensus.cc:1275] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:15.930475 27103 consensus_queue.cc:1048] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:15.940299 26934 raft_consensus.cc:1275] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Refusing update from remote peer 0d2ef7d68b00428eb27455b54249aac6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:15.942201 27104 consensus_queue.cc:1048] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.926982 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.935037 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:17.935838 26785 raft_consensus.cc:606] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Received request to transfer leadership to TS 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:17.938604 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:17.939206 26785 raft_consensus.cc:606] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Received request to transfer leadership to TS 7102af04472b45fea26b3cf86f8acafe
I20260709 13:08:17.941938 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:17.942518 26785 raft_consensus.cc:606] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Received request to transfer leadership to TS 43440284ac85466d808ba517a4c706b0
I20260709 13:08:17.945461 26785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3"
dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
mode: GRACEFUL
new_leader_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:36568
I20260709 13:08:17.946095 26785 raft_consensus.cc:606] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Received request to transfer leadership to TS 43440284ac85466d808ba517a4c706b0
I20260709 13:08:17.947528 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:17.948101 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:17.993463 27111 raft_consensus.cc:993] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:17.994159 27112 raft_consensus.cc:1081] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Signalling peer 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:17.995973 26934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:54732
I20260709 13:08:17.996590 26934 raft_consensus.cc:493] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.997030 26934 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.005467 26934 raft_consensus.cc:515] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.007634 26934 leader_election.cc:290] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:18.008713 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:18.009243 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf93b6ad00f4635804a9b526453cba3" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:18.009649 26785 raft_consensus.cc:3055] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.009914 26860 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.010061 26785 raft_consensus.cc:740] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:18.010987 26785 consensus_queue.cc:260] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.012082 26785 raft_consensus.cc:3060] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.015355 26860 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:18.016716 26897 leader_election.cc:304] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:18.016923 26785 raft_consensus.cc:2468] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 2.
I20260709 13:08:18.017673 27082 raft_consensus.cc:2804] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.018798 27082 raft_consensus.cc:697] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:18.019793 27082 consensus_queue.cc:237] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.027801 26683 catalog_manager.cc:5697] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 1 to 2, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.064561 27111 raft_consensus.cc:993] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:18.065088 27112 raft_consensus.cc:1081] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Signalling peer 43440284ac85466d808ba517a4c706b0 to start an election
I20260709 13:08:18.066816 26934 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7"
dest_uuid: "43440284ac85466d808ba517a4c706b0"
 from {username='slave'} at 127.0.0.1:54732
I20260709 13:08:18.067344 26934 raft_consensus.cc:493] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.067641 26934 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.072249 26934 raft_consensus.cc:515] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.073789 26934 leader_election.cc:290] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 3 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 7102af04472b45fea26b3cf86f8acafe (127.25.139.130:37873)
I20260709 13:08:18.074746 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:18.075001 26860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "873b080b66854bc5a56c58471a9f26c7" candidate_uuid: "43440284ac85466d808ba517a4c706b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
I20260709 13:08:18.075349 26785 raft_consensus.cc:3055] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.075599 26860 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.075680 26785 raft_consensus.cc:740] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:18.076498 26785 consensus_queue.cc:260] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.077440 26785 raft_consensus.cc:3060] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.080787 26860 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 3.
I20260709 13:08:18.081712 26785 raft_consensus.cc:2468] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43440284ac85466d808ba517a4c706b0 in term 3.
I20260709 13:08:18.081857 26897 leader_election.cc:304] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:18.082808 27082 raft_consensus.cc:2804] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.083293 27082 raft_consensus.cc:697] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Becoming Leader. State: Replica: 43440284ac85466d808ba517a4c706b0, State: Running, Role: LEADER
I20260709 13:08:18.084226 27082 consensus_queue.cc:237] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.091979 26683 catalog_manager.cc:5697] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 reported cstate change: term changed from 2 to 3, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 43440284ac85466d808ba517a4c706b0 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "43440284ac85466d808ba517a4c706b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.168917 27111 raft_consensus.cc:993] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:18.169446 27111 raft_consensus.cc:1081] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Signalling peer 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:18.171067 26860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:37128
I20260709 13:08:18.171622 26860 raft_consensus.cc:493] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.171916 26860 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.176803 26860 raft_consensus.cc:515] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.178674 26860 leader_election.cc:290] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 4 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:18.179513 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:18.179833 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857b1d2eee1a4eb8bfac3db8a51b4204" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:18.180066 26785 raft_consensus.cc:3055] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:18.180361 26934 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.180413 26785 raft_consensus.cc:740] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:18.181154 26785 consensus_queue.cc:260] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.181995 26785 raft_consensus.cc:3060] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.185348 26934 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 4.
I20260709 13:08:18.186393 26785 raft_consensus.cc:2468] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 4.
I20260709 13:08:18.186658 26824 leader_election.cc:304] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:18.187673 27089 raft_consensus.cc:2804] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:18.188838 27089 raft_consensus.cc:697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 4 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:18.189628 27089 consensus_queue.cc:237] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.197078 26683 catalog_manager.cc:5697] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 3 to 4, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 4 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.370720 27112 raft_consensus.cc:993] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: : Instructing follower 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:18.371224 27111 raft_consensus.cc:1081] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Signalling peer 7102af04472b45fea26b3cf86f8acafe to start an election
I20260709 13:08:18.372699 26860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782"
dest_uuid: "7102af04472b45fea26b3cf86f8acafe"
 from {username='slave'} at 127.0.0.1:37128
I20260709 13:08:18.373252 26860 raft_consensus.cc:493] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.373564 26860 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.378227 26860 raft_consensus.cc:515] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.379879 26860 leader_election.cc:290] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 3 election: Requested vote from peers 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111), 43440284ac85466d808ba517a4c706b0 (127.25.139.131:40531)
I20260709 13:08:18.380826 26785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d2ef7d68b00428eb27455b54249aac6"
I20260709 13:08:18.380992 26934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6510e8a0942545c8bf2c1f1b4db0d782" candidate_uuid: "7102af04472b45fea26b3cf86f8acafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "43440284ac85466d808ba517a4c706b0"
I20260709 13:08:18.381318 26785 raft_consensus.cc:3055] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.381515 26934 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.381660 26785 raft_consensus.cc:740] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d2ef7d68b00428eb27455b54249aac6, State: Running, Role: LEADER
I20260709 13:08:18.382467 26785 consensus_queue.cc:260] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.383430 26785 raft_consensus.cc:3060] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.386304 26934 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 3.
I20260709 13:08:18.387459 26824 leader_election.cc:304] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43440284ac85466d808ba517a4c706b0, 7102af04472b45fea26b3cf86f8acafe; no voters: 
I20260709 13:08:18.388259 27089 raft_consensus.cc:2804] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:18.388334 26785 raft_consensus.cc:2468] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7102af04472b45fea26b3cf86f8acafe in term 3.
I20260709 13:08:18.388885 27089 raft_consensus.cc:697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 3 LEADER]: Becoming Leader. State: Replica: 7102af04472b45fea26b3cf86f8acafe, State: Running, Role: LEADER
I20260709 13:08:18.389976 27089 consensus_queue.cc:237] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } }
I20260709 13:08:18.397660 26683 catalog_manager.cc:5697] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe reported cstate change: term changed from 2 to 3, leader changed from 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129) to 7102af04472b45fea26b3cf86f8acafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "7102af04472b45fea26b3cf86f8acafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.548061 26785 raft_consensus.cc:1275] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.549779 27082 consensus_queue.cc:1048] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.550189 26860 raft_consensus.cc:1275] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.551836 27082 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.566345 26859 raft_consensus.cc:1275] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.569329 27113 consensus_queue.cc:1048] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7102af04472b45fea26b3cf86f8acafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 37873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.579578 26785 raft_consensus.cc:1275] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Refusing update from remote peer 43440284ac85466d808ba517a4c706b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.583509 27082 consensus_queue.cc:1048] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:18.645927 26785 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Refusing update from remote peer 7102af04472b45fea26b3cf86f8acafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.647533 27089 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d2ef7d68b00428eb27455b54249aac6" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.658344 26934 raft_consensus.cc:1275] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Refusing update from remote peer 7102af04472b45fea26b3cf86f8acafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.660140 27089 consensus_queue.cc:1048] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:18.949157 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:18.955114 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:08:18.970628 26823 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:08:18.975829 26823 consensus_peers.cc:597] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe -> Peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Couldn't send request to peer 0d2ef7d68b00428eb27455b54249aac6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.987635 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:18.988996 26158 tablet_replica.cc:333] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:18.989988 26158 raft_consensus.cc:2243] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.990672 26158 raft_consensus.cc:2272] T 873b080b66854bc5a56c58471a9f26c7 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:18.991120 26897 consensus_peers.cc:597] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 -> Peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Couldn't send request to peer 0d2ef7d68b00428eb27455b54249aac6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.991526 26934 raft_consensus.cc:1275] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Refusing update from remote peer 7102af04472b45fea26b3cf86f8acafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:18.993422 27120 consensus_queue.cc:1048] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "43440284ac85466d808ba517a4c706b0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.994714 26158 tablet_replica.cc:333] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:18.995613 26158 raft_consensus.cc:2243] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:18.996030 26158 raft_consensus.cc:2272] T 6510e8a0942545c8bf2c1f1b4db0d782 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:18.998620 26158 tablet_replica.cc:333] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:18.999517 26158 raft_consensus.cc:2243] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.000600 26158 raft_consensus.cc:2272] T d6a0c6598dab4f13b119d424a28d9942 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.004241 26158 tablet_replica.cc:333] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.005103 26158 raft_consensus.cc:2243] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.005700 26158 raft_consensus.cc:2272] T 07d13fda78e0416ea0ce3a7cbdb74132 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.008497 26158 tablet_replica.cc:333] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.009518 26158 raft_consensus.cc:2243] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.010361 26158 raft_consensus.cc:2272] T 1c854a59db1f473db3eda59af3823ccf P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.013443 26158 tablet_replica.cc:333] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.014420 26158 raft_consensus.cc:2243] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.015378 26158 raft_consensus.cc:2272] T 99775683f19743b99dff361620aa59e4 P 0d2ef7d68b00428eb27455b54249aac6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.018249 26158 tablet_replica.cc:333] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.019188 26158 raft_consensus.cc:2243] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.020412 26158 raft_consensus.cc:2272] T 8cb0c4e1fee24f22b394b1dbada67acd P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.022621 26158 tablet_replica.cc:333] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.023248 26158 raft_consensus.cc:2243] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.023795 26158 raft_consensus.cc:2272] T faf93b6ad00f4635804a9b526453cba3 P 0d2ef7d68b00428eb27455b54249aac6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.026532 26158 tablet_replica.cc:333] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.027285 26158 raft_consensus.cc:2243] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.027863 26158 raft_consensus.cc:2272] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 0d2ef7d68b00428eb27455b54249aac6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.031077 26158 tablet_replica.cc:333] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6: stopping tablet replica
I20260709 13:08:19.031850 26158 raft_consensus.cc:2243] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.032853 26158 raft_consensus.cc:2272] T 45d8fc82001d49a6ae34887f5e5d3de6 P 0d2ef7d68b00428eb27455b54249aac6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:19.046149 26748 connection.cc:466] server connection from 127.0.0.1:33554 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33554 (request call id 52) could send its response
W20260709 13:08:19.052718 26897 consensus_peers.cc:597] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 -> Peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Couldn't send request to peer 0d2ef7d68b00428eb27455b54249aac6. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:42111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.065830 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
W20260709 13:08:19.089232 26897 consensus_peers.cc:597] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 -> Peer 0d2ef7d68b00428eb27455b54249aac6 (127.25.139.129:42111): Couldn't send request to peer 0d2ef7d68b00428eb27455b54249aac6. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:42111: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.092489 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
I20260709 13:08:19.124483 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:19.125190 26158 tablet_replica.cc:333] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.125795 26158 raft_consensus.cc:2243] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.126266 26158 raft_consensus.cc:2272] T 1c854a59db1f473db3eda59af3823ccf P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.128123 26158 tablet_replica.cc:333] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.128670 26158 raft_consensus.cc:2243] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.129349 26158 raft_consensus.cc:2272] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.131506 26158 tablet_replica.cc:333] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.132006 26158 raft_consensus.cc:2243] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.132486 26158 raft_consensus.cc:2272] T 45d8fc82001d49a6ae34887f5e5d3de6 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.134383 26158 tablet_replica.cc:333] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.134888 26158 raft_consensus.cc:2243] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.135372 26158 raft_consensus.cc:2272] T d6a0c6598dab4f13b119d424a28d9942 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.137089 26158 tablet_replica.cc:333] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.137557 26158 raft_consensus.cc:2243] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.138281 26158 raft_consensus.cc:2272] T 07d13fda78e0416ea0ce3a7cbdb74132 P 7102af04472b45fea26b3cf86f8acafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.140148 26158 tablet_replica.cc:333] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.140623 26158 raft_consensus.cc:2243] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.141024 26158 raft_consensus.cc:2272] T 99775683f19743b99dff361620aa59e4 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.142961 26158 tablet_replica.cc:333] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.143551 26158 raft_consensus.cc:2243] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.143968 26158 raft_consensus.cc:2272] T 873b080b66854bc5a56c58471a9f26c7 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.146732 26158 tablet_replica.cc:333] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.147320 26158 raft_consensus.cc:2243] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.148064 26158 raft_consensus.cc:2272] T 6510e8a0942545c8bf2c1f1b4db0d782 P 7102af04472b45fea26b3cf86f8acafe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.150170 26158 tablet_replica.cc:333] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.150645 26158 raft_consensus.cc:2243] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.151012 26158 raft_consensus.cc:2272] T faf93b6ad00f4635804a9b526453cba3 P 7102af04472b45fea26b3cf86f8acafe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.153035 26158 tablet_replica.cc:333] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe: stopping tablet replica
I20260709 13:08:19.153558 26158 raft_consensus.cc:2243] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.153980 26158 raft_consensus.cc:2272] T 8cb0c4e1fee24f22b394b1dbada67acd P 7102af04472b45fea26b3cf86f8acafe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.185678 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
I20260709 13:08:19.204351 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
I20260709 13:08:19.228402 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:19.229203 26158 tablet_replica.cc:333] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.229853 26158 raft_consensus.cc:2243] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.230700 26158 raft_consensus.cc:2272] T 1c854a59db1f473db3eda59af3823ccf P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.232724 26158 tablet_replica.cc:333] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.233414 26158 raft_consensus.cc:2243] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.233907 26158 raft_consensus.cc:2272] T 8cb0c4e1fee24f22b394b1dbada67acd P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.235741 26158 tablet_replica.cc:333] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.236310 26158 raft_consensus.cc:2243] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.237166 26158 raft_consensus.cc:2272] T 873b080b66854bc5a56c58471a9f26c7 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.239464 26158 tablet_replica.cc:333] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.240026 26158 raft_consensus.cc:2243] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.240481 26158 raft_consensus.cc:2272] T 6510e8a0942545c8bf2c1f1b4db0d782 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.243479 26158 tablet_replica.cc:333] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.244072 26158 raft_consensus.cc:2243] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.244578 26158 raft_consensus.cc:2272] T 99775683f19743b99dff361620aa59e4 P 43440284ac85466d808ba517a4c706b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.246335 26158 tablet_replica.cc:333] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.246846 26158 raft_consensus.cc:2243] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.247351 26158 raft_consensus.cc:2272] T 07d13fda78e0416ea0ce3a7cbdb74132 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.249146 26158 tablet_replica.cc:333] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.249676 26158 raft_consensus.cc:2243] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.250144 26158 raft_consensus.cc:2272] T d6a0c6598dab4f13b119d424a28d9942 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.251926 26158 tablet_replica.cc:333] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.252446 26158 raft_consensus.cc:2243] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.253203 26158 raft_consensus.cc:2272] T faf93b6ad00f4635804a9b526453cba3 P 43440284ac85466d808ba517a4c706b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.255442 26158 tablet_replica.cc:333] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.255964 26158 raft_consensus.cc:2243] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.256399 26158 raft_consensus.cc:2272] T 857b1d2eee1a4eb8bfac3db8a51b4204 P 43440284ac85466d808ba517a4c706b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.258673 26158 tablet_replica.cc:333] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0: stopping tablet replica
I20260709 13:08:19.259133 26158 raft_consensus.cc:2243] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.259608 26158 raft_consensus.cc:2272] T 45d8fc82001d49a6ae34887f5e5d3de6 P 43440284ac85466d808ba517a4c706b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.289384 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:08:19.308068 26158 master.cc:562] Master@127.25.139.190:42481 shutting down...
I20260709 13:08:19.328745 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.329305 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.329730 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P a93ba37efa194669908d8bec9dacb377: stopping tablet replica
I20260709 13:08:19.350451 26158 master.cc:584] Master@127.25.139.190:42481 shutdown complete.
0d2ef7d68b00428eb27455b54249aac6  5
43440284ac85466d808ba517a4c706b0  1
7102af04472b45fea26b3cf86f8acafe  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10644 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:08:19.396943 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:43657
I20260709 13:08:19.398047 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:19.403891 27141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.404064 27142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.405490 27144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.406781 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:19.407684 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:19.407864 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:19.408041 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602499408027 us; error 0 us; skew 500 ppm
I20260709 13:08:19.408479 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:19.410945 26158 webserver.cc:533] Webserver started at http://127.25.139.190:45141/ using document root <none> and password file <none>
I20260709 13:08:19.411705 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:19.411864 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:19.412087 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:19.413137 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "1dbd25262fd84bb38e8451d89b086534"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.417500 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:19.420982 27149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.422008 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.001s
I20260709 13:08:19.422384 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "1dbd25262fd84bb38e8451d89b086534"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.422693 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:19.446571 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:19.448046 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:19.490814 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:43657
I20260709 13:08:19.490957 27200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:43657 every 8 connection(s)
I20260709 13:08:19.496961 27201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.507377 27201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Bootstrap starting.
I20260709 13:08:19.512138 27201 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:19.516448 27201 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: No bootstrap required, opened a new log
I20260709 13:08:19.518774 27201 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER }
I20260709 13:08:19.519280 27201 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:19.519553 27201 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dbd25262fd84bb38e8451d89b086534, State: Initialized, Role: FOLLOWER
I20260709 13:08:19.520231 27201 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER }
I20260709 13:08:19.520743 27201 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:19.521008 27201 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:19.521304 27201 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:19.526173 27201 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER }
I20260709 13:08:19.526747 27201 leader_election.cc:304] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dbd25262fd84bb38e8451d89b086534; no voters: 
I20260709 13:08:19.527992 27201 leader_election.cc:290] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:19.528422 27204 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:19.529767 27204 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 1 LEADER]: Becoming Leader. State: Replica: 1dbd25262fd84bb38e8451d89b086534, State: Running, Role: LEADER
I20260709 13:08:19.530514 27204 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER }
I20260709 13:08:19.531302 27201 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:19.533353 27205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dbd25262fd84bb38e8451d89b086534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER } }
I20260709 13:08:19.534044 27205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:19.533495 27206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dbd25262fd84bb38e8451d89b086534. Latest consensus state: current_term: 1 leader_uuid: "1dbd25262fd84bb38e8451d89b086534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dbd25262fd84bb38e8451d89b086534" member_type: VOTER } }
I20260709 13:08:19.535089 27206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:19.538592 27208 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:19.548038 27208 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:19.549154 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:19.557708 27208 catalog_manager.cc:1383] Generated new cluster ID: aeed81a8df8c4e4681182e5f25d73d76
I20260709 13:08:19.557951 27208 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:19.582697 27208 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:19.584203 27208 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:19.599301 27208 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Generated new TSK 0
I20260709 13:08:19.599952 27208 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:19.615767 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:19.622046 27222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.623939 27223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.625257 26158 server_base.cc:1061] running on GCE node
W20260709 13:08:19.625202 27225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.626646 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:19.626895 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:19.627096 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602499627070 us; error 0 us; skew 500 ppm
I20260709 13:08:19.627751 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:19.630494 26158 webserver.cc:533] Webserver started at http://127.25.139.129:37145/ using document root <none> and password file <none>
I20260709 13:08:19.631059 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:19.631345 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:19.631657 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:19.632985 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "203d83f7fac847e0beee51aa18513b25"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.637897 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:19.641593 27230 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.642613 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:08:19.642875 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "203d83f7fac847e0beee51aa18513b25"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.643132 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:19.662988 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:19.664337 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:19.665834 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:19.668222 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:19.668407 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.668706 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:19.668879 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.711936 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:44339
I20260709 13:08:19.712087 27292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:44339 every 8 connection(s)
I20260709 13:08:19.717121 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:19.724884 27297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.726747 27298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.729018 26158 server_base.cc:1061] running on GCE node
W20260709 13:08:19.729195 27300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.730537 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:19.730784 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:19.730974 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602499730956 us; error 0 us; skew 500 ppm
I20260709 13:08:19.731568 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:19.735096 26158 webserver.cc:533] Webserver started at http://127.25.139.130:39851/ using document root <none> and password file <none>
I20260709 13:08:19.735735 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:19.735774 27293 heartbeater.cc:344] Connected to a master server at 127.25.139.190:43657
I20260709 13:08:19.735967 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:19.736285 27293 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:19.736341 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:19.737128 27293 heartbeater.cc:507] Master 127.25.139.190:43657 requested a full tablet report, sending...
I20260709 13:08:19.737764 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.739540 27166 ts_manager.cc:194] Registered new tserver with Master: 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:19.741367 27166 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33586
I20260709 13:08:19.743016 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:08:19.746984 27305 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.747995 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:19.748358 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.748684 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:19.768811 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:19.770059 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:19.771631 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:19.773897 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:19.774133 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.774381 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:19.774559 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.816251 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:35457
I20260709 13:08:19.816375 27367 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:35457 every 8 connection(s)
I20260709 13:08:19.820964 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:19.828718 27371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.829547 27372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:19.832767 27374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:19.833210 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:19.834180 27368 heartbeater.cc:344] Connected to a master server at 127.25.139.190:43657
I20260709 13:08:19.834617 27368 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:19.834826 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:19.835086 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:19.835309 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602499835290 us; error 0 us; skew 500 ppm
I20260709 13:08:19.835578 27368 heartbeater.cc:507] Master 127.25.139.190:43657 requested a full tablet report, sending...
I20260709 13:08:19.836086 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:19.838019 27166 ts_manager.cc:194] Registered new tserver with Master: 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:19.839478 27166 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33590
I20260709 13:08:19.840664 26158 webserver.cc:533] Webserver started at http://127.25.139.131:34919/ using document root <none> and password file <none>
I20260709 13:08:19.841331 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:19.841611 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:19.841933 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:19.843235 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "d02eb2355bc54e7f8c13a30c33793d95"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.847832 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:19.851419 27379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.852298 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:19.852617 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "d02eb2355bc54e7f8c13a30c33793d95"
format_stamp: "Formatted at 2026-07-09 13:08:19 on dist-test-slave-v5z2"
I20260709 13:08:19.852919 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:19.864751 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:19.866021 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:19.867549 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:19.869755 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:19.869946 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.870221 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:19.870379 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:19.911389 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:34895
I20260709 13:08:19.911552 27441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:34895 every 8 connection(s)
I20260709 13:08:19.925787 27442 heartbeater.cc:344] Connected to a master server at 127.25.139.190:43657
I20260709 13:08:19.926185 27442 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:19.926904 27442 heartbeater.cc:507] Master 127.25.139.190:43657 requested a full tablet report, sending...
I20260709 13:08:19.929021 27166 ts_manager.cc:194] Registered new tserver with Master: d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:19.929395 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014808759s
I20260709 13:08:19.930413 27166 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33596
I20260709 13:08:19.957839 27166 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:19.964119 27166 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:20.163036 27258 tablet_service.cc:1511] Processing CreateTablet for tablet e622bd20107a4c4190d71a5b581aa506 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:20.164652 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e622bd20107a4c4190d71a5b581aa506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.164297 27256 tablet_service.cc:1511] Processing CreateTablet for tablet efee0a6a9d2c4ed096004a49852dbc86 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:20.165689 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efee0a6a9d2c4ed096004a49852dbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.171753 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44de1887e445a5b020fd0cbae6a5a3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:20.173264 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44de1887e445a5b020fd0cbae6a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.175341 27330 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44de1887e445a5b020fd0cbae6a5a3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:20.176827 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44de1887e445a5b020fd0cbae6a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.176946 27332 tablet_service.cc:1511] Processing CreateTablet for tablet cdb46c37e35142cf8e2148ef2d2da5e7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:20.178362 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb46c37e35142cf8e2148ef2d2da5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.175341 27333 tablet_service.cc:1511] Processing CreateTablet for tablet e622bd20107a4c4190d71a5b581aa506 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:20.180572 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e622bd20107a4c4190d71a5b581aa506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.180261 27331 tablet_service.cc:1511] Processing CreateTablet for tablet efee0a6a9d2c4ed096004a49852dbc86 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:20.181592 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efee0a6a9d2c4ed096004a49852dbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.169519 27257 tablet_service.cc:1511] Processing CreateTablet for tablet cdb46c37e35142cf8e2148ef2d2da5e7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:20.182760 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb46c37e35142cf8e2148ef2d2da5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.187853 27254 tablet_service.cc:1511] Processing CreateTablet for tablet e9cc5476f0fd4bceaab7f594e240f37c (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:20.189349 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cc5476f0fd4bceaab7f594e240f37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.192332 27253 tablet_service.cc:1511] Processing CreateTablet for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:20.193758 27253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.196257 27252 tablet_service.cc:1511] Processing CreateTablet for tablet 41a124c306f9418a8556266f795a58b3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:20.197690 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a124c306f9418a8556266f795a58b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.201500 27251 tablet_service.cc:1511] Processing CreateTablet for tablet d07722edbe05448eaa1edebf1ce562cd (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:20.202854 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07722edbe05448eaa1edebf1ce562cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.204840 27250 tablet_service.cc:1511] Processing CreateTablet for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:20.211527 27250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a9f1b01ac8406691c2d1c83b5dcca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.219676 27329 tablet_service.cc:1511] Processing CreateTablet for tablet e9cc5476f0fd4bceaab7f594e240f37c (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:20.220230 27407 tablet_service.cc:1511] Processing CreateTablet for tablet e622bd20107a4c4190d71a5b581aa506 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:08:20.221146 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cc5476f0fd4bceaab7f594e240f37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.221554 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e622bd20107a4c4190d71a5b581aa506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.224298 27406 tablet_service.cc:1511] Processing CreateTablet for tablet cdb46c37e35142cf8e2148ef2d2da5e7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:08:20.225647 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdb46c37e35142cf8e2148ef2d2da5e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.228389 27404 tablet_service.cc:1511] Processing CreateTablet for tablet 0a44de1887e445a5b020fd0cbae6a5a3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:08:20.229737 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44de1887e445a5b020fd0cbae6a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.232285 27403 tablet_service.cc:1511] Processing CreateTablet for tablet e9cc5476f0fd4bceaab7f594e240f37c (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:08:20.233655 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9cc5476f0fd4bceaab7f594e240f37c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.239892 27249 tablet_service.cc:1511] Processing CreateTablet for tablet 415aa8030d05423fbf90a8f010b516d3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:20.240247 27328 tablet_service.cc:1511] Processing CreateTablet for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:20.241374 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415aa8030d05423fbf90a8f010b516d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.241583 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.242969 27405 tablet_service.cc:1511] Processing CreateTablet for tablet efee0a6a9d2c4ed096004a49852dbc86 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:08:20.243839 27324 tablet_service.cc:1511] Processing CreateTablet for tablet 415aa8030d05423fbf90a8f010b516d3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:20.244462 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efee0a6a9d2c4ed096004a49852dbc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.250044 27326 tablet_service.cc:1511] Processing CreateTablet for tablet d07722edbe05448eaa1edebf1ce562cd (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:20.249951 27325 tablet_service.cc:1511] Processing CreateTablet for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:20.250555 27402 tablet_service.cc:1511] Processing CreateTablet for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:08:20.257674 27401 tablet_service.cc:1511] Processing CreateTablet for tablet 41a124c306f9418a8556266f795a58b3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:20.259383 27327 tablet_service.cc:1511] Processing CreateTablet for tablet 41a124c306f9418a8556266f795a58b3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:08:20.262387 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b3f6c9e74407ebaecb4a51f7b4fcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.264261 27257 tablet_service.cc:1511] Processing CreateTablet for tablet 76061244738f450fb409cb866212c235 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:20.264477 27398 tablet_service.cc:1511] Processing CreateTablet for tablet 415aa8030d05423fbf90a8f010b516d3 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:08:20.265882 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76061244738f450fb409cb866212c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.265962 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415aa8030d05423fbf90a8f010b516d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.267608 27401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a124c306f9418a8556266f795a58b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.267524 27399 tablet_service.cc:1511] Processing CreateTablet for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:08:20.268452 27400 tablet_service.cc:1511] Processing CreateTablet for tablet d07722edbe05448eaa1edebf1ce562cd (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:08:20.275331 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415aa8030d05423fbf90a8f010b516d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.275609 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 008af8ad84434532baca82a0654da9bf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:20.279563 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a9f1b01ac8406691c2d1c83b5dcca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.283864 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a9f1b01ac8406691c2d1c83b5dcca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.284787 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07722edbe05448eaa1edebf1ce562cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.285552 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a124c306f9418a8556266f795a58b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.287585 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07722edbe05448eaa1edebf1ce562cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.327105 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008af8ad84434532baca82a0654da9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.352769 27457 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:20.369345 27457 tablet_bootstrap.cc:654] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.369553 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 76061244738f450fb409cb866212c235 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:20.371037 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76061244738f450fb409cb866212c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.413230 27406 tablet_service.cc:1511] Processing CreateTablet for tablet 76061244738f450fb409cb866212c235 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:08:20.383060 27249 tablet_service.cc:1511] Processing CreateTablet for tablet 189d9bcac7d24abe800257c915b738c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:20.414637 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76061244738f450fb409cb866212c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.415055 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189d9bcac7d24abe800257c915b738c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.418340 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 189d9bcac7d24abe800257c915b738c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:20.419831 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189d9bcac7d24abe800257c915b738c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.428388 27398 tablet_service.cc:1511] Processing CreateTablet for tablet 008af8ad84434532baca82a0654da9bf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:20.449630 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 4841dcf8d05d4ecaa8771d888fc649c0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:20.450598 27406 tablet_service.cc:1511] Processing CreateTablet for tablet 4841dcf8d05d4ecaa8771d888fc649c0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:20.452220 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 59877a2f8723407f9fd30c7505cc2e29 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:20.455363 27326 tablet_service.cc:1511] Processing CreateTablet for tablet 008af8ad84434532baca82a0654da9bf (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:08:20.457278 27403 tablet_service.cc:1511] Processing CreateTablet for tablet c065641be1624ea49a986708690a8b46 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:20.464341 27332 tablet_service.cc:1511] Processing CreateTablet for tablet c065641be1624ea49a986708690a8b46 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:20.476603 27459 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:20.462600 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7b8babc1b46fbad021d233647b834 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:20.485723 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841dcf8d05d4ecaa8771d888fc649c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.486163 27330 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7b8babc1b46fbad021d233647b834 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:20.487519 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c065641be1624ea49a986708690a8b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.490126 27459 tablet_bootstrap.cc:654] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.497344 27254 tablet_service.cc:1511] Processing CreateTablet for tablet 59877a2f8723407f9fd30c7505cc2e29 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:20.498934 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59877a2f8723407f9fd30c7505cc2e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.501156 27457 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:20.501693 27457 ts_tablet_manager.cc:1403] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.000s
I20260709 13:08:20.503333 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 17909c3b30eb43b79bd7ea94e48dcef1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:20.504597 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17909c3b30eb43b79bd7ea94e48dcef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.504462 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 56b15c3e61ae45a6b84a4d2a3838c018 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:20.505203 27457 raft_consensus.cc:359] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.505988 27457 raft_consensus.cc:385] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.506306 27457 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.506632 27253 tablet_service.cc:1511] Processing CreateTablet for tablet 4d09be3e7a494235854c88600f2adfad (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:20.507434 27457 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.511348 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b15c3e61ae45a6b84a4d2a3838c018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.511603 27458 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:20.515787 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7b8babc1b46fbad021d233647b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.523975 27329 tablet_service.cc:1511] Processing CreateTablet for tablet 4841dcf8d05d4ecaa8771d888fc649c0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:08:20.525049 27327 tablet_service.cc:1511] Processing CreateTablet for tablet 59877a2f8723407f9fd30c7505cc2e29 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:08:20.526192 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841dcf8d05d4ecaa8771d888fc649c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.527268 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59877a2f8723407f9fd30c7505cc2e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.527217 27253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d09be3e7a494235854c88600f2adfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.535610 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7b8babc1b46fbad021d233647b834. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:20.546773 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:20.547478 27293 heartbeater.cc:499] Master 127.25.139.190:43657 was elected leader, sending a full tablet report...
I20260709 13:08:20.564363 27457 ts_tablet_manager.cc:1434] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.062s	user 0.016s	sys 0.004s
I20260709 13:08:20.565585 27457 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:20.535000 27324 tablet_service.cc:1511] Processing CreateTablet for tablet 17909c3b30eb43b79bd7ea94e48dcef1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:20.534653 27399 tablet_service.cc:1511] Processing CreateTablet for tablet 17909c3b30eb43b79bd7ea94e48dcef1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:08:20.478387 27405 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7b8babc1b46fbad021d233647b834 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:08:20.530838 27252 tablet_service.cc:1511] Processing CreateTablet for tablet c065641be1624ea49a986708690a8b46 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:08:20.569156 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c065641be1624ea49a986708690a8b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.555859 27257 tablet_service.cc:1511] Processing CreateTablet for tablet 05efe4ee1469496f84eca86709a6b478 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:20.570236 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05efe4ee1469496f84eca86709a6b478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.574124 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcb012538c4a0eb307834fbfd9752a (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:20.576133 27331 tablet_service.cc:1511] Processing CreateTablet for tablet 189d9bcac7d24abe800257c915b738c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:08:20.591761 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17909c3b30eb43b79bd7ea94e48dcef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.593343 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c065641be1624ea49a986708690a8b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.595625 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008af8ad84434532baca82a0654da9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.597725 27407 tablet_service.cc:1511] Processing CreateTablet for tablet 4d09be3e7a494235854c88600f2adfad (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:20.638528 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 05efe4ee1469496f84eca86709a6b478 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:20.606969 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189d9bcac7d24abe800257c915b738c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.642406 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 3defd7d5f6684c09bb491b62d9c1cba1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:20.644989 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcb012538c4a0eb307834fbfd9752a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.645817 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defd7d5f6684c09bb491b62d9c1cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.647498 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05efe4ee1469496f84eca86709a6b478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.651638 27404 tablet_service.cc:1511] Processing CreateTablet for tablet 05efe4ee1469496f84eca86709a6b478 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:08:20.613631 27458 tablet_bootstrap.cc:654] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.595657 27328 tablet_service.cc:1511] Processing CreateTablet for tablet 4d09be3e7a494235854c88600f2adfad (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:08:20.662182 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d09be3e7a494235854c88600f2adfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.605145 27459 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:20.635967 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d09be3e7a494235854c88600f2adfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.668286 27459 ts_tablet_manager.cc:1403] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.194s	user 0.023s	sys 0.041s
I20260709 13:08:20.675799 27253 tablet_service.cc:1511] Processing CreateTablet for tablet ca25783a146d4038878d9ffd69f34217 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:20.611737 27332 tablet_service.cc:1511] Processing CreateTablet for tablet 56b15c3e61ae45a6b84a4d2a3838c018 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:20.681668 27253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25783a146d4038878d9ffd69f34217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.609036 27402 tablet_service.cc:1511] Processing CreateTablet for tablet 56b15c3e61ae45a6b84a4d2a3838c018 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:08:20.649983 27325 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcb012538c4a0eb307834fbfd9752a (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:20.610731 27250 tablet_service.cc:1511] Processing CreateTablet for tablet b390ed75f2f14d258d4cdff9c656d787 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:20.614928 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 0f07af3920db4e9da19de0ec4eba7c75 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:20.680807 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841dcf8d05d4ecaa8771d888fc649c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.688241 27249 tablet_service.cc:1511] Processing CreateTablet for tablet c4f1db10d9664160ae88f26e3becd4b7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:20.689090 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17909c3b30eb43b79bd7ea94e48dcef1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.689749 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008af8ad84434532baca82a0654da9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.690336 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7b8babc1b46fbad021d233647b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.693179 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59877a2f8723407f9fd30c7505cc2e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.699857 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b15c3e61ae45a6b84a4d2a3838c018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.682260 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56b15c3e61ae45a6b84a4d2a3838c018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.703691 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05efe4ee1469496f84eca86709a6b478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.707286 27457 tablet_bootstrap.cc:654] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.713565 27254 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa2cbbfc6b45fe8d8f862c301f1909 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:20.724483 27459 raft_consensus.cc:359] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.725589 27459 raft_consensus.cc:385] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.725936 27459 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.726126 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 13cceb5d4cfd4e358a438f514c9e75f0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:20.726882 27459 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.727828 27458 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:20.728438 27458 ts_tablet_manager.cc:1403] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.217s	user 0.018s	sys 0.015s
I20260709 13:08:20.728806 27401 tablet_service.cc:1511] Processing CreateTablet for tablet 83dcb012538c4a0eb307834fbfd9752a (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:08:20.730476 27401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcb012538c4a0eb307834fbfd9752a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.736245 27326 tablet_service.cc:1511] Processing CreateTablet for tablet 0f07af3920db4e9da19de0ec4eba7c75 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:20.737773 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f07af3920db4e9da19de0ec4eba7c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.744189 27327 tablet_service.cc:1511] Processing CreateTablet for tablet b390ed75f2f14d258d4cdff9c656d787 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:20.746075 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b390ed75f2f14d258d4cdff9c656d787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.715071 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa2cbbfc6b45fe8d8f862c301f1909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.751016 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f07af3920db4e9da19de0ec4eba7c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.752503 27329 tablet_service.cc:1511] Processing CreateTablet for tablet 3defd7d5f6684c09bb491b62d9c1cba1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:20.727655 27257 tablet_service.cc:1511] Processing CreateTablet for tablet a30a45f010dd49e5a9ddb107297fa03e (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:20.753579 27458 raft_consensus.cc:359] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.754407 27458 raft_consensus.cc:385] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.754751 27458 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.753221 27252 tablet_service.cc:1511] Processing CreateTablet for tablet 170c6d7d3371409fbd512d4226e702f5 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:20.767342 27250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b390ed75f2f14d258d4cdff9c656d787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.771643 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cceb5d4cfd4e358a438f514c9e75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.779646 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f1db10d9664160ae88f26e3becd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.754029 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defd7d5f6684c09bb491b62d9c1cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.781020 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a45f010dd49e5a9ddb107297fa03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.781620 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcb012538c4a0eb307834fbfd9752a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.793329 27403 tablet_service.cc:1511] Processing CreateTablet for tablet b390ed75f2f14d258d4cdff9c656d787 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:08:20.796000 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:20.803524 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170c6d7d3371409fbd512d4226e702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.808956 27324 tablet_service.cc:1511] Processing CreateTablet for tablet ca25783a146d4038878d9ffd69f34217 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:20.820202 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b390ed75f2f14d258d4cdff9c656d787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.806898 27459 ts_tablet_manager.cc:1434] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.004s
I20260709 13:08:20.814358 27331 tablet_service.cc:1511] Processing CreateTablet for tablet c4f1db10d9664160ae88f26e3becd4b7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:20.834820 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f1db10d9664160ae88f26e3becd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.836634 27442 heartbeater.cc:499] Master 127.25.139.190:43657 was elected leader, sending a full tablet report...
I20260709 13:08:20.839861 27459 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:20.842382 27368 heartbeater.cc:499] Master 127.25.139.190:43657 was elected leader, sending a full tablet report...
I20260709 13:08:20.855576 27402 tablet_service.cc:1511] Processing CreateTablet for tablet 0f07af3920db4e9da19de0ec4eba7c75 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:08:20.857162 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f07af3920db4e9da19de0ec4eba7c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.858430 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 4b44d9e3827f45eabce8235344e58d0f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:20.869338 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.875527 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b44d9e3827f45eabce8235344e58d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.877270 27399 tablet_service.cc:1511] Processing CreateTablet for tablet ca25783a146d4038878d9ffd69f34217 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:08:20.793334 27458 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.880692 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25783a146d4038878d9ffd69f34217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.881376 27406 tablet_service.cc:1511] Processing CreateTablet for tablet 3defd7d5f6684c09bb491b62d9c1cba1 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:08:20.886719 27330 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa2cbbfc6b45fe8d8f862c301f1909 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:20.889478 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa2cbbfc6b45fe8d8f862c301f1909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.890208 27457 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:20.890731 27457 ts_tablet_manager.cc:1403] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.325s	user 0.007s	sys 0.009s
I20260709 13:08:20.892663 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 3412bba6f0c740dd9adb1895146dd937 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:20.893704 27328 tablet_service.cc:1511] Processing CreateTablet for tablet 13cceb5d4cfd4e358a438f514c9e75f0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:20.894109 27457 raft_consensus.cc:359] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.910180 27457 raft_consensus.cc:385] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.895134 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25783a146d4038878d9ffd69f34217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.899209 27462 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.910588 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3412bba6f0c740dd9adb1895146dd937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.900774 27333 tablet_service.cc:1511] Processing CreateTablet for tablet a30a45f010dd49e5a9ddb107297fa03e (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:20.910318 27398 tablet_service.cc:1511] Processing CreateTablet for tablet c4f1db10d9664160ae88f26e3becd4b7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:08:20.906105 27253 tablet_service.cc:1511] Processing CreateTablet for tablet bf4fb4f20e74427f86180930e86a7afc (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:20.910595 27457 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.912662 27253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4fb4f20e74427f86180930e86a7afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.910903 27462 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.912689 27457 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:20.903885 27332 tablet_service.cc:1511] Processing CreateTablet for tablet 170c6d7d3371409fbd512d4226e702f5 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:20.907274 27329 tablet_service.cc:1511] Processing CreateTablet for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:20.927670 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3defd7d5f6684c09bb491b62d9c1cba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.933876 27462 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:20.948798 27407 tablet_service.cc:1511] Processing CreateTablet for tablet 13cceb5d4cfd4e358a438f514c9e75f0 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:08:20.949844 27405 tablet_service.cc:1511] Processing CreateTablet for tablet a30a45f010dd49e5a9ddb107297fa03e (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:08:20.946514 27326 tablet_service.cc:1511] Processing CreateTablet for tablet 4b44d9e3827f45eabce8235344e58d0f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:20.979866 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f1db10d9664160ae88f26e3becd4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.983305 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cceb5d4cfd4e358a438f514c9e75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.997430 27459 tablet_bootstrap.cc:654] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.984459 27400 tablet_service.cc:1511] Processing CreateTablet for tablet d0aa2cbbfc6b45fe8d8f862c301f1909 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:08:21.002972 27457 ts_tablet_manager.cc:1434] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.112s	user 0.016s	sys 0.007s
I20260709 13:08:21.005867 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b44d9e3827f45eabce8235344e58d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.006537 27325 tablet_service.cc:1511] Processing CreateTablet for tablet 3412bba6f0c740dd9adb1895146dd937 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:21.009044 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.012193 27250 tablet_service.cc:1511] Processing CreateTablet for tablet c760b3987ef34e0189563d3ccb585eed (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:21.013244 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a45f010dd49e5a9ddb107297fa03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.015828 27404 tablet_service.cc:1511] Processing CreateTablet for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:08:21.024653 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3412bba6f0c740dd9adb1895146dd937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.026566 27249 tablet_service.cc:1511] Processing CreateTablet for tablet 099c52bc6b98406cadce31d6411cb635 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:21.027209 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:21.040588 27231 leader_election.cc:343] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.028499 27457 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:21.033458 27250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c760b3987ef34e0189563d3ccb585eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.035861 27458 ts_tablet_manager.cc:1434] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.307s	user 0.006s	sys 0.018s
I20260709 13:08:21.043462 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a45f010dd49e5a9ddb107297fa03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.043620 27458 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:21.048179 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa2cbbfc6b45fe8d8f862c301f1909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.051523 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099c52bc6b98406cadce31d6411cb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.061302 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13cceb5d4cfd4e358a438f514c9e75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.053673 27255 tablet_service.cc:1511] Processing CreateTablet for tablet cfbd4344db4a4ffb8868b58ddc53af83 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:21.062395 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbd4344db4a4ffb8868b58ddc53af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.065166 27252 tablet_service.cc:1511] Processing CreateTablet for tablet 804fae3c2b684e6a8a7c159e417231fa (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:21.066437 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804fae3c2b684e6a8a7c159e417231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.054045 27402 tablet_service.cc:1511] Processing CreateTablet for tablet 4b44d9e3827f45eabce8235344e58d0f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:08:21.072100 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170c6d7d3371409fbd512d4226e702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.091951 27458 tablet_bootstrap.cc:654] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.075941 27327 tablet_service.cc:1511] Processing CreateTablet for tablet 4d586a4492094f0dbea7efd8255dd991 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:21.085568 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:21.096700 27330 tablet_service.cc:1511] Processing CreateTablet for tablet cfbd4344db4a4ffb8868b58ddc53af83 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:08:21.097232 27233 leader_election.cc:343] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.097694 27233 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:21.098033 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbd4344db4a4ffb8868b58ddc53af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.098475 27462 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.103754 27257 tablet_service.cc:1511] Processing CreateTablet for tablet f872873b55df4f2ab953481b0bbe5229 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:21.078992 27457 tablet_bootstrap.cc:654] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.111953 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d586a4492094f0dbea7efd8255dd991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.112128 27251 tablet_service.cc:1511] Processing CreateTablet for tablet e0b732e9fe744ccfb9006867b9ec2cd7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:21.113477 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b732e9fe744ccfb9006867b9ec2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.116087 27401 tablet_service.cc:1511] Processing CreateTablet for tablet 170c6d7d3371409fbd512d4226e702f5 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:08:21.106498 27254 tablet_service.cc:1511] Processing CreateTablet for tablet 4d586a4492094f0dbea7efd8255dd991 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:21.118878 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d586a4492094f0dbea7efd8255dd991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.119575 27331 tablet_service.cc:1511] Processing CreateTablet for tablet bf4fb4f20e74427f86180930e86a7afc (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:21.121299 27331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4fb4f20e74427f86180930e86a7afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.125142 27467 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.125844 27467 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.128904 27403 tablet_service.cc:1511] Processing CreateTablet for tablet 3412bba6f0c740dd9adb1895146dd937 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:08:21.132490 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:21.133524 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872873b55df4f2ab953481b0bbe5229. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:21.134455 27231 leader_election.cc:343] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.132635 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f78b1bcfcd4b219e6af2bf690b4f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.138589 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b44d9e3827f45eabce8235344e58d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.138793 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 60414d130cdc460696513fb91e20161f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:21.140385 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414d130cdc460696513fb91e20161f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.140407 27330 tablet_service.cc:1511] Processing CreateTablet for tablet c760b3987ef34e0189563d3ccb585eed (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:21.143558 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c760b3987ef34e0189563d3ccb585eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.144234 27401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170c6d7d3371409fbd512d4226e702f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.152454 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 099c52bc6b98406cadce31d6411cb635 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:21.163324 27399 tablet_service.cc:1511] Processing CreateTablet for tablet bf4fb4f20e74427f86180930e86a7afc (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:08:21.165066 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099c52bc6b98406cadce31d6411cb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.164314 27398 tablet_service.cc:1511] Processing CreateTablet for tablet 4d586a4492094f0dbea7efd8255dd991 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:08:21.166189 27467 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.167764 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:21.172664 27233 leader_election.cc:343] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.173136 27233 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:21.174077 27459 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:21.174580 27459 ts_tablet_manager.cc:1403] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.335s	user 0.023s	sys 0.019s
I20260709 13:08:21.176203 27324 tablet_service.cc:1511] Processing CreateTablet for tablet f872873b55df4f2ab953481b0bbe5229 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:21.203950 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872873b55df4f2ab953481b0bbe5229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.207279 27459 raft_consensus.cc:359] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.208086 27459 raft_consensus.cc:385] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.208488 27459 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.209277 27459 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.210291 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 099c52bc6b98406cadce31d6411cb635 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:08:21.180269 27253 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:21.183332 27467 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.171134 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3412bba6f0c740dd9adb1895146dd937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.185187 27406 tablet_service.cc:1511] Processing CreateTablet for tablet cfbd4344db4a4ffb8868b58ddc53af83 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:08:21.188043 27464 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.197391 27457 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:21.197867 27407 tablet_service.cc:1511] Processing CreateTablet for tablet c760b3987ef34e0189563d3ccb585eed (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:08:21.198530 27466 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.186971 27326 tablet_service.cc:1511] Processing CreateTablet for tablet 804fae3c2b684e6a8a7c159e417231fa (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:21.220346 27330 tablet_service.cc:1511] Processing CreateTablet for tablet e0b732e9fe744ccfb9006867b9ec2cd7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:21.221653 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b732e9fe744ccfb9006867b9ec2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.223344 27464 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.226276 27464 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:21.236217 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804fae3c2b684e6a8a7c159e417231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.239188 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3e88c6f82141d8a7a8cb507f425200 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:21.228101 27457 ts_tablet_manager.cc:1403] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.200s	user 0.006s	sys 0.009s
I20260709 13:08:21.227144 27466 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.262943 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4fb4f20e74427f86180930e86a7afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.276012 27253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2fa29e3bcf4670ab310ce67ee127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.293004 27457 raft_consensus.cc:359] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.295706 27333 tablet_service.cc:1511] Processing CreateTablet for tablet 60414d130cdc460696513fb91e20161f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:21.298666 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d586a4492094f0dbea7efd8255dd991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.318800 27466 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.310303 27327 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:21.320513 27328 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3e88c6f82141d8a7a8cb507f425200 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:21.322698 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099c52bc6b98406cadce31d6411cb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.327803 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3e88c6f82141d8a7a8cb507f425200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.332828 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414d130cdc460696513fb91e20161f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.333750 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3e88c6f82141d8a7a8cb507f425200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.335883 27332 tablet_service.cc:1511] Processing CreateTablet for tablet 3c247f301fde4963b4d1761a0b3254a9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:21.336484 27325 tablet_service.cc:1511] Processing CreateTablet for tablet fbda0aef93534e40827c2bc13b826560 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:21.337313 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c247f301fde4963b4d1761a0b3254a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.338150 27255 tablet_service.cc:1511] Processing CreateTablet for tablet fbda0aef93534e40827c2bc13b826560 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:21.305960 27457 raft_consensus.cc:385] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.339514 27457 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.339704 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbda0aef93534e40827c2bc13b826560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.340334 27457 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.341670 27458 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:21.342334 27458 ts_tablet_manager.cc:1403] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.299s	user 0.028s	sys 0.033s
I20260709 13:08:21.344225 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2fa29e3bcf4670ab310ce67ee127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.351526 27475 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.352085 27475 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.350555 27404 tablet_service.cc:1511] Processing CreateTablet for tablet f872873b55df4f2ab953481b0bbe5229 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:08:21.359651 27475 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:21.369022 27405 tablet_service.cc:1511] Processing CreateTablet for tablet 804fae3c2b684e6a8a7c159e417231fa (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:08:21.375360 27457 ts_tablet_manager.cc:1434] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.001s
I20260709 13:08:21.376573 27457 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:21.376915 27254 tablet_service.cc:1511] Processing CreateTablet for tablet 8a295e8566b04b49918a92cb09270d62 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:21.378470 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a295e8566b04b49918a92cb09270d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.383390 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbd4344db4a4ffb8868b58ddc53af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.384212 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c760b3987ef34e0189563d3ccb585eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.393790 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbda0aef93534e40827c2bc13b826560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.396091 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872873b55df4f2ab953481b0bbe5229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.410307 27459 ts_tablet_manager.cc:1434] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.235s	user 0.016s	sys 0.024s
I20260709 13:08:21.409955 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 3c247f301fde4963b4d1761a0b3254a9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:08:21.424118 27459 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:21.425395 27249 tablet_service.cc:1511] Processing CreateTablet for tablet a0d30dde9c4c4d778d398130da0cdaea (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:21.430779 27457 tablet_bootstrap.cc:654] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.437578 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c247f301fde4963b4d1761a0b3254a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.432423 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804fae3c2b684e6a8a7c159e417231fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.446897 27459 tablet_bootstrap.cc:654] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.452430 27399 tablet_service.cc:1511] Processing CreateTablet for tablet 60414d130cdc460696513fb91e20161f (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:08:21.453830 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60414d130cdc460696513fb91e20161f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.456359 27403 tablet_service.cc:1511] Processing CreateTablet for tablet fbda0aef93534e40827c2bc13b826560 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:08:21.456993 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:21.457791 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbda0aef93534e40827c2bc13b826560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.460444 27458 raft_consensus.cc:359] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.461376 27458 raft_consensus.cc:385] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.461686 27458 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.463603 27249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d30dde9c4c4d778d398130da0cdaea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.464463 27252 tablet_service.cc:1511] Processing CreateTablet for tablet 0287d5309a46494ca6fc1acd716c9c17 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:21.466090 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287d5309a46494ca6fc1acd716c9c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.470160 27327 tablet_service.cc:1511] Processing CreateTablet for tablet 8a295e8566b04b49918a92cb09270d62 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:21.471617 27327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a295e8566b04b49918a92cb09270d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.471750 27329 tablet_service.cc:1511] Processing CreateTablet for tablet a0d30dde9c4c4d778d398130da0cdaea (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:21.473229 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d30dde9c4c4d778d398130da0cdaea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.475963 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:21.477461 27380 leader_election.cc:343] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.478077 27401 tablet_service.cc:1511] Processing CreateTablet for tablet 3c247f301fde4963b4d1761a0b3254a9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:08:21.478531 27380 leader_election.cc:343] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.450526 27402 tablet_service.cc:1511] Processing CreateTablet for tablet e0b732e9fe744ccfb9006867b9ec2cd7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:08:21.480212 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b732e9fe744ccfb9006867b9ec2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.468639 27406 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:08:21.482790 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2fa29e3bcf4670ab310ce67ee127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.483119 27330 tablet_service.cc:1511] Processing CreateTablet for tablet 0287d5309a46494ca6fc1acd716c9c17 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:08:21.486375 27258 tablet_service.cc:1511] Processing CreateTablet for tablet a055e36ded584640806637e94e87f6b9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:21.496780 27330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287d5309a46494ca6fc1acd716c9c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.496999 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055e36ded584640806637e94e87f6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.502310 27254 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1b7ffb3d487ea7c361ac87825c5d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:21.502420 27398 tablet_service.cc:1511] Processing CreateTablet for tablet 8a295e8566b04b49918a92cb09270d62 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:08:21.495275 27328 tablet_service.cc:1511] Processing CreateTablet for tablet a055e36ded584640806637e94e87f6b9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:21.507985 27326 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1b7ffb3d487ea7c361ac87825c5d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:21.515619 27407 tablet_service.cc:1511] Processing CreateTablet for tablet 0f3e88c6f82141d8a7a8cb507f425200 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:08:21.503880 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1b7ffb3d487ea7c361ac87825c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.462483 27458 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.533948 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 21d14940356a45ada8e16731853b8769 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:21.535468 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d14940356a45ada8e16731853b8769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.539446 27401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c247f301fde4963b4d1761a0b3254a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.554378 27405 tablet_service.cc:1511] Processing CreateTablet for tablet a0d30dde9c4c4d778d398130da0cdaea (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:08:21.556787 27458 ts_tablet_manager.cc:1434] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.214s	user 0.004s	sys 0.004s
I20260709 13:08:21.556965 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d30dde9c4c4d778d398130da0cdaea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.557035 27324 tablet_service.cc:1511] Processing CreateTablet for tablet 21d14940356a45ada8e16731853b8769 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:08:21.565254 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:21.566334 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055e36ded584640806637e94e87f6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.568007 27467 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.568495 27467 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.575933 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a295e8566b04b49918a92cb09270d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.576709 27324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d14940356a45ada8e16731853b8769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.580420 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:21.581843 27458 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
W20260709 13:08:21.582998 27231 leader_election.cc:343] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.583938 27467 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.585541 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:21.587802 27233 leader_election.cc:343] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.588246 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:21.589509 27466 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.589964 27466 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.593353 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:21.593681 27467 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.594188 27466 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.601083 27326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1b7ffb3d487ea7c361ac87825c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.601471 27407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f3e88c6f82141d8a7a8cb507f425200. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.595196 27399 tablet_service.cc:1511] Processing CreateTablet for tablet 0287d5309a46494ca6fc1acd716c9c17 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:08:21.614754 27309 leader_election.cc:343] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.615458 27399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287d5309a46494ca6fc1acd716c9c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.615782 27459 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:21.616228 27459 ts_tablet_manager.cc:1403] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.011s
I20260709 13:08:21.613292 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:21.637881 27383 leader_election.cc:343] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.638443 27383 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:21.639420 27475 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.640887 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:21.641585 27267 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:21.643747 27254 tablet_service.cc:1511] Processing CreateTablet for tablet e376a729bb7c47e99662f97b33ea32c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:21.643859 27252 tablet_service.cc:1511] Processing CreateTablet for tablet e004b67b35dd4a9b8ccf73182f7bdf58 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:21.646553 27404 tablet_service.cc:1511] Processing CreateTablet for tablet a055e36ded584640806637e94e87f6b9 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:08:21.647982 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:21.648661 27266 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:21.651233 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:21.652326 27466 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.652705 27466 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.652927 27457 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:21.653445 27457 ts_tablet_manager.cc:1403] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.277s	user 0.016s	sys 0.004s
I20260709 13:08:21.653436 27459 raft_consensus.cc:359] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.654441 27459 raft_consensus.cc:385] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.653069 27466 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.656564 27457 raft_consensus.cc:359] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.657310 27457 raft_consensus.cc:385] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.657620 27457 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.658481 27457 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.642781 27332 tablet_service.cc:1511] Processing CreateTablet for tablet e376a729bb7c47e99662f97b33ea32c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:21.660274 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e376a729bb7c47e99662f97b33ea32c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.661013 27457 ts_tablet_manager.cc:1434] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:21.654891 27459 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.662781 27459 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.664686 27333 tablet_service.cc:1511] Processing CreateTablet for tablet e004b67b35dd4a9b8ccf73182f7bdf58 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:08:21.665751 27404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a055e36ded584640806637e94e87f6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.665970 27333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e004b67b35dd4a9b8ccf73182f7bdf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.663046 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:21.666939 27475 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.667469 27475 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.667913 27475 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.679773 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e376a729bb7c47e99662f97b33ea32c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.680486 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e004b67b35dd4a9b8ccf73182f7bdf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.681641 27406 tablet_service.cc:1511] Processing CreateTablet for tablet a4df1b7ffb3d487ea7c361ac87825c5d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:08:21.682535 27251 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43efa5ed2d4349a1025bedcb71ff49 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:21.692235 27325 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43efa5ed2d4349a1025bedcb71ff49 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:21.693593 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43efa5ed2d4349a1025bedcb71ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.697377 27457 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:21.700248 27400 tablet_service.cc:1511] Processing CreateTablet for tablet 21d14940356a45ada8e16731853b8769 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:08:21.701117 27459 ts_tablet_manager.cc:1434] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 13:08:21.701565 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d14940356a45ada8e16731853b8769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.704218 27459 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:21.706426 27458 tablet_bootstrap.cc:654] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.718712 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:21.720466 27398 tablet_service.cc:1511] Processing CreateTablet for tablet e004b67b35dd4a9b8ccf73182f7bdf58 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:08:21.721264 27308 leader_election.cc:343] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.721904 27398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e004b67b35dd4a9b8ccf73182f7bdf58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.719686 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:21.721733 27308 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:21.710788 27403 tablet_service.cc:1511] Processing CreateTablet for tablet e376a729bb7c47e99662f97b33ea32c7 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:08:21.731534 27466 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.718918 27475 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.737912 27251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43efa5ed2d4349a1025bedcb71ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.738234 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:21.738878 27266 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.740953 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:21.742542 27380 leader_election.cc:343] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.743187 27475 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:21.743907 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:21.744406 27267 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.750187 27267 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:21.752178 27466 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.752839 27466 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.754062 27266 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:21.755254 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:21.756783 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:21.752878 27457 tablet_bootstrap.cc:654] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.759717 27475 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.766177 27466 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.767088 27459 tablet_bootstrap.cc:654] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.771394 27466 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:21.771556 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 43ab3e6cd15341cd8cc43296cb7ce69d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:08:21.772346 27466 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.773324 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ab3e6cd15341cd8cc43296cb7ce69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.775447 27464 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.775924 27464 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.777916 27464 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:21.767416 27406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4df1b7ffb3d487ea7c361ac87825c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.769795 27467 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.784863 27467 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.789652 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:21.779503 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:21.765533 27475 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:21.796264 27467 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:21.798048 27405 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43efa5ed2d4349a1025bedcb71ff49 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:08:21.799731 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:21.801370 27380 leader_election.cc:343] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.803396 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:21.801326 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b64b3a0d3c44ff1893b67152ebe2c50. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:21.815405 27233 leader_election.cc:343] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.815735 27401 tablet_service.cc:1511] Processing CreateTablet for tablet 43ab3e6cd15341cd8cc43296cb7ce69d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:08:21.817004 27231 leader_election.cc:343] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.814271 27475 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.817471 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:21.818320 27467 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.818810 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:21.813768 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 92674.7us
I20260709 13:08:21.819538 27266 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:21.820631 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:21.822178 27403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e376a729bb7c47e99662f97b33ea32c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.828943 27464 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.829411 27464 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.829095 27252 tablet_service.cc:1511] Processing CreateTablet for tablet d4b61886e4de43d1a7459c0b2b639537 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:21.829838 27464 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.830531 27252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b61886e4de43d1a7459c0b2b639537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.831130 27405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43efa5ed2d4349a1025bedcb71ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.845060 27458 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:21.845000 27402 tablet_service.cc:1511] Processing CreateTablet for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:21.845656 27458 ts_tablet_manager.cc:1403] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.264s	user 0.005s	sys 0.031s
I20260709 13:08:21.846423 27402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b64b3a0d3c44ff1893b67152ebe2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.847549 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:21.838603 27464 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.847105 27164 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.856729 27459 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:21.857326 27459 ts_tablet_manager.cc:1403] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.000s
I20260709 13:08:21.863023 27401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ab3e6cd15341cd8cc43296cb7ce69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.864677 27459 raft_consensus.cc:359] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.866074 27459 raft_consensus.cc:385] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.870990 27458 raft_consensus.cc:359] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.880955 27459 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.884318 27459 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.882632 27458 raft_consensus.cc:385] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.886678 27458 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.887290 27400 tablet_service.cc:1511] Processing CreateTablet for tablet d4b61886e4de43d1a7459c0b2b639537 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:08:21.888572 27400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b61886e4de43d1a7459c0b2b639537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.887863 27458 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.890976 27458 ts_tablet_manager.cc:1434] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260709 13:08:21.894917 27457 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:21.895445 27457 ts_tablet_manager.cc:1403] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.198s	user 0.011s	sys 0.025s
I20260709 13:08:21.897688 27332 tablet_service.cc:1511] Processing CreateTablet for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:08:21.898298 27325 tablet_service.cc:1511] Processing CreateTablet for tablet 43ab3e6cd15341cd8cc43296cb7ce69d (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:08:21.899873 27308 leader_election.cc:343] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.900727 27328 tablet_service.cc:1511] Processing CreateTablet for tablet d4b61886e4de43d1a7459c0b2b639537 (DEFAULT_TABLE table=test-workload [id=b00ddfdf72e54540b59533ffe08799ad]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:08:21.901270 27308 leader_election.cc:343] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.904040 27457 raft_consensus.cc:359] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.904788 27457 raft_consensus.cc:385] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.905092 27457 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.905845 27457 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.907567 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:21.908133 27457 ts_tablet_manager.cc:1434] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:21.908180 27266 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.912515 27457 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:21.916432 27266 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:21.918115 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:21.925765 27458 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:21.924749 27475 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.926658 27475 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:21.926798 27328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b61886e4de43d1a7459c0b2b639537. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.927685 27475 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:21.930244 27325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ab3e6cd15341cd8cc43296cb7ce69d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.934208 27332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b64b3a0d3c44ff1893b67152ebe2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.943300 27457 tablet_bootstrap.cc:654] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.946789 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:21.944146 27165 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:21.951001 27380 leader_election.cc:343] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.952715 27459 ts_tablet_manager.cc:1434] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.091s	user 0.016s	sys 0.013s
I20260709 13:08:21.953748 27459 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:21.947602 27464 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:21.963693 27459 tablet_bootstrap.cc:654] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.972046 27458 tablet_bootstrap.cc:654] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.003094 27457 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.003803 27457 ts_tablet_manager.cc:1403] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.012s
I20260709 13:08:22.004401 27458 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.004976 27458 ts_tablet_manager.cc:1403] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.010s
I20260709 13:08:22.007282 27457 raft_consensus.cc:359] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.008222 27457 raft_consensus.cc:385] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.008627 27457 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.009632 27457 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.012280 27457 ts_tablet_manager.cc:1434] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:08:22.013792 27457 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.014077 27459 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.013200 27164 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.014631 27459 ts_tablet_manager.cc:1403] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.008s
I20260709 13:08:22.017731 27459 raft_consensus.cc:359] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.018471 27459 raft_consensus.cc:385] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.018806 27459 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.019642 27459 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.021811 27459 ts_tablet_manager.cc:1434] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:22.022421 27457 tablet_bootstrap.cc:654] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.022771 27459 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.025722 27475 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.008075 27458 raft_consensus.cc:359] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.026206 27458 raft_consensus.cc:385] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.026659 27458 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.026235 27475 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.029422 27459 tablet_bootstrap.cc:654] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.030359 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.030508 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:22.031929 27380 leader_election.cc:343] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.032498 27383 leader_election.cc:343] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.032598 27475 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.033125 27383 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.034495 27475 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.035537 27458 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.036804 27457 tablet_bootstrap.cc:492] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.037418 27457 ts_tablet_manager.cc:1403] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.012s
I20260709 13:08:22.040735 27457 raft_consensus.cc:359] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.041702 27457 raft_consensus.cc:385] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.042110 27457 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.043107 27457 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.045998 27457 ts_tablet_manager.cc:1434] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:08:22.047155 27457 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.057276 27457 tablet_bootstrap.cc:654] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.058566 27458 ts_tablet_manager.cc:1434] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.006s
I20260709 13:08:22.059828 27458 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.069000 27457 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.069434 27459 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.069530 27458 tablet_bootstrap.cc:654] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.069602 27457 ts_tablet_manager.cc:1403] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:08:22.069896 27459 ts_tablet_manager.cc:1403] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.022s
I20260709 13:08:22.072552 27457 raft_consensus.cc:359] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.072508 27459 raft_consensus.cc:359] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.073414 27457 raft_consensus.cc:385] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.073467 27459 raft_consensus.cc:385] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.073834 27457 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.073868 27459 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.074635 27457 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.074635 27459 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.076122 27458 tablet_bootstrap.cc:492] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.076623 27458 ts_tablet_manager.cc:1403] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:08:22.077010 27459 ts_tablet_manager.cc:1434] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:22.078356 27459 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.079793 27458 raft_consensus.cc:359] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.082093 27458 raft_consensus.cc:385] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.082458 27458 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.083262 27458 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.085333 27458 ts_tablet_manager.cc:1434] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:22.080641 27457 ts_tablet_manager.cc:1434] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:08:22.086437 27457 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.086500 27458 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.086944 27459 tablet_bootstrap.cc:654] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.093760 27458 tablet_bootstrap.cc:654] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.098618 27457 tablet_bootstrap.cc:654] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.107456 27459 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.107961 27459 ts_tablet_manager.cc:1403] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 13:08:22.111265 27458 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.111339 27457 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.110980 27459 raft_consensus.cc:359] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.112035 27459 raft_consensus.cc:385] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.112000 27457 ts_tablet_manager.cc:1403] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.003s
I20260709 13:08:22.112000 27458 ts_tablet_manager.cc:1403] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.005s
I20260709 13:08:22.112643 27459 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.113626 27459 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.115628 27458 raft_consensus.cc:359] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.116017 27459 ts_tablet_manager.cc:1434] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:08:22.116437 27458 raft_consensus.cc:385] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.116024 27457 raft_consensus.cc:359] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.116782 27458 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.116940 27457 raft_consensus.cc:385] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.117260 27457 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.117483 27459 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.117797 27458 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.118098 27457 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.122987 27457 ts_tablet_manager.cc:1434] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:22.122987 27458 ts_tablet_manager.cc:1434] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:22.124199 27458 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.124199 27457 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.124907 27459 tablet_bootstrap.cc:654] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.130987 27457 tablet_bootstrap.cc:654] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.131058 27458 tablet_bootstrap.cc:654] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.135222 27484 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.135949 27484 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.140232 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.140848 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.141141 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
W20260709 13:08:22.142519 27308 leader_election.cc:343] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.143288 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.144363 27466 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.144879 27466 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.145334 27466 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.149863 27467 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.144381 27484 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.150506 27467 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.154902 27467 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.155264 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.155501 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.156138 27342 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.158015 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:22.156242 27416 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.160837 27467 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.161340 27467 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.161954 27467 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.165982 27458 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.166735 27458 ts_tablet_manager.cc:1403] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.004s
I20260709 13:08:22.161203 27466 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.171384 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:22.172294 27266 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.188702 27457 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.188997 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.189234 27457 ts_tablet_manager.cc:1403] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.065s	user 0.032s	sys 0.020s
W20260709 13:08:22.190600 27308 leader_election.cc:343] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.191233 27466 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.191002 27467 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.192188 27457 raft_consensus.cc:359] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.192904 27457 raft_consensus.cc:385] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.193202 27457 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.194087 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:22.194022 27457 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.195443 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.191915 27458 raft_consensus.cc:359] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.196568 27458 raft_consensus.cc:385] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.197124 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:22.197356 27458 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.197952 27342 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.198649 27458 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.200377 27484 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.204250 27457 ts_tablet_manager.cc:1434] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:08:22.206663 27342 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:22.208850 27458 ts_tablet_manager.cc:1434] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.007s
I20260709 13:08:22.219906 27467 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.210299 27457 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.220734 27459 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.220883 27458 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.221961 27459 ts_tablet_manager.cc:1403] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.105s	user 0.048s	sys 0.049s
I20260709 13:08:22.222399 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:22.220664 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.223721 27416 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.214854 27484 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:22.225406 27484 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.225623 27459 raft_consensus.cc:359] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.226547 27459 raft_consensus.cc:385] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.226927 27459 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.227859 27459 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.228297 27475 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.230244 27459 ts_tablet_manager.cc:1434] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:22.231287 27459 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.231362 27457 tablet_bootstrap.cc:654] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.243271 27459 tablet_bootstrap.cc:654] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.239142 27467 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.248327 27467 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.252676 27416 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:22.254623 27484 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.255765 27510 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.264123 27166 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.273068 27484 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.273296 27467 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.273818 27484 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.274852 27464 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.275610 27464 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.277554 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.279273 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.282122 27464 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.284319 27510 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:22.284483 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.286851 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.286093 27484 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.297181 27459 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.297775 27459 ts_tablet_manager.cc:1403] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.067s	user 0.017s	sys 0.008s
I20260709 13:08:22.291314 27510 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.298978 27464 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.299510 27464 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.293395 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:22.291858 27233 leader_election.cc:343] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.301803 27231 leader_election.cc:343] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.288882 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.302793 27457 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.303319 27457 ts_tablet_manager.cc:1403] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.024s
W20260709 13:08:22.303606 27380 leader_election.cc:343] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:22.306802 27308 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:22.307700 27383 leader_election.cc:343] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.307547 27459 raft_consensus.cc:359] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.308313 27459 raft_consensus.cc:385] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.308668 27459 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.308195 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.310263 27464 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.310971 27458 tablet_bootstrap.cc:654] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.311830 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.316251 27459 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.318147 27491 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.318746 27459 ts_tablet_manager.cc:1434] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
W20260709 13:08:22.319415 27380 leader_election.cc:343] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.325306 27459 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.325152 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.327688 27467 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.331481 27517 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.332041 27517 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.390005 27484 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.390686 27484 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.393031 27467 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.487073 27457 raft_consensus.cc:359] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.488011 27457 raft_consensus.cc:385] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.359589 27517 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.393318 27484 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.498852 27459 tablet_bootstrap.cc:654] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.488408 27457 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
W20260709 13:08:22.457182 27490 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:22.503574 27457 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.482173 27475 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:08:22.480129 27511 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.451931 27516 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.488977 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 195514us
I20260709 13:08:22.450984 27343 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.443655 27467 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.504618 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.509632 27457 ts_tablet_manager.cc:1434] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.206s	user 0.024s	sys 0.011s
I20260709 13:08:22.508215 27511 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.511363 27342 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.512791 27511 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.510252 27516 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.513631 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.514406 27267 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:22.445317 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.517289 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:22.517639 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 135154us
I20260709 13:08:22.518198 27341 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.504405 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.519387 27516 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.520838 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.520526 27166 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.521481 27415 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:22.519253 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.522607 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.522955 27416 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.525975 27467 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.526747 27309 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:22.527570 27484 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.527961 27484 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.528826 27484 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.530094 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.534039 27233 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:22.539889 27457 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.544962 27475 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.547485 27516 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:22.536036 27233 leader_election.cc:343] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.550279 27516 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.555487 27516 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.547652 27511 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.560374 27457 tablet_bootstrap.cc:654] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.561923 27458 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.562320 27458 ts_tablet_manager.cc:1403] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.342s	user 0.019s	sys 0.012s
I20260709 13:08:22.557027 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.551120 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:22.568972 27383 leader_election.cc:343] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.577307 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.579603 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.580403 27475 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.580757 27517 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.581205 27517 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.552963 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.581564 27517 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.582147 27511 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.592247 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.584693 27484 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:22.594537 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:22.596027 27233 leader_election.cc:343] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.596732 27484 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.598007 27341 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:22.649871 27467 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.653784 27467 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.656481 27467 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.672574 27475 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.673309 27475 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.678050 27475 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.679378 27475 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:22.677914 27231 leader_election.cc:343] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.682739 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.684536 27458 raft_consensus.cc:359] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.685338 27458 raft_consensus.cc:385] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.685614 27458 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.685696 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:22.686381 27458 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.686340 27516 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.687340 27459 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.687809 27459 ts_tablet_manager.cc:1403] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.363s	user 0.011s	sys 0.026s
I20260709 13:08:22.687410 27467 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.690049 27267 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:22.691323 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.693125 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.693737 27417 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.693717 27459 raft_consensus.cc:359] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:22.694061 27233 leader_election.cc:343] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.694543 27459 raft_consensus.cc:385] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.694855 27459 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.695856 27459 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.684502 27517 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.698066 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.698333 27517 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.700626 27459 ts_tablet_manager.cc:1434] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 13:08:22.701593 27459 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.699151 27458 ts_tablet_manager.cc:1434] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.006s
I20260709 13:08:22.702978 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.706564 27417 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
W20260709 13:08:22.707858 27380 leader_election.cc:343] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.708009 27459 tablet_bootstrap.cc:654] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.709687 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:22.710278 27341 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:22.712786 27231 leader_election.cc:343] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.713800 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.714298 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.716053 27517 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.718766 27467 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.725660 27459 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.726135 27459 ts_tablet_manager.cc:1403] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:08:22.728012 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:22.728919 27340 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:22.728969 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.729460 27464 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.729966 27464 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.730834 27459 raft_consensus.cc:359] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.731532 27459 raft_consensus.cc:385] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.731777 27459 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.732415 27464 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.732343 27459 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.736896 27458 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
W20260709 13:08:22.739683 27383 leader_election.cc:343] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.744115 27458 tablet_bootstrap.cc:654] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.744228 27516 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.748615 27459 ts_tablet_manager.cc:1434] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:08:22.749678 27459 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.750780 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.751835 27457 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.741732 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.752308 27524 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.752437 27457 ts_tablet_manager.cc:1403] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.213s	user 0.017s	sys 0.003s
I20260709 13:08:22.752911 27524 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:22.744134 27383 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.753885 27524 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.755424 27475 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.756480 27457 raft_consensus.cc:359] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.757251 27457 raft_consensus.cc:385] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:22.757169 27233 leader_election.cc:343] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.757717 27457 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.758617 27457 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.760317 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:22.761848 27308 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.765686 27341 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:22.767297 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.768219 27457 ts_tablet_manager.cc:1434] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:22.768205 27516 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.768930 27516 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:22.769872 27516 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.770880 27383 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.776422 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.777590 27417 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:22.777944 27532 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.783409 27233 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.784602 27467 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.784818 27166 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.788626 27457 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.792094 27458 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.792600 27458 ts_tablet_manager.cc:1403] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.002s
I20260709 13:08:22.792611 27459 tablet_bootstrap.cc:654] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.801234 27457 tablet_bootstrap.cc:654] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.804864 27516 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:22.802839 27458 raft_consensus.cc:359] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.805781 27458 raft_consensus.cc:385] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.806128 27458 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.806849 27458 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.809190 27458 ts_tablet_manager.cc:1434] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:22.810303 27458 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.817616 27458 tablet_bootstrap.cc:654] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.819597 27524 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:22.819941 27457 tablet_bootstrap.cc:492] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.821267 27457 ts_tablet_manager.cc:1403] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 13:08:22.838410 27524 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.839299 27524 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.843981 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:22.845932 27309 leader_election.cc:343] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.846563 27459 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.847090 27459 ts_tablet_manager.cc:1403] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.009s
I20260709 13:08:22.847373 27524 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.848268 27414 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.853888 27459 raft_consensus.cc:359] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.855099 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.856850 27459 raft_consensus.cc:385] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.857163 27459 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
W20260709 13:08:22.857594 27308 leader_election.cc:343] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.858042 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:22.857963 27459 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.859181 27484 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.856025 27457 raft_consensus.cc:359] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.860204 27457 raft_consensus.cc:385] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.860492 27459 ts_tablet_manager.cc:1434] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:22.861588 27459 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.867424 27459 tablet_bootstrap.cc:654] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.869493 27166 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.860497 27457 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.876780 27457 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.878029 27516 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.878544 27516 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.880808 27457 ts_tablet_manager.cc:1434] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:08:22.880927 27516 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.882062 27457 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.882776 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.883580 27343 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.885491 27458 tablet_bootstrap.cc:492] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.886242 27458 ts_tablet_manager.cc:1403] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.012s
I20260709 13:08:22.887573 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:22.889756 27457 tablet_bootstrap.cc:654] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.891481 27513 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.891923 27513 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.892262 27513 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.895371 27516 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.890530 27458 raft_consensus.cc:359] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.896497 27458 raft_consensus.cc:385] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.896822 27458 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.897264 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.897586 27458 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.898123 27414 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.900535 27458 ts_tablet_manager.cc:1434] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:08:22.901475 27458 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.896032 27516 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.903959 27532 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.904516 27532 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.909192 27457 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.909444 27458 tablet_bootstrap.cc:654] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.909718 27457 ts_tablet_manager.cc:1403] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 13:08:22.910496 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.912592 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.912914 27457 raft_consensus.cc:359] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.913949 27457 raft_consensus.cc:385] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.914238 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:22.916144 27532 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.916771 27516 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.917034 27343 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:22.918963 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:22.919667 27414 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:22.914364 27457 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.921056 27513 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.921670 27457 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.922863 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:22.923744 27457 ts_tablet_manager.cc:1434] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:08:22.924584 27532 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.925209 27457 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.929864 27513 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:22.915953 27231 leader_election.cc:343] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:22.932837 27457 tablet_bootstrap.cc:654] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.933471 27458 tablet_bootstrap.cc:492] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.934041 27458 ts_tablet_manager.cc:1403] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.010s
I20260709 13:08:22.934190 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:22.934868 27343 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.937500 27458 raft_consensus.cc:359] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.938416 27458 raft_consensus.cc:385] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.938820 27458 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.939929 27458 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.942202 27458 ts_tablet_manager.cc:1434] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:08:22.933193 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:22.943563 27458 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:22.943739 27513 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.944260 27513 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.944528 27459 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:22.944612 27513 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.945078 27459 ts_tablet_manager.cc:1403] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.016s
I20260709 13:08:22.946089 27457 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.946529 27457 ts_tablet_manager.cc:1403] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:08:22.949256 27532 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:22.951601 27458 tablet_bootstrap.cc:654] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.951211 27459 raft_consensus.cc:359] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.951215 27457 raft_consensus.cc:359] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.952081 27459 raft_consensus.cc:385] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.952167 27457 raft_consensus.cc:385] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:22.952417 27459 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.952575 27457 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:22.952930 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.953594 27414 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.953253 27459 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.953305 27457 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.955823 27457 ts_tablet_manager.cc:1434] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:22.956825 27457 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:22.961261 27459 ts_tablet_manager.cc:1434] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:22.962280 27459 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:22.962951 27457 tablet_bootstrap.cc:654] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.966861 27532 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.966650 27513 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.967469 27532 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.969988 27532 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:22.970502 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:22.971258 27341 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.973116 27459 tablet_bootstrap.cc:654] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:22.974653 27458 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:22.943090 27343 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:22.975323 27458 ts_tablet_manager.cc:1403] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.007s
I20260709 13:08:22.976758 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:22.977733 27516 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:22.978255 27516 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:22.978626 27414 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:22.979450 27513 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.979142 27516 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.984395 27457 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:22.985271 27457 ts_tablet_manager.cc:1403] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 13:08:22.985565 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:22.986737 27266 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:22.987315 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:22.987912 27414 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.988111 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:22.988930 27532 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:22.989321 27532 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.989650 27532 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:22.993911 27513 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.994598 27513 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:22.997146 27513 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:22.998001 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:23.000617 27231 leader_election.cc:343] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.000077 27458 raft_consensus.cc:359] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.003641 27458 raft_consensus.cc:385] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.004241 27458 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.005205 27458 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.002683 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.008076 27532 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.009016 27457 raft_consensus.cc:359] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.009749 27457 raft_consensus.cc:385] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.010016 27457 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.011416 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.012091 27343 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.012384 27458 ts_tablet_manager.cc:1434] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:08:23.012755 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:23.013048 27416 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:23.013370 27266 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.013638 27458 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.014806 27233 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:23.015869 27513 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.015775 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.016310 27513 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.016475 27343 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.010746 27457 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.016914 27513 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.018923 27457 ts_tablet_manager.cc:1434] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:08:23.021014 27457 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.014623 27532 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.028594 27414 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.002715 27341 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.032014 27459 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.032575 27459 ts_tablet_manager.cc:1403] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.070s	user 0.026s	sys 0.016s
I20260709 13:08:23.033004 27458 tablet_bootstrap.cc:654] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.036787 27459 raft_consensus.cc:359] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.036350 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.037803 27459 raft_consensus.cc:385] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.038256 27459 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.038595 27510 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.039103 27510 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:23.039402 27459 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.040443 27457 tablet_bootstrap.cc:654] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.040170 27510 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.045334 27459 ts_tablet_manager.cc:1434] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:08:23.046512 27459 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.027674 27343 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:23.052289 27266 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:23.056602 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.059216 27532 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.060873 27532 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:23.061723 27532 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.041204 27513 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.067270 27513 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.067625 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.068293 27343 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.067416 27163 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.071724 27459 tablet_bootstrap.cc:654] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.087221 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:23.088795 27414 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.085357 27464 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.089694 27464 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.101785 27458 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:23.102663 27458 ts_tablet_manager.cc:1403] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.005s
I20260709 13:08:23.104619 27343 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.106617 27464 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.109138 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:23.111068 27383 leader_election.cc:343] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.112821 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.115290 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.116070 27343 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.116600 27458 raft_consensus.cc:359] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.117609 27510 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.117400 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:23.118566 27510 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:23.118914 27464 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.119599 27464 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.120028 27464 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.120100 27510 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.124219 27414 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.117403 27458 raft_consensus.cc:385] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.128404 27464 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.128612 27163 catalog_manager.cc:5697] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.133876 27458 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.134835 27458 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.138384 27458 ts_tablet_manager.cc:1434] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:08:23.138088 27164 catalog_manager.cc:5697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.139744 27458 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.140297 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.140894 27343 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.144079 27484 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.144750 27484 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.149720 27343 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:23.150128 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.150174 27464 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.152634 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:08:23.152889 27309 leader_election.cc:343] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.153622 27464 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.154193 27464 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:23.155277 27464 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.156956 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.158304 27484 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:23.158787 27308 leader_election.cc:343] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.159265 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:23.160621 27484 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.167008 27458 tablet_bootstrap.cc:654] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.168844 27556 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.170431 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:23.176940 27457 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.179543 27457 ts_tablet_manager.cc:1403] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.159s	user 0.030s	sys 0.015s
I20260709 13:08:23.169972 27556 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.185338 27459 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.185985 27459 ts_tablet_manager.cc:1403] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.140s	user 0.029s	sys 0.015s
I20260709 13:08:23.188558 27556 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:08:23.182421 27383 leader_election.cc:343] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.190737 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.191820 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.191795 27414 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.193908 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:23.194334 27459 raft_consensus.cc:359] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.195216 27459 raft_consensus.cc:385] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.195541 27459 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.200374 27459 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.205757 27459 ts_tablet_manager.cc:1434] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:08:23.207031 27459 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.206519 27457 raft_consensus.cc:359] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.214843 27457 raft_consensus.cc:385] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.215183 27457 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.218453 27458 tablet_bootstrap.cc:492] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:23.218914 27458 ts_tablet_manager.cc:1403] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.000s
I20260709 13:08:23.218132 27163 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.216641 27457 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.221865 27459 tablet_bootstrap.cc:654] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.222797 27457 ts_tablet_manager.cc:1434] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:08:23.222231 27166 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.226066 27457 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.227353 27458 raft_consensus.cc:359] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.228137 27458 raft_consensus.cc:385] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.231055 27458 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.231837 27458 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.238958 27457 tablet_bootstrap.cc:654] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.240890 27459 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.242755 27459 ts_tablet_manager.cc:1403] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.005s
I20260709 13:08:23.245223 27458 ts_tablet_manager.cc:1434] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:08:23.245196 27459 raft_consensus.cc:359] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.247045 27459 raft_consensus.cc:385] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.247300 27458 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.247380 27459 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.248449 27459 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.250887 27459 ts_tablet_manager.cc:1434] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:23.251281 27556 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.251915 27459 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.253325 27458 tablet_bootstrap.cc:654] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.258813 27459 tablet_bootstrap.cc:654] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.261301 27457 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.262228 27457 ts_tablet_manager.cc:1403] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.005s
I20260709 13:08:23.265409 27457 raft_consensus.cc:359] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.266117 27457 raft_consensus.cc:385] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.266399 27457 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.267227 27457 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.270840 27459 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.271466 27459 ts_tablet_manager.cc:1403] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:08:23.272328 27510 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.272802 27510 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.274103 27459 raft_consensus.cc:359] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.274803 27459 raft_consensus.cc:385] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.275040 27510 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.275086 27459 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.277359 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.277325 27459 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:23.279023 27233 leader_election.cc:343] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.279765 27459 ts_tablet_manager.cc:1434] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:23.280754 27459 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.281179 27458 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:23.281687 27458 ts_tablet_manager.cc:1403] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.013s
I20260709 13:08:23.282260 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.283731 27484 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.284268 27484 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.284874 27458 raft_consensus.cc:359] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.285629 27458 raft_consensus.cc:385] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.285936 27458 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.286288 27484 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.286579 27458 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:23.288029 27231 leader_election.cc:343] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.288484 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:23.290613 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.291303 27414 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:23.292176 27513 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.292719 27459 tablet_bootstrap.cc:654] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.291317 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.293530 27266 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:23.294222 27457 ts_tablet_manager.cc:1434] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:08:23.294706 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.295639 27484 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.295981 27484 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.296309 27484 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.298949 27458 ts_tablet_manager.cc:1434] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:08:23.299131 27510 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.299793 27457 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.300208 27458 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.306301 27484 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.310521 27524 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.312171 27459 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.312672 27459 ts_tablet_manager.cc:1403] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.005s
I20260709 13:08:23.312829 27510 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.313388 27510 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.315810 27459 raft_consensus.cc:359] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.316555 27459 raft_consensus.cc:385] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.316689 27484 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.316888 27459 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.317130 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.317529 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:23.317824 27417 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:23.317664 27459 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.318148 27266 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.319425 27457 tablet_bootstrap.cc:654] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.319265 27233 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.320112 27510 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.320708 27510 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.320880 27511 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.323897 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.325205 27459 ts_tablet_manager.cc:1434] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
W20260709 13:08:23.325824 27231 leader_election.cc:343] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.326301 27459 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.329262 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:23.329905 27417 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.321199 27510 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.332051 27510 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.333439 27459 tablet_bootstrap.cc:654] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.334219 27517 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.340037 27457 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.340626 27457 ts_tablet_manager.cc:1403] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.008s
I20260709 13:08:23.340277 27510 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.345077 27457 raft_consensus.cc:359] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.345983 27457 raft_consensus.cc:385] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.346318 27457 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.347123 27457 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.348030 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.349380 27457 ts_tablet_manager.cc:1434] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:23.350385 27457 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.351630 27266 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
W20260709 13:08:23.352607 27231 leader_election.cc:343] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.355309 27510 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.356760 27458 tablet_bootstrap.cc:654] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.356911 27417 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:23.357800 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:23.358457 27415 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.360917 27457 tablet_bootstrap.cc:654] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.366698 27415 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.358196 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.368000 27484 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.368474 27484 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:23.369289 27484 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.375026 27233 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:23.375890 27517 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.376348 27517 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:23.377141 27517 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.379634 27459 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.380124 27459 ts_tablet_manager.cc:1403] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.000s
I20260709 13:08:23.384025 27459 raft_consensus.cc:359] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.384747 27459 raft_consensus.cc:385] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.385032 27459 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.386986 27459 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.389117 27457 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.389590 27457 ts_tablet_manager.cc:1403] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.004s
I20260709 13:08:23.389605 27459 ts_tablet_manager.cc:1434] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:23.390877 27459 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.392127 27457 raft_consensus.cc:359] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.392794 27457 raft_consensus.cc:385] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.393056 27457 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.397025 27457 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.399411 27457 ts_tablet_manager.cc:1434] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:08:23.400313 27457 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.404211 27166 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.405710 27517 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.406234 27517 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.408412 27517 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.410743 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.411423 27343 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:23.411592 27457 tablet_bootstrap.cc:654] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.413604 27459 tablet_bootstrap.cc:654] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.415086 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.416054 27517 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.416395 27517 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.416713 27517 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.421303 27510 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.421859 27510 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.424178 27510 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.410735 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.425894 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.426121 27416 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
W20260709 13:08:23.427704 27233 leader_election.cc:343] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.429939 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.430284 27517 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:23.432216 27231 leader_election.cc:343] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.432672 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:23.433032 27556 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.433305 27464 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.433573 27556 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.433959 27464 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.435137 27516 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:23.436030 27556 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.436673 27464 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.438097 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.438702 27517 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.438824 27267 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.439587 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.440761 27266 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.441171 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.443470 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.444235 27459 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.443797 27166 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.444685 27459 ts_tablet_manager.cc:1403] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:08:23.444772 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.447203 27556 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.447604 27556 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.447985 27556 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.449929 27457 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.450368 27457 ts_tablet_manager.cc:1403] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.016s
I20260709 13:08:23.450845 27458 tablet_bootstrap.cc:492] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:23.451395 27458 ts_tablet_manager.cc:1403] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.017s
I20260709 13:08:23.452935 27457 raft_consensus.cc:359] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.453411 27457 raft_consensus.cc:385] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.453583 27457 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.454017 27457 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.455652 27457 ts_tablet_manager.cc:1434] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
W20260709 13:08:23.455881 27380 leader_election.cc:343] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.456728 27459 raft_consensus.cc:359] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.457399 27459 raft_consensus.cc:385] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.457291 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.457782 27459 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.458001 27343 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.456720 27464 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.458559 27459 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.460107 27464 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.460500 27464 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.461464 27459 ts_tablet_manager.cc:1434] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:08:23.459431 27457 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.459151 27458 raft_consensus.cc:359] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.461961 27458 raft_consensus.cc:385] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.462291 27458 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.463250 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.462992 27458 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.463768 27343 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.463966 27459 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.470342 27459 tablet_bootstrap.cc:654] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.472975 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:23.473627 27416 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.477401 27510 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.477924 27510 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.478602 27458 ts_tablet_manager.cc:1434] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:08:23.481464 27457 tablet_bootstrap.cc:654] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.482978 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.483685 27341 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:23.485059 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.485841 27517 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:23.486212 27517 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.486537 27517 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.493837 27517 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.454881 27556 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.495678 27510 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.496505 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.497143 27415 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:23.497701 27458 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.499877 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:23.500447 27266 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.501351 27517 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.503037 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.503629 27341 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.507428 27464 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.509181 27491 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.512562 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:23.513258 27267 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.513622 27517 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.515232 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:23.518400 27464 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.521294 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.522087 27340 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.523655 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:23.527920 27415 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:23.568118 27380 leader_election.cc:343] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:23.577199 27517 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.579910 27268 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:23.589092 27517 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:08:23.627990 27510 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:23.628558 27513 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.624590 27491 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.638000 27459 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:23.638537 27459 ts_tablet_manager.cc:1403] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.175s	user 0.070s	sys 0.069s
I20260709 13:08:23.639995 27458 tablet_bootstrap.cc:654] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.639602 27491 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.637866 27267 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:23.516729 27556 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.581847 27464 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.071s
I20260709 13:08:23.688544 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:23.696228 27585 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.699404 27459 raft_consensus.cc:359] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.700162 27459 raft_consensus.cc:385] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.700661 27459 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.701710 27459 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.700181 27585 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:23.708267 27459 ts_tablet_manager.cc:1434] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.002s
I20260709 13:08:23.707867 27585 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.709406 27457 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:23.709748 27457 ts_tablet_manager.cc:1403] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.251s	user 0.021s	sys 0.011s
I20260709 13:08:23.711577 27266 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:23.713059 27343 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.713527 27341 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.717348 27416 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.720238 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.722537 27459 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:23.721760 27457 raft_consensus.cc:359] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.724694 27457 raft_consensus.cc:385] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.725004 27457 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.725817 27464 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:23.709105 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:23.732156 27457 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.742375 27457 ts_tablet_manager.cc:1434] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 13:08:23.730538 27532 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.756913 27415 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:23.729607 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.761974 27457 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:23.771036 27517 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.771586 27517 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:23.772455 27517 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:23.773993 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 55225.9us
I20260709 13:08:23.785521 27510 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.778807 27491 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:23.798647 27457 tablet_bootstrap.cc:654] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.784426 27532 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:23.805995 27458 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:23.808816 27458 ts_tablet_manager.cc:1403] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.312s	user 0.044s	sys 0.094s
W20260709 13:08:23.809520 27586 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:23.816963 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:23.808200 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:23.824239 27459 tablet_bootstrap.cc:654] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:23.826961 27517 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:23.826913 27268 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:23.829452 27517 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:23.830302 27517 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.831342 27532 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.831684 27491 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:23.842587 27383 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:23.845847 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:23.847271 27163 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.853873 27513 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.860049 27458 raft_consensus.cc:359] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.860819 27458 raft_consensus.cc:385] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:23.861143 27458 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:23.862700 27458 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.862308 27491 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:23.876402 27380 leader_election.cc:343] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:23.872488 27581 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:08:23.859385 27513 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:23.870282 27517 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.889815 27458 ts_tablet_manager.cc:1434] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.001s
I20260709 13:08:23.905896 27532 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.036629 27484 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:08:24.001259 27524 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.015224 27590 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.067549 27590 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.068464 27457 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:24.068935 27457 ts_tablet_manager.cc:1403] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.307s	user 0.006s	sys 0.014s
I20260709 13:08:24.043577 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:23.961953 27516 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.070938 27516 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.072289 27457 raft_consensus.cc:359] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.072955 27457 raft_consensus.cc:385] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.047760 27532 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.073371 27457 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.043624 27458 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:23.875699 27491 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.056917 27517 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:24.064531 27593 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.206s	user 0.000s	sys 0.003s
I20260709 13:08:23.960958 27164 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.072996 27516 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:23.996052 27513 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:24.074023 27457 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.078605 27491 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.107792 27164 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:24.074530 27340 consensus_meta.cc:287] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.552s	user 0.013s	sys 0.004s
I20260709 13:08:24.122105 27590 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.145993 27532 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.147776 27340 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:24.074987 27524 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.167927 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:24.159139 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 117250us
W20260709 13:08:24.163264 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 165383us
I20260709 13:08:24.168799 27262 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:24.174746 27457 ts_tablet_manager.cc:1434] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.020s
I20260709 13:08:24.170394 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.181463 27459 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:24.181977 27459 ts_tablet_manager.cc:1403] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.460s	user 0.045s	sys 0.175s
I20260709 13:08:24.169226 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.184962 27457 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:24.175329 27601 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:08:24.207742 27266 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:24.229225 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:24.230623 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:24.232193 27590 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.232743 27590 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.233153 27590 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.232193 27459 raft_consensus.cc:359] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.260417 27459 raft_consensus.cc:385] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.260607 27458 tablet_bootstrap.cc:654] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.260911 27459 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.265004 27459 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.267720 27532 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.269369 27491 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:24.269943 27233 leader_election.cc:343] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.271523 27517 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:24.271584 27233 leader_election.cc:343] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.276068 27524 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:24.277196 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:24.278019 27414 raft_consensus.cc:2393] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:24.285772 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:24.289312 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 109617us
I20260709 13:08:24.289443 27459 ts_tablet_manager.cc:1434] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.002s
I20260709 13:08:24.290800 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.293031 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.381263 27491 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.405771 27590 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.408233 27457 tablet_bootstrap.cc:654] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.408253 27590 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.421451 27599 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.426568 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:24.427313 27268 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.427186 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:24.428038 27265 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.454676 27458 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.455416 27458 ts_tablet_manager.cc:1403] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.412s	user 0.046s	sys 0.035s
I20260709 13:08:24.459662 27588 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.459406 27458 raft_consensus.cc:359] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.459915 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.460271 27458 raft_consensus.cc:385] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.460765 27458 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.460213 27588 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.461594 27458 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.462136 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.462767 27588 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.466272 27339 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.466722 27458 ts_tablet_manager.cc:1434] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:08:24.468075 27458 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:24.434993 27268 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
W20260709 13:08:24.464769 27380 leader_election.cc:343] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:24.475512 27380 leader_election.cc:343] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.486476 27458 tablet_bootstrap.cc:654] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.490162 27588 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.490439 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.493587 27457 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:24.494078 27457 ts_tablet_manager.cc:1403] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.309s	user 0.014s	sys 0.021s
I20260709 13:08:24.494349 27458 tablet_bootstrap.cc:492] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.494850 27458 ts_tablet_manager.cc:1403] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:08:24.496767 27602 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.497752 27458 raft_consensus.cc:359] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.499451 27602 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.498515 27458 raft_consensus.cc:385] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.501466 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:24.503377 27459 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:24.504242 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.504916 27457 raft_consensus.cc:359] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.505638 27457 raft_consensus.cc:385] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.505908 27457 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.506489 27457 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:24.507763 27231 leader_election.cc:343] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.508587 27231 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:24.509865 27231 leader_election.cc:343] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.510519 27459 tablet_bootstrap.cc:654] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.501104 27458 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.510830 27608 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.516999 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:24.517882 27599 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.518868 27458 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.519748 27340 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.438764 27265 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:24.522883 27457 ts_tablet_manager.cc:1434] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:08:24.524569 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.524902 27457 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:24.525307 27263 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:24.529819 27340 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:24.522753 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:24.531512 27339 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.534406 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:24.534786 27458 ts_tablet_manager.cc:1434] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:08:24.535924 27458 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
W20260709 13:08:24.536868 27380 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:24.538300 27380 leader_election.cc:343] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.539153 27457 tablet_bootstrap.cc:654] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.543821 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:24.544710 27458 tablet_bootstrap.cc:654] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.545094 27588 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.545228 27459 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:24.545759 27588 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:24.545992 27459 ts_tablet_manager.cc:1403] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.008s
I20260709 13:08:24.546656 27588 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.551019 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:24.554824 27466 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.554908 27459 raft_consensus.cc:359] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.555830 27459 raft_consensus.cc:385] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.556288 27459 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.559640 27458 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.560153 27458 ts_tablet_manager.cc:1403] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 13:08:24.560698 27339 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:24.562879 27458 raft_consensus.cc:359] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.563644 27458 raft_consensus.cc:385] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.563936 27458 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.564906 27599 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:24.564745 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:24.564884 27458 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.569519 27491 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.570081 27491 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:24.571274 27458 ts_tablet_manager.cc:1434] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:24.570936 27491 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.572316 27458 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:24.571344 27166 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.579733 27458 tablet_bootstrap.cc:654] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.580951 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:24.557117 27459 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.560994 27457 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:24.584584 27457 ts_tablet_manager.cc:1403] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.004s
I20260709 13:08:24.587380 27602 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.589829 27602 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.592581 27602 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.591697 27457 raft_consensus.cc:359] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.595252 27457 raft_consensus.cc:385] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.596256 27457 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.599334 27532 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.599753 27532 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.600096 27532 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.603662 27459 ts_tablet_manager.cc:1434] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:08:24.604557 27524 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.605232 27459 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:24.605039 27524 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.608589 27532 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.609467 27524 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:24.610845 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:24.611591 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.614110 27532 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.614063 27263 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:24.615413 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:24.616096 27415 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
W20260709 13:08:24.616604 27380 leader_election.cc:343] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.617522 27309 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:24.618508 27484 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.618884 27484 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.619264 27484 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.598361 27457 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.625860 27457 ts_tablet_manager.cc:1434] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:08:24.625892 27484 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.633029 27457 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:24.634217 27484 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:24.627094 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46240.9us
I20260709 13:08:24.635341 27491 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:24.637005 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:24.637838 27413 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.640169 27458 tablet_bootstrap.cc:492] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.640668 27458 ts_tablet_manager.cc:1403] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.022s
I20260709 13:08:24.641181 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:24.641849 27263 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.631251 27459 tablet_bootstrap.cc:654] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.644217 27457 tablet_bootstrap.cc:654] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.645804 27458 raft_consensus.cc:359] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.646601 27458 raft_consensus.cc:385] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.646875 27458 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.647588 27458 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.653254 27458 ts_tablet_manager.cc:1434] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:24.654454 27458 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:24.658404 27383 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:24.663579 27263 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:24.667338 27309 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:24.684788 27484 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.691054 27484 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:24.695369 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:24.696234 27263 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.693549 27484 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.707093 27458 tablet_bootstrap.cc:654] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.736534 27603 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.737279 27603 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.741071 27603 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:24.761876 27413 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:24.778599 27491 raft_consensus.cc:2764] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:08:24.779071 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.781412 27263 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
W20260709 13:08:24.782585 27231 leader_election.cc:343] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.790439 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:24.810421 27163 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.813086 27163 catalog_manager.cc:5697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.826778 27458 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.827303 27458 ts_tablet_manager.cc:1403] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.010s
I20260709 13:08:24.828387 27459 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:24.828887 27459 ts_tablet_manager.cc:1403] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.224s	user 0.026s	sys 0.027s
I20260709 13:08:24.831436 27491 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.831928 27491 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.823062 27603 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.838043 27603 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.838778 27459 raft_consensus.cc:359] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.839473 27459 raft_consensus.cc:385] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.839749 27459 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.840276 27603 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:24.840747 27458 raft_consensus.cc:359] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.841406 27458 raft_consensus.cc:385] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.842239 27459 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.841794 27458 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.843861 27458 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.847456 27459 ts_tablet_manager.cc:1434] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:08:24.848491 27459 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:24.849368 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:24.842273 27457 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:24.850950 27457 ts_tablet_manager.cc:1403] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.218s	user 0.049s	sys 0.034s
I20260709 13:08:24.855136 27458 ts_tablet_manager.cc:1434] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:08:24.856545 27458 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:24.864229 27491 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.865626 27340 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:24.855763 27231 leader_election.cc:343] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.870357 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:24.872584 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:24.873576 27233 leader_election.cc:343] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.874035 27233 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:24.874707 27608 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.876693 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:24.877502 27588 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:24.878386 27588 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:08:24.879276 27380 leader_election.cc:343] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.889485 27457 raft_consensus.cc:359] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.890941 27457 raft_consensus.cc:385] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.879415 27588 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.891466 27457 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.891974 27164 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.894464 27457 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.901417 27457 ts_tablet_manager.cc:1434] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:08:24.904491 27458 tablet_bootstrap.cc:654] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.905931 27457 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:24.909583 27459 tablet_bootstrap.cc:654] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.909422 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.910226 27265 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:24.912977 27457 tablet_bootstrap.cc:654] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.916976 27459 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:24.917454 27459 ts_tablet_manager.cc:1403] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:08:24.920087 27459 raft_consensus.cc:359] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.920786 27459 raft_consensus.cc:385] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.923887 27459 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.924979 27585 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.924971 27459 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.925537 27585 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.928372 27585 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.928562 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:24.929800 27380 leader_election.cc:343] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.930928 27459 ts_tablet_manager.cc:1434] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:24.931875 27457 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:24.932011 27459 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:24.932348 27457 ts_tablet_manager.cc:1403] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:08:24.932958 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:24.933593 27413 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:24.935025 27457 raft_consensus.cc:359] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.935725 27457 raft_consensus.cc:385] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.935967 27457 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.936631 27457 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.938488 27459 tablet_bootstrap.cc:654] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.938666 27457 ts_tablet_manager.cc:1434] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:24.939301 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:24.940207 27233 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:24.941054 27457 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:24.940970 27608 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:24.941429 27608 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.941808 27608 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.941855 27383 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:24.951077 27585 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:24.951386 27383 leader_election.cc:343] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.951505 27585 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.951897 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:24.951951 27585 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:24.954324 27590 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.955003 27608 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.957873 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:24.958214 27608 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:24.959376 27231 leader_election.cc:343] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:24.959511 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:24.960188 27458 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:24.960697 27458 ts_tablet_manager.cc:1403] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.004s
I20260709 13:08:24.962697 27457 tablet_bootstrap.cc:654] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:24.963183 27588 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:24.976156 27458 raft_consensus.cc:359] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.977401 27458 raft_consensus.cc:385] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:24.977849 27458 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:24.978801 27458 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.986001 27458 ts_tablet_manager.cc:1434] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:08:24.975030 27585 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:24.987443 27413 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:24.992697 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:24.993563 27265 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:24.995765 27233 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:24.995980 27585 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:24.996950 27608 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:24.997761 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:24.999298 27585 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:25.002369 27380 leader_election.cc:343] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.002821 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:25.006078 27608 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.006752 27608 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.008798 27608 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.010118 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.009464 27164 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.013998 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.016010 27532 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.017835 27532 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:08:25.022763 27231 leader_election.cc:343] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.027329 27590 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:25.029465 27233 leader_election.cc:343] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.030124 27233 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.031121 27608 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.035028 27458 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.041292 27459 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.041780 27459 ts_tablet_manager.cc:1403] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.110s	user 0.048s	sys 0.017s
I20260709 13:08:25.055799 27459 raft_consensus.cc:359] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.054656 27457 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.056540 27459 raft_consensus.cc:385] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.056850 27459 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.057523 27459 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.056943 27457 ts_tablet_manager.cc:1403] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.116s	user 0.042s	sys 0.016s
I20260709 13:08:25.058833 27458 tablet_bootstrap.cc:654] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.059437 27459 ts_tablet_manager.cc:1434] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:08:25.060308 27459 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.066597 27457 raft_consensus.cc:359] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.068296 27457 raft_consensus.cc:385] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.069226 27457 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.071704 27457 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.068257 27484 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.074234 27484 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.075001 27457 ts_tablet_manager.cc:1434] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:08:25.075951 27457 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.076251 27484 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.083146 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.085000 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.085680 27262 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
W20260709 13:08:25.091920 27308 leader_election.cc:343] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.096300 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.099726 27484 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.100122 27484 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.100468 27484 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.101120 27459 tablet_bootstrap.cc:654] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.108115 27484 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.112432 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.113034 27262 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.120472 27457 tablet_bootstrap.cc:654] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.123111 27458 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.123605 27458 ts_tablet_manager.cc:1403] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.006s
I20260709 13:08:25.113718 27484 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.126822 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:08:25.130723 27308 leader_election.cc:343] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.134096 27458 raft_consensus.cc:359] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.135211 27458 raft_consensus.cc:385] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.135490 27458 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.147580 27457 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.147238 27458 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.148017 27457 ts_tablet_manager.cc:1403] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.002s
I20260709 13:08:25.149273 27458 ts_tablet_manager.cc:1434] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:08:25.149628 27459 tablet_bootstrap.cc:492] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.150111 27458 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.150135 27459 ts_tablet_manager.cc:1403] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.020s
I20260709 13:08:25.150607 27457 raft_consensus.cc:359] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.151321 27457 raft_consensus.cc:385] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.151583 27457 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.146075 27262 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:25.153072 27457 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.153565 27459 raft_consensus.cc:359] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.154230 27459 raft_consensus.cc:385] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.154472 27459 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.155115 27459 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.155596 27457 ts_tablet_manager.cc:1434] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:25.156494 27457 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.157349 27458 tablet_bootstrap.cc:654] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.158566 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.159783 27466 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.160266 27466 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:25.161058 27466 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.162833 27457 tablet_bootstrap.cc:654] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.169296 27459 ts_tablet_manager.cc:1434] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:08:25.169858 27458 tablet_bootstrap.cc:492] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.170250 27459 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.170483 27458 ts_tablet_manager.cc:1403] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:08:25.174430 27458 raft_consensus.cc:359] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.175575 27458 raft_consensus.cc:385] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.175961 27458 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.176828 27458 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.181773 27458 ts_tablet_manager.cc:1434] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 13:08:25.183391 27458 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.185550 27457 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.186085 27457 ts_tablet_manager.cc:1403] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.020s
I20260709 13:08:25.187767 27163 catalog_manager.cc:5697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.188913 27457 raft_consensus.cc:359] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.189626 27457 raft_consensus.cc:385] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.189724 27459 tablet_bootstrap.cc:654] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.189947 27457 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.190703 27457 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.196539 27458 tablet_bootstrap.cc:654] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.197671 27457 ts_tablet_manager.cc:1434] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:08:25.199059 27457 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.203987 27459 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.204571 27459 ts_tablet_manager.cc:1403] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.005s
I20260709 13:08:25.207335 27459 raft_consensus.cc:359] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.208222 27459 raft_consensus.cc:385] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.208411 27457 tablet_bootstrap.cc:654] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.208606 27459 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.209472 27459 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.212261 27459 ts_tablet_manager.cc:1434] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:25.213500 27459 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.214046 27458 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.214581 27458 ts_tablet_manager.cc:1403] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.009s
I20260709 13:08:25.217145 27458 raft_consensus.cc:359] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.217868 27458 raft_consensus.cc:385] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.218200 27458 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.218899 27458 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.219496 27457 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.219596 27459 tablet_bootstrap.cc:654] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.221391 27458 ts_tablet_manager.cc:1434] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:25.222925 27458 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.223778 27457 ts_tablet_manager.cc:1403] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:08:25.227475 27457 raft_consensus.cc:359] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.228387 27457 raft_consensus.cc:385] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.228711 27457 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.229655 27457 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.232518 27457 ts_tablet_manager.cc:1434] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:08:25.233150 27599 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.233631 27457 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.233629 27599 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.236629 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:25.238261 27231 leader_election.cc:343] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.239908 27457 tablet_bootstrap.cc:654] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.241192 27517 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.241674 27517 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.245616 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.246248 27342 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.245782 27517 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.247442 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:25.242198 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.251812 27415 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.249728 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.253285 27413 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.254132 27608 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.254547 27608 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.254863 27608 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.256366 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:25.257625 27602 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.257972 27602 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.258299 27602 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.260759 27466 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.239821 27599 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.268337 27608 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.274243 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.274339 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:25.274838 27415 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.275115 27342 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.281746 27415 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.256645 27457 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.282557 27457 ts_tablet_manager.cc:1403] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 13:08:25.285648 27457 raft_consensus.cc:359] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.271471 27458 tablet_bootstrap.cc:654] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.289769 27457 raft_consensus.cc:385] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.290416 27457 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.286377 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.287295 27588 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.292061 27457 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.289189 27608 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.294628 27517 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.301980 27517 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:25.302940 27517 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.269078 27602 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.309923 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:25.311374 27231 leader_election.cc:343] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.312263 27602 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.316676 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.317303 27417 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.292577 27342 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.295126 27457 ts_tablet_manager.cc:1434] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 13:08:25.321364 27457 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.300176 27459 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.327479 27459 ts_tablet_manager.cc:1403] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.114s	user 0.034s	sys 0.030s
I20260709 13:08:25.328953 27340 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.330097 27459 raft_consensus.cc:359] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.330793 27459 raft_consensus.cc:385] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.331063 27459 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.332217 27459 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.334584 27459 ts_tablet_manager.cc:1434] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:25.335474 27459 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.336975 27417 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.338366 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:25.327035 27457 tablet_bootstrap.cc:654] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.343430 27603 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.344069 27603 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:25.344954 27459 tablet_bootstrap.cc:654] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.345158 27603 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.344995 27484 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:25.350466 27464 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.351022 27464 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.354386 27464 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.355919 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.357755 27459 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.358197 27459 ts_tablet_manager.cc:1403] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.006s
I20260709 13:08:25.360663 27458 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.363106 27458 ts_tablet_manager.cc:1403] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.026s
I20260709 13:08:25.363683 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.363874 27459 raft_consensus.cc:359] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.364570 27459 raft_consensus.cc:385] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.364881 27459 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.364490 27262 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:25.365536 27163 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.369089 27459 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.370568 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:25.376801 27459 ts_tablet_manager.cc:1434] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:08:25.378013 27459 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.379617 27464 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.384171 27532 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.402915 27484 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.403571 27484 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.404950 27457 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.405418 27457 ts_tablet_manager.cc:1403] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.008s
I20260709 13:08:25.405864 27484 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.407058 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.409025 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.408928 27458 raft_consensus.cc:359] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.409663 27458 raft_consensus.cc:385] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.409963 27458 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.410689 27309 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.410689 27458 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.412515 27466 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.413120 27458 ts_tablet_manager.cc:1434] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 13:08:25.412952 27466 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.413998 27458 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.415035 27466 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.417212 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.417976 27262 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:25.420490 27458 tablet_bootstrap.cc:654] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.422264 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.424481 27457 raft_consensus.cc:359] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.425160 27457 raft_consensus.cc:385] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.424991 27484 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:25.425491 27457 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.426129 27457 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.423106 27415 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:25.428411 27457 ts_tablet_manager.cc:1434] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:08:25.429042 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.431296 27524 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.432547 27164 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.442842 27524 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.445181 27532 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.451942 27459 tablet_bootstrap.cc:654] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.457296 27457 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.465020 27457 tablet_bootstrap.cc:654] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.469389 27603 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.469594 27458 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.470191 27458 ts_tablet_manager.cc:1403] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.025s
I20260709 13:08:25.469945 27603 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.470475 27457 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.470784 27459 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.470913 27457 ts_tablet_manager.cc:1403] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.002s
I20260709 13:08:25.471491 27459 ts_tablet_manager.cc:1403] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.005s
I20260709 13:08:25.473766 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.473573 27458 raft_consensus.cc:359] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.473930 27459 raft_consensus.cc:359] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.474428 27603 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.474246 27457 raft_consensus.cc:359] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.474277 27458 raft_consensus.cc:385] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.474985 27457 raft_consensus.cc:385] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.475126 27459 raft_consensus.cc:385] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.475258 27458 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.475353 27457 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.475466 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.475803 27459 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.476217 27458 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.476444 27457 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.476639 27459 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.477706 27415 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.479267 27459 ts_tablet_manager.cc:1434] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:08:25.480054 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.480820 27458 ts_tablet_manager.cc:1434] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:25.481572 27459 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.481701 27458 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.482606 27660 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.482973 27660 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.483319 27660 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.487986 27459 tablet_bootstrap.cc:654] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.488111 27458 tablet_bootstrap.cc:654] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.492847 27524 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.493361 27524 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.495347 27340 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.496723 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.496986 27524 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.498284 27464 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.498337 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.499118 27415 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:25.499025 27464 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.500427 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.501686 27464 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.502393 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.503046 27262 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:25.504304 27458 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.504739 27458 ts_tablet_manager.cc:1403] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:08:25.505049 27603 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.505668 27603 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.508227 27603 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.507150 27458 raft_consensus.cc:359] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.509024 27458 raft_consensus.cc:385] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.509308 27458 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.509231 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.511833 27459 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.512533 27524 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.510051 27458 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.510001 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.512804 27459 ts_tablet_manager.cc:1403] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.009s
I20260709 13:08:25.512914 27524 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.517336 27524 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.517016 27660 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.517397 27459 raft_consensus.cc:359] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.518224 27459 raft_consensus.cc:385] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.518366 27265 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:25.518548 27459 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.519357 27459 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.521438 27459 ts_tablet_manager.cc:1434] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:08:25.521576 27660 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.522855 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:25.514271 27233 leader_election.cc:343] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.513607 27585 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.523592 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.523880 27585 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.514408 27458 ts_tablet_manager.cc:1434] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:25.524266 27585 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.524825 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.525372 27415 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.525580 27458 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
W20260709 13:08:25.525846 27380 leader_election.cc:343] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.525388 27231 leader_election.cc:343] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.527638 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.530817 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:25.532948 27458 tablet_bootstrap.cc:654] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.533566 27415 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.533277 27459 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.534690 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.535514 27603 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.536123 27603 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.536577 27603 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:25.537415 27603 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.542656 27459 tablet_bootstrap.cc:654] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.542706 27585 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.542165 27524 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.544334 27340 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:25.545855 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.546495 27265 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.551034 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.551553 27532 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.552026 27532 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.553259 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.554019 27415 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:25.554710 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.555367 27262 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:25.555490 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.556263 27466 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.556947 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.557466 27524 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.558255 27532 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.558867 27464 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.559382 27464 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.559780 27464 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.566288 27585 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.567968 27265 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:25.569192 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.570070 27585 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.570837 27585 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:25.571987 27585 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.576855 27457 ts_tablet_manager.cc:1434] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 13:08:25.578105 27457 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.578605 27660 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.579401 27660 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.581182 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.581682 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:25.584084 27380 leader_election.cc:343] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:25.585245 27380 leader_election.cc:343] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.586963 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.587631 27340 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.586872 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.588677 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:25.589964 27603 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.590552 27603 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.591063 27603 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.593616 27464 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.588284 27415 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.596906 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.599486 27265 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.605258 27265 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:25.607544 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.603791 27660 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.607096 27165 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.609730 27163 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.598908 27603 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.617915 27458 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.625769 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:25.614817 27459 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.640960 27459 ts_tablet_manager.cc:1403] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.110s	user 0.023s	sys 0.023s
W20260709 13:08:25.641134 27380 leader_election.cc:343] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.623723 27457 tablet_bootstrap.cc:654] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.642472 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:25.643081 27342 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.643687 27459 raft_consensus.cc:359] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.644348 27459 raft_consensus.cc:385] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.644618 27459 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.640427 27458 ts_tablet_manager.cc:1403] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.039s
I20260709 13:08:25.611100 27585 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.647848 27458 raft_consensus.cc:359] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.648097 27585 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:25.649060 27585 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.649870 27342 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.650583 27603 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.651786 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:25.652199 27459 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.652786 27660 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.653270 27660 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:25.654529 27459 ts_tablet_manager.cc:1434] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:08:25.654091 27660 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.655326 27458 raft_consensus.cc:385] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.655630 27458 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.656248 27458 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.657258 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.658114 27415 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.658281 27459 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.665558 27458 ts_tablet_manager.cc:1434] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:08:25.666604 27458 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.630829 27464 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.674297 27457 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.674837 27457 ts_tablet_manager.cc:1403] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.003s
I20260709 13:08:25.676316 27459 tablet_bootstrap.cc:654] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.682802 27458 tablet_bootstrap.cc:654] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.682982 27457 raft_consensus.cc:359] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.683780 27457 raft_consensus.cc:385] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.684151 27457 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.684809 27457 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.685530 27602 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.686023 27602 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.689640 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:25.691486 27231 leader_election.cc:343] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.692711 27602 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.682447 27166 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.693084 27457 ts_tablet_manager.cc:1434] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:08:25.694168 27457 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.696849 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.697687 27459 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.698118 27459 ts_tablet_manager.cc:1403] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:08:25.698318 27524 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:25.698592 27233 leader_election.cc:343] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.699064 27233 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.699801 27602 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:25.669272 27415 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:25.706225 27459 raft_consensus.cc:359] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.706905 27459 raft_consensus.cc:385] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.713898 27458 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.714366 27458 ts_tablet_manager.cc:1403] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:08:25.714520 27457 tablet_bootstrap.cc:654] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.717165 27458 raft_consensus.cc:359] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.717870 27458 raft_consensus.cc:385] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.718142 27458 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.717435 27163 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.718787 27459 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.719514 27458 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.720700 27459 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.723112 27459 ts_tablet_manager.cc:1434] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:08:25.724040 27458 ts_tablet_manager.cc:1434] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:25.724088 27459 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.724485 27466 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:25.724948 27458 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.739949 27585 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.740633 27585 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.747063 27458 tablet_bootstrap.cc:654] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.748733 27459 tablet_bootstrap.cc:654] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.754508 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.755540 27262 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:25.760171 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.757441 27585 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.772423 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.773120 27342 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:25.767505 27491 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.776914 27491 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.777956 27491 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.779906 27231 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.781201 27457 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:25.781629 27457 ts_tablet_manager.cc:1403] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.021s
I20260709 13:08:25.805948 27603 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.815770 27459 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.816313 27459 ts_tablet_manager.cc:1403] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.024s
I20260709 13:08:25.816745 27457 raft_consensus.cc:359] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.819723 27457 raft_consensus.cc:385] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.820063 27457 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.820796 27457 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.824615 27457 ts_tablet_manager.cc:1434] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:08:25.825384 27457 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:25.826169 27458 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.826686 27458 ts_tablet_manager.cc:1403] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.015s
I20260709 13:08:25.833874 27458 raft_consensus.cc:359] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.834570 27458 raft_consensus.cc:385] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.834833 27458 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.837153 27458 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.840849 27585 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.840644 27491 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.841406 27585 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.842875 27491 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.843668 27585 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.844925 27459 raft_consensus.cc:359] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.845505 27459 raft_consensus.cc:385] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.845750 27459 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.846356 27458 ts_tablet_manager.cc:1434] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:08:25.847414 27458 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:25.847288 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.849378 27459 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.850785 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.852540 27265 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.848012 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:25.859349 27459 ts_tablet_manager.cc:1434] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 13:08:25.860451 27459 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.857828 27599 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:25.868806 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.868918 27603 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:25.869253 27660 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.871480 27660 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.873684 27660 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.874259 27464 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.874688 27464 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.875028 27464 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.883810 27459 tablet_bootstrap.cc:654] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.890509 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.891232 27417 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.898290 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:25.898978 27341 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.900576 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.901571 27599 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.902221 27599 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.901561 27342 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.906314 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.907449 27603 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.907882 27603 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.908067 27660 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.908254 27603 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.908588 27660 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.910645 27341 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:25.912303 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.914703 27660 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.915845 27599 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.916100 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.917425 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.919112 27458 tablet_bootstrap.cc:654] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.918457 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.920725 27524 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.918174 27464 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.925529 27524 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:25.922428 27233 leader_election.cc:343] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.919543 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:25.919613 27457 tablet_bootstrap.cc:654] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:25.928686 27524 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:25.932372 27265 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:25.921034 27417 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:25.936364 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:25.937110 27412 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:25.942554 27458 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:25.919026 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.943627 27458 ts_tablet_manager.cc:1403] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.096s	user 0.013s	sys 0.003s
I20260709 13:08:25.921355 27603 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.942893 27308 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.947932 27491 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:25.941761 27464 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:25.947966 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:25.951692 27524 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.936359 27233 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:25.952107 27524 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.952544 27524 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.955406 27599 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:25.955952 27599 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.957084 27599 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:25.957545 27491 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:25.959218 27491 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:25.964854 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45909.2us
W20260709 13:08:25.968107 27231 leader_election.cc:343] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.948777 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:25.972231 27265 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:25.974754 27231 leader_election.cc:343] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.980129 27458 raft_consensus.cc:359] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.980954 27458 raft_consensus.cc:385] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.981243 27458 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.981437 27231 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:25.982707 27602 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:25.974243 27309 leader_election.cc:343] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:25.983907 27459 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:25.984421 27459 ts_tablet_manager.cc:1403] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.006s
I20260709 13:08:25.986658 27458 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.989563 27459 raft_consensus.cc:359] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.990285 27459 raft_consensus.cc:385] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:25.990574 27459 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:25.991492 27459 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:25.995594 27459 ts_tablet_manager.cc:1434] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:08:25.996587 27459 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:25.999899 27458 ts_tablet_manager.cc:1434] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:08:26.000963 27458 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:26.001142 27457 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:26.001590 27457 ts_tablet_manager.cc:1403] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.006s
I20260709 13:08:26.007778 27599 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.008455 27457 raft_consensus.cc:359] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.009207 27457 raft_consensus.cc:385] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.009506 27457 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.012063 27457 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.016331 27457 ts_tablet_manager.cc:1434] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:08:26.017505 27457 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:26.020154 27603 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:26.025765 27380 leader_election.cc:343] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.025552 27585 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.027616 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:25.999886 27524 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.028256 27415 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.036906 27599 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.040016 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:26.040462 27466 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.040858 27417 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.041144 27466 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.040362 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:26.046315 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.048260 27466 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.049774 27417 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:26.052947 27415 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:26.055615 27233 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:26.056110 27524 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.056218 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:26.056743 27599 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.056977 27413 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.057824 27599 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:26.058997 27599 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.061391 27265 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:26.061864 27166 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.063441 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:08:26.068392 27380 leader_election.cc:343] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.068635 27608 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.069404 27608 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:26.074090 27457 tablet_bootstrap.cc:654] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.074761 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:26.077050 27458 tablet_bootstrap.cc:654] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.077833 27459 tablet_bootstrap.cc:654] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.070847 27413 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:26.070612 27608 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.080354 27308 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:26.082700 27524 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.083359 27524 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:26.084247 27524 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.092832 27466 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.093456 27466 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.096215 27466 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.099797 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.100931 27413 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:26.102612 27308 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:26.102687 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.105001 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:26.108419 27266 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:26.117575 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:26.118374 27342 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.121814 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:26.110059 27585 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.124966 27466 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.128096 27466 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.138273 27466 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.151120 27457 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:26.151676 27457 ts_tablet_manager.cc:1403] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.011s
I20260709 13:08:26.153205 27585 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:26.157864 27585 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.161942 27458 tablet_bootstrap.cc:492] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:26.162544 27458 ts_tablet_manager.cc:1403] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.018s
I20260709 13:08:26.162146 27466 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:26.201277 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:08:26.203286 27309 leader_election.cc:343] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:26.205415 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60869.1us
I20260709 13:08:26.157940 27457 raft_consensus.cc:359] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.221048 27457 raft_consensus.cc:385] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.221657 27457 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.229128 27459 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:26.222921 27457 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.230293 27459 ts_tablet_manager.cc:1403] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.012s
I20260709 13:08:26.242637 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.221686 27166 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.258190 27457 ts_tablet_manager.cc:1434] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.008s
I20260709 13:08:26.260344 27457 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:26.270260 27466 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:26.290774 27380 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.294337 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:26.295270 27413 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.286592 27165 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.300489 27532 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:26.300988 27231 leader_election.cc:343] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.302790 27608 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.304323 27413 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:26.295074 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.308884 27599 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.311908 27458 raft_consensus.cc:359] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.320430 27458 raft_consensus.cc:385] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:26.315865 27309 leader_election.cc:343] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.318573 27459 raft_consensus.cc:359] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.321177 27459 raft_consensus.cc:385] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.321329 27708 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.321672 27308 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:26.286914 27342 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:26.322372 27459 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.323794 27484 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.323799 27459 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.320773 27458 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.327677 27708 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.329785 27457 tablet_bootstrap.cc:654] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.331493 27524 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.333195 27165 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.335331 27708 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.335477 27524 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:26.350178 27459 ts_tablet_manager.cc:1434] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 13:08:26.350610 27707 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.353430 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.335485 27458 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:26.358202 27308 leader_election.cc:343] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.364782 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:26.366125 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.342943 27524 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:26.378202 27309 leader_election.cc:343] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.380407 27459 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:26.385941 27458 ts_tablet_manager.cc:1434] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.223s	user 0.013s	sys 0.000s
W20260709 13:08:26.387091 27309 leader_election.cc:343] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.389772 27309 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.390429 27466 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.391518 27660 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.401866 27458 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:26.402729 27166 catalog_manager.cc:5697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.433744 27165 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.464167 27585 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.464859 27585 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.472434 27585 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:26.474237 27484 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.487996 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:26.489179 27457 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:26.489693 27457 ts_tablet_manager.cc:1403] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.009s
W20260709 13:08:26.490617 27380 leader_election.cc:343] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.499734 27459 tablet_bootstrap.cc:654] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.504797 27457 raft_consensus.cc:359] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.506212 27457 raft_consensus.cc:385] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.506501 27457 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.507269 27602 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.508139 27458 tablet_bootstrap.cc:654] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.507858 27602 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.511473 27457 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.513471 27585 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:26.512863 27602 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.520341 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.521129 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:26.521450 27457 ts_tablet_manager.cc:1434] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:08:26.522675 27457 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:26.524572 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:26.526081 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:26.527284 27491 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.527650 27491 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.527985 27491 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.528558 27231 leader_election.cc:343] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.547067 27457 tablet_bootstrap.cc:654] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.542146 27459 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:26.545001 27707 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:08:26.552959 27459 ts_tablet_manager.cc:1403] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.011s
I20260709 13:08:26.545456 27458 tablet_bootstrap.cc:492] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:26.554037 27458 ts_tablet_manager.cc:1403] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.165s	user 0.013s	sys 0.022s
I20260709 13:08:26.558737 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.538308 27585 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:08:26.562721 27458 raft_consensus.cc:359] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.571621 27458 raft_consensus.cc:385] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.571919 27458 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.572734 27458 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.575048 27484 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.575570 27484 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.577039 27458 ts_tablet_manager.cc:1434] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:08:26.577184 27719 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.578541 27458 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
W20260709 13:08:26.580325 27233 leader_election.cc:343] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.580736 27233 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.580849 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.581502 27707 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.536827 27491 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.577683 27484 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.591228 27459 raft_consensus.cc:359] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.583894 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.593564 27459 raft_consensus.cc:385] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:26.591958 27231 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.594054 27459 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.621130 27491 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:26.602888 27719 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:08:26.591045 27458 tablet_bootstrap.cc:654] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.608259 27707 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.602152 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:26.623399 27265 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.599891 27308 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.599116 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:26.624924 27459 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.628404 27459 ts_tablet_manager.cc:1434] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.007s
I20260709 13:08:26.630038 27710 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.623311 27707 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:26.633134 27380 leader_election.cc:343] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:26.635654 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:26.635735 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.639866 27415 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:26.644941 27585 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.638701 27707 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.648247 27459 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:26.648667 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.641474 27491 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:08:26.652518 27707 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.675386 27464 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.676169 27464 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.692271 27457 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:26.692955 27457 ts_tablet_manager.cc:1403] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.009s
I20260709 13:08:26.695866 27458 tablet_bootstrap.cc:492] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:26.696550 27458 ts_tablet_manager.cc:1403] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.015s
I20260709 13:08:26.698931 27342 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.700222 27457 raft_consensus.cc:359] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.701972 27457 raft_consensus.cc:385] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.702325 27457 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.703065 27457 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.709031 27457 ts_tablet_manager.cc:1434] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:08:26.706272 27458 raft_consensus.cc:359] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.713608 27458 raft_consensus.cc:385] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:26.714048 27458 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:26.718442 27710 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:26.722348 27464 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:26.722193 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:26.726557 27458 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.732049 27265 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:26.737283 27457 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:26.785945 27599 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.786859 27599 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.772688 27730 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:08:26.793038 27459 tablet_bootstrap.cc:654] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.797854 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:26.796631 27339 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:26.791040 27707 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.792944 27342 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:26.795745 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58775.8us
I20260709 13:08:26.806452 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:26.819294 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:26.819883 27599 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:26.823472 27264 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:26.827319 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:26.831652 27413 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:26.829310 27532 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:26.832527 27532 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:26.833397 27532 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.839543 27233 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:26.842139 27602 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.842170 27710 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:26.864972 27602 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:26.883989 27458 ts_tablet_manager.cc:1434] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.187s	user 0.020s	sys 0.025s
I20260709 13:08:26.878309 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:26.887787 27464 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:26.888168 27464 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.888528 27464 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.902282 27458 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:26.906400 27464 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:26.913411 27464 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:26.913450 27459 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:26.915560 27459 ts_tablet_manager.cc:1403] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.285s	user 0.019s	sys 0.001s
I20260709 13:08:26.916720 27457 tablet_bootstrap.cc:654] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:26.955746 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:26.956614 27337 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:26.962116 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:26.962735 27268 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.015709 27459 raft_consensus.cc:359] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.017520 27459 raft_consensus.cc:385] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.017966 27459 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.028092 27459 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.033517 27458 tablet_bootstrap.cc:654] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.017767 27484 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:08:27.045989 27459 ts_tablet_manager.cc:1434] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.130s	user 0.011s	sys 0.004s
I20260709 13:08:27.061168 27459 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.073496 27268 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:27.077615 27337 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:27.079718 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.079290 27164 catalog_manager.cc:5697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.080578 27532 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.081061 27532 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:27.081845 27532 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:27.065891 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44426.3us
W20260709 13:08:27.089866 27741 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:08:27.096624 27743 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.098711 27457 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.099589 27457 ts_tablet_manager.cc:1403] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.368s	user 0.043s	sys 0.043s
I20260709 13:08:27.103971 27457 raft_consensus.cc:359] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.104719 27457 raft_consensus.cc:385] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.106036 27457 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.106765 27457 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.123828 27459 tablet_bootstrap.cc:654] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.130446 27457 ts_tablet_manager.cc:1434] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:08:27.131749 27457 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.144556 27457 tablet_bootstrap.cc:654] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.146251 27458 tablet_bootstrap.cc:492] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.146760 27458 ts_tablet_manager.cc:1403] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.245s	user 0.011s	sys 0.026s
I20260709 13:08:27.150043 27458 raft_consensus.cc:359] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.153355 27458 raft_consensus.cc:385] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.153649 27458 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.155922 27458 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.159078 27458 ts_tablet_manager.cc:1434] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:08:27.160048 27458 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.171763 27743 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.172513 27743 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.179634 27735 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.194847 27602 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.180188 27735 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.195668 27602 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.212885 27602 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.217737 27458 tablet_bootstrap.cc:654] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.219339 27466 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.232880 27466 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.250355 27466 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.252034 27735 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:27.254567 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.262739 27413 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:27.263543 27704 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.256356 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.264075 27704 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.264798 27342 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.256307 27743 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.260250 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.260596 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.265818 27265 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:27.265818 27341 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:27.266825 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.267645 27704 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:27.267695 27417 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.269069 27231 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:27.269479 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.275971 27602 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.276583 27602 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.271097 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.277051 27602 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.278111 27466 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.278559 27466 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.278728 27457 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.279042 27466 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.279240 27457 ts_tablet_manager.cc:1403] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.005s
I20260709 13:08:27.270893 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.271844 27608 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.283600 27608 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.285363 27458 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.285898 27458 ts_tablet_manager.cc:1403] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.126s	user 0.009s	sys 0.003s
I20260709 13:08:27.272917 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.273389 27459 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.271831 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.286846 27459 ts_tablet_manager.cc:1403] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.012s
I20260709 13:08:27.287025 27268 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:27.287415 27608 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.288318 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.288686 27704 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:27.288978 27341 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:27.289057 27704 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.289826 27704 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:27.290982 27459 raft_consensus.cc:359] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.291749 27459 raft_consensus.cc:385] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.292085 27459 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.292845 27459 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.294974 27459 ts_tablet_manager.cc:1434] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:27.296519 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.297262 27459 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.299100 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:08:27.299472 27380 leader_election.cc:343] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.300403 27608 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.295660 27466 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.300899 27608 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.301384 27608 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.302819 27704 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.303340 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:27.304858 27704 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:27.306051 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.306881 27341 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:27.307679 27458 raft_consensus.cc:359] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.308362 27458 raft_consensus.cc:385] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.308621 27458 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.309536 27466 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.309278 27458 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.282627 27457 raft_consensus.cc:359] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.310303 27457 raft_consensus.cc:385] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.310642 27457 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.310336 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.311451 27457 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.316155 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.317414 27457 ts_tablet_manager.cc:1434] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:08:27.318621 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:27.320523 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.321677 27457 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.321372 27743 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.297715 27602 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.321080 27458 ts_tablet_manager.cc:1434] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:08:27.324725 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:27.326886 27459 tablet_bootstrap.cc:654] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.327203 27265 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:27.327466 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:27.331432 27383 leader_election.cc:343] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.331764 27412 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:27.331895 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:27.350118 27458 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.350262 27341 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:27.332649 27704 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.350515 27608 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.381161 27602 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.386718 27458 tablet_bootstrap.cc:654] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:27.387279 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55874.3us
I20260709 13:08:27.389329 27383 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:08:27.388065 27233 leader_election.cc:343] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.392771 27532 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.401535 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:27.403004 27412 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:27.405634 27608 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.407029 27457 tablet_bootstrap.cc:654] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.409457 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.410939 27466 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.412379 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.412959 27341 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.413204 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:08:27.415055 27233 leader_election.cc:343] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.415735 27231 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.417488 27695 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:27.418069 27743 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.420773 27341 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.425387 27466 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.426065 27466 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.428169 27457 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.429930 27457 ts_tablet_manager.cc:1403] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.007s
I20260709 13:08:27.428872 27466 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.435848 27457 raft_consensus.cc:359] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.439124 27457 raft_consensus.cc:385] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.439970 27457 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.443888 27457 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.443890 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.447926 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.448422 27695 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.448944 27457 ts_tablet_manager.cc:1434] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:08:27.449066 27695 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:27.450042 27695 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.450883 27735 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.472487 27457 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.470765 27165 catalog_manager.cc:5697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.485208 27735 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.488150 27735 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:27.495844 27457 tablet_bootstrap.cc:654] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.498040 27458 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.499081 27458 ts_tablet_manager.cc:1403] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.150s	user 0.042s	sys 0.047s
I20260709 13:08:27.502575 27458 raft_consensus.cc:359] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.503545 27458 raft_consensus.cc:385] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.503903 27458 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.504737 27458 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:27.506968 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:27.509366 27458 ts_tablet_manager.cc:1434] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:27.510541 27458 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.514565 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.516835 27457 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.520692 27457 ts_tablet_manager.cc:1403] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.003s
I20260709 13:08:27.523316 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.518402 27458 tablet_bootstrap.cc:654] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.526093 27743 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.523813 27660 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.529616 27660 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.530205 27457 raft_consensus.cc:359] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.531006 27457 raft_consensus.cc:385] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.531303 27457 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.532182 27457 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.535358 27459 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.535928 27459 ts_tablet_manager.cc:1403] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.239s	user 0.028s	sys 0.041s
I20260709 13:08:27.539973 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.542534 27457 ts_tablet_manager.cc:1434] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:08:27.543079 27660 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:27.544026 27231 leader_election.cc:343] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.545214 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.545921 27417 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:27.546602 27457 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.547966 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:27.553705 27457 tablet_bootstrap.cc:654] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.556469 27532 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:27.563400 27660 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.563958 27660 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.564404 27660 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.571297 27458 tablet_bootstrap.cc:492] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.571790 27458 ts_tablet_manager.cc:1403] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.024s
I20260709 13:08:27.574373 27458 raft_consensus.cc:359] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.575045 27458 raft_consensus.cc:385] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.575345 27458 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.576177 27458 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.578800 27458 ts_tablet_manager.cc:1434] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:27.579753 27458 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.581199 27660 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.583432 27459 raft_consensus.cc:359] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.584184 27459 raft_consensus.cc:385] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.584450 27459 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.585196 27457 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.585750 27457 ts_tablet_manager.cc:1403] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.002s
I20260709 13:08:27.586838 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:27.587201 27660 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.587481 27417 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.588541 27457 raft_consensus.cc:359] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.589263 27457 raft_consensus.cc:385] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.589540 27457 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.589661 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.590685 27342 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.592054 27458 tablet_bootstrap.cc:654] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.594995 27417 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.595156 27457 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.596240 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.596920 27660 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.597329 27457 ts_tablet_manager.cc:1434] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:08:27.597429 27660 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:27.598491 27457 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.598486 27660 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.605552 27457 tablet_bootstrap.cc:654] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.605552 27459 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.608659 27165 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.609434 27459 ts_tablet_manager.cc:1434] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.000s
I20260709 13:08:27.611120 27459 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.617200 27458 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.617702 27458 ts_tablet_manager.cc:1403] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:08:27.620458 27458 raft_consensus.cc:359] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.621150 27458 raft_consensus.cc:385] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.621423 27458 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.622072 27458 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.624158 27458 ts_tablet_manager.cc:1434] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:27.625186 27458 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.630110 27459 tablet_bootstrap.cc:654] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.630900 27602 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.631562 27457 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.631651 27602 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.632061 27457 ts_tablet_manager.cc:1403] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:08:27.636567 27457 raft_consensus.cc:359] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.639709 27457 raft_consensus.cc:385] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.640122 27457 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.639359 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.643543 27337 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.646497 27458 tablet_bootstrap.cc:654] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.643549 27412 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:27.654300 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.642458 27457 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.655194 27608 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.655606 27608 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.655974 27608 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.657272 27457 ts_tablet_manager.cc:1434] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:08:27.658648 27457 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.641466 27602 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.666163 27342 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.679991 27165 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.706048 27459 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.706707 27459 ts_tablet_manager.cc:1403] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.096s	user 0.041s	sys 0.037s
I20260709 13:08:27.710058 27459 raft_consensus.cc:359] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.710737 27459 raft_consensus.cc:385] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.710983 27459 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.711567 27459 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.713939 27459 ts_tablet_manager.cc:1434] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:27.714951 27459 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.720744 27459 tablet_bootstrap.cc:654] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.720955 27457 tablet_bootstrap.cc:654] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.732291 27459 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.732913 27459 ts_tablet_manager.cc:1403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:08:27.734222 27457 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.734724 27457 ts_tablet_manager.cc:1403] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.002s
I20260709 13:08:27.735608 27459 raft_consensus.cc:359] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.736330 27459 raft_consensus.cc:385] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.736590 27459 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.737471 27459 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.739667 27459 ts_tablet_manager.cc:1434] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:08:27.743276 27457 raft_consensus.cc:359] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.743889 27457 raft_consensus.cc:385] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.744131 27457 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.744658 27457 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.745229 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.746114 27457 ts_tablet_manager.cc:1434] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:27.747066 27457 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.749608 27484 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.750223 27484 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:27.752449 27231 leader_election.cc:343] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.753060 27457 tablet_bootstrap.cc:654] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.753705 27484 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.754007 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:27.756057 27308 leader_election.cc:343] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.762636 27608 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.764833 27608 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.782488 27608 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.783242 27608 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.788502 27660 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.789026 27660 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.790638 27459 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.791270 27660 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.794658 27608 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.796751 27459 tablet_bootstrap.cc:654] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.800021 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:27.802687 27233 leader_election.cc:343] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.803876 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:27.806344 27233 leader_election.cc:343] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.811631 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.811861 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.813289 27342 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:27.823037 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:27.827585 27412 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.825644 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.847086 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.848340 27264 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
W20260709 13:08:27.851689 27231 leader_election.cc:343] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.851984 27458 tablet_bootstrap.cc:492] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.852550 27458 ts_tablet_manager.cc:1403] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.228s	user 0.078s	sys 0.117s
I20260709 13:08:27.853153 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.854113 27608 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.854508 27608 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.854914 27608 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.855301 27458 raft_consensus.cc:359] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.856009 27458 raft_consensus.cc:385] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.856280 27458 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.856909 27458 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.858428 27458 ts_tablet_manager.cc:1434] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:08:27.863261 27459 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.863749 27459 ts_tablet_manager.cc:1403] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.025s
W20260709 13:08:27.863997 27231 leader_election.cc:343] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.864431 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.865398 27412 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.866061 27660 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:27.868299 27459 raft_consensus.cc:359] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.868587 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:27.869009 27459 raft_consensus.cc:385] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.869326 27459 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.869413 27660 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:27.870119 27660 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:27.870064 27459 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.871028 27608 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.871119 27660 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.872376 27459 ts_tablet_manager.cc:1434] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:27.873397 27459 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:27.882735 27309 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.884063 27458 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:27.880355 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:27.889560 27464 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.890326 27458 tablet_bootstrap.cc:654] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.890033 27464 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.887053 27459 tablet_bootstrap.cc:654] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.892032 27464 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:08:27.892953 27233 leader_election.cc:343] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.896337 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.897375 27268 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:27.899190 27383 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:27.900101 27608 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.900959 27464 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.901494 27464 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.901978 27464 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.906775 27457 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:27.907282 27457 ts_tablet_manager.cc:1403] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.160s	user 0.030s	sys 0.053s
I20260709 13:08:27.911401 27743 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:27.911288 27457 raft_consensus.cc:359] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.911798 27743 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.912078 27457 raft_consensus.cc:385] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.912144 27743 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.912431 27457 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.913046 27457 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.915046 27457 ts_tablet_manager.cc:1434] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:27.916049 27457 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:27.919552 27484 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.920117 27484 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.926433 27735 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.931239 27484 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.931492 27735 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.932462 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.932328 27464 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.934331 27464 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:27.935415 27735 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:27.936699 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.940393 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:27.942145 27264 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.953958 27165 catalog_manager.cc:5697] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.919145 27743 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.955583 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.960899 27342 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:27.964273 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:27.965561 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:27.966665 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:27.966910 27380 leader_election.cc:343] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.967506 27339 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:27.969192 27342 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:27.972735 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:27.973412 27458 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:27.973901 27458 ts_tablet_manager.cc:1403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.014s
I20260709 13:08:27.975872 27695 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.976528 27695 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.980089 27695 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.981043 27735 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.982227 27719 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.984243 27458 raft_consensus.cc:359] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.983795 27457 tablet_bootstrap.cc:654] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:27.985049 27458 raft_consensus.cc:385] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:27.985450 27458 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:27.985059 27459 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:27.986312 27458 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.982777 27719 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:27.990382 27719 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:27.982187 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.982748 27735 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:27.992260 27233 leader_election.cc:343] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.993331 27735 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:08:27.983572 27380 leader_election.cc:343] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:27.994536 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:27.994894 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:27.996826 27735 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:27.999379 27233 leader_election.cc:343] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.003394 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.012645 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:27.998625 27743 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.016609 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.017935 27459 ts_tablet_manager.cc:1403] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.145s	user 0.035s	sys 0.013s
I20260709 13:08:28.018705 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.019562 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.019861 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:28.021358 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:28.027968 27231 leader_election.cc:343] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.021802 27308 leader_election.cc:343] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.016885 27719 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.030948 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.019757 27743 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.015618 27264 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:28.035041 27660 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:08:28.035130 27719 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:08:28.041926 27380 leader_election.cc:343] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.037580 27695 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.039346 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:28.043546 27268 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.041692 27719 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.032895 27458 ts_tablet_manager.cc:1434] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.059s	user 0.020s	sys 0.011s
I20260709 13:08:28.046689 27532 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.047187 27532 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.049170 27532 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.052537 27459 raft_consensus.cc:359] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.054082 27459 raft_consensus.cc:385] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.054468 27459 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.055338 27383 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:28.055214 27459 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:28.058416 27383 leader_election.cc:343] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.059350 27458 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.059206 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:28.060040 27457 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:28.060391 27457 ts_tablet_manager.cc:1403] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.145s	user 0.009s	sys 0.007s
I20260709 13:08:28.060184 27464 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.058398 27704 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.062978 27704 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:28.063704 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:28.063838 27704 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:28.066129 27383 leader_election.cc:343] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.072841 27459 ts_tablet_manager.cc:1434] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 13:08:28.058013 27735 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.082648 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.083369 27341 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:28.085323 27459 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
W20260709 13:08:28.087803 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59866.8us
W20260709 13:08:28.088524 27231 leader_election.cc:343] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.088922 27231 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.089664 27781 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.096855 27457 raft_consensus.cc:359] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.097649 27457 raft_consensus.cc:385] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.097939 27457 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.098609 27457 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.104116 27457 ts_tablet_manager.cc:1434] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:08:28.100811 27784 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:08:28.114048 27608 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.099031 27268 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:28.107401 27783 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:08:28.147382 27309 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.120589 27608 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.171563 27457 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:28.209729 27608 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.168586 27743 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.212460 27743 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:28.213641 27743 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.217633 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:28.219769 27231 leader_election.cc:343] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.221278 27165 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.229409 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 147502us
I20260709 13:08:28.231654 27459 tablet_bootstrap.cc:654] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.237983 27164 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.241041 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:28.245388 27233 leader_election.cc:343] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.245823 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.246869 27343 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.261355 27602 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.257318 27783 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.264936 27458 tablet_bootstrap.cc:654] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.271467 27380 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:28.274334 27532 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.274771 27532 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.275142 27532 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.335475 27458 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.336165 27458 ts_tablet_manager.cc:1403] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.279s	user 0.019s	sys 0.012s
I20260709 13:08:28.357978 27457 tablet_bootstrap.cc:654] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.376157 27459 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.376853 27459 ts_tablet_manager.cc:1403] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.292s	user 0.010s	sys 0.016s
I20260709 13:08:28.382975 27787 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.383584 27787 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.385841 27787 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.390897 27458 raft_consensus.cc:359] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.402033 27458 raft_consensus.cc:385] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.402411 27458 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.403213 27458 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.406219 27459 raft_consensus.cc:359] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.406888 27459 raft_consensus.cc:385] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.407136 27459 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.408468 27459 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.410940 27459 ts_tablet_manager.cc:1434] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:08:28.411890 27459 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:28.412046 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.427834 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:28.428534 27264 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:28.431274 27457 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:28.431767 27457 ts_tablet_manager.cc:1403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.272s	user 0.017s	sys 0.007s
I20260709 13:08:28.431629 27532 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.433169 27458 ts_tablet_manager.cc:1434] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 13:08:28.425504 27164 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.437397 27532 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.438740 27458 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.445134 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:28.445843 27341 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.447535 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:28.454604 27383 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:28.455348 27704 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.455729 27704 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.456115 27704 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.457234 27457 raft_consensus.cc:359] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.458009 27457 raft_consensus.cc:385] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.458315 27457 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.423089 27695 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:08:28.463027 27383 leader_election.cc:343] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.458974 27457 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:28.471681 27380 leader_election.cc:343] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.472247 27457 ts_tablet_manager.cc:1434] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:08:28.489336 27459 tablet_bootstrap.cc:654] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.474161 27341 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:28.492003 27704 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.493566 27380 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:28.494480 27464 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.494899 27464 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:28.495325 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:28.495657 27464 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.496088 27265 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.497731 27457 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
W20260709 13:08:28.509745 27231 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.509744 27602 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.511015 27602 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.513904 27602 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:28.518889 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48058us
I20260709 13:08:28.541591 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:28.553972 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.554342 27458 tablet_bootstrap.cc:654] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:28.556111 27231 leader_election.cc:343] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.560352 27704 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.567489 27457 tablet_bootstrap.cc:654] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.569188 27265 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:28.582957 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:28.582950 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:28.585280 27416 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:28.585879 27735 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.586360 27735 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.590610 27735 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.593458 27459 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.594067 27459 ts_tablet_manager.cc:1403] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.003s
I20260709 13:08:28.596030 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:28.596941 27268 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:28.600773 27459 raft_consensus.cc:359] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.601951 27459 raft_consensus.cc:385] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.600725 27383 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:28.602521 27459 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.603308 27735 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.604223 27735 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:28.605386 27735 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.603812 27459 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.610085 27459 ts_tablet_manager.cc:1434] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:08:28.611219 27459 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
W20260709 13:08:28.612237 27380 leader_election.cc:343] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.614454 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:28.617530 27459 tablet_bootstrap.cc:654] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.617281 27804 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.619612 27464 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.620227 27464 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.620782 27464 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.628394 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:28.630091 27380 leader_election.cc:343] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.633659 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:28.635669 27660 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.635377 27464 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.636066 27660 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.636445 27660 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.638548 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:28.639935 27380 leader_election.cc:343] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.640730 27464 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.652537 27458 tablet_bootstrap.cc:492] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.653087 27458 ts_tablet_manager.cc:1403] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.215s	user 0.022s	sys 0.013s
I20260709 13:08:28.655881 27458 raft_consensus.cc:359] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.656642 27458 raft_consensus.cc:385] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.656949 27458 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.657611 27458 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.663530 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:28.664036 27660 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.666113 27457 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:28.666638 27457 ts_tablet_manager.cc:1403] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.019s
I20260709 13:08:28.668270 27265 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:28.671367 27660 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:28.672705 27308 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.674265 27457 raft_consensus.cc:359] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.674834 27457 raft_consensus.cc:385] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.675064 27457 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.675697 27457 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.676280 27458 ts_tablet_manager.cc:1434] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:08:28.677762 27458 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.678402 27457 ts_tablet_manager.cc:1434] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:08:28.679451 27457 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
W20260709 13:08:28.681103 27233 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.682262 27804 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.682600 27459 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.683014 27459 ts_tablet_manager.cc:1403] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.000s
I20260709 13:08:28.682761 27804 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.684939 27804 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.685487 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:28.685572 27459 raft_consensus.cc:359] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.686318 27459 raft_consensus.cc:385] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.686570 27459 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.687145 27459 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.691342 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:28.691970 27532 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.693636 27459 ts_tablet_manager.cc:1434] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:08:28.694685 27459 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:28.696543 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.698098 27458 tablet_bootstrap.cc:654] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.700692 27735 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.702216 27457 tablet_bootstrap.cc:654] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.705442 27459 tablet_bootstrap.cc:654] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.706004 27340 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.715279 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:28.716176 27412 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:28.716274 27459 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.716888 27459 ts_tablet_manager.cc:1403] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:08:28.720890 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:28.721614 27412 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:28.725764 27459 raft_consensus.cc:359] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.726778 27459 raft_consensus.cc:385] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.727125 27459 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.728024 27459 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:28.731084 27231 leader_election.cc:343] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.736784 27459 ts_tablet_manager.cc:1434] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:08:28.738332 27459 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
W20260709 13:08:28.740718 27231 leader_election.cc:343] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.743489 27458 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.743999 27458 ts_tablet_manager.cc:1403] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.025s
I20260709 13:08:28.746811 27459 tablet_bootstrap.cc:654] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.746920 27458 raft_consensus.cc:359] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.747849 27458 raft_consensus.cc:385] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.748188 27458 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.748677 27735 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:28.748939 27458 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.750469 27735 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.751358 27735 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.752362 27458 ts_tablet_manager.cc:1434] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:28.753487 27458 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.753711 27735 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:28.758322 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.759961 27458 tablet_bootstrap.cc:654] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.760090 27804 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.761263 27459 tablet_bootstrap.cc:492] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.761979 27459 ts_tablet_manager.cc:1403] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 13:08:28.762869 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:28.764571 27660 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.764986 27660 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.765354 27660 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.765722 27459 raft_consensus.cc:359] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.766419 27459 raft_consensus.cc:385] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.766727 27459 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.767395 27459 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.769356 27459 ts_tablet_manager.cc:1434] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:28.770398 27459 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:28.774220 27165 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.776110 27459 tablet_bootstrap.cc:654] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.776729 27802 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.777256 27802 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.780417 27802 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.778568 27783 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.781440 27783 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.781911 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:28.783802 27783 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.788127 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:28.789552 27660 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.792896 27660 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.794142 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:28.797748 27458 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.798233 27458 ts_tablet_manager.cc:1403] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.011s
I20260709 13:08:28.800998 27458 raft_consensus.cc:359] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.801745 27458 raft_consensus.cc:385] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.802023 27458 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.802932 27459 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.802604 27458 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.803388 27459 ts_tablet_manager.cc:1403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 13:08:28.804215 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:28.804633 27458 ts_tablet_manager.cc:1434] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:28.805620 27458 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.808099 27457 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:28.808545 27457 ts_tablet_manager.cc:1403] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.129s	user 0.010s	sys 0.059s
I20260709 13:08:28.811957 27458 tablet_bootstrap.cc:654] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.814766 27459 raft_consensus.cc:359] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.815501 27459 raft_consensus.cc:385] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.815791 27459 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.804162 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.816675 27459 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.818096 27340 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:28.818460 27457 raft_consensus.cc:359] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.819198 27457 raft_consensus.cc:385] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.819458 27457 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.820104 27457 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.822156 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:28.822993 27459 ts_tablet_manager.cc:1434] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:08:28.826313 27459 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:28.828895 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:28.830899 27231 leader_election.cc:343] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.831946 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:28.832515 27416 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.832909 27457 ts_tablet_manager.cc:1434] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:08:28.834295 27457 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:28.839385 27416 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:28.844671 27459 tablet_bootstrap.cc:654] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.845340 27457 tablet_bootstrap.cc:654] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:28.847088 27380 leader_election.cc:343] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:28.857686 27383 leader_election.cc:343] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:28.858193 27383 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:28.867144 27309 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.867959 27458 tablet_bootstrap.cc:492] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.868063 27802 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:28.868673 27458 ts_tablet_manager.cc:1403] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.020s
I20260709 13:08:28.869664 27532 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.872267 27458 raft_consensus.cc:359] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.873135 27458 raft_consensus.cc:385] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.873499 27458 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.874336 27458 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.876802 27458 ts_tablet_manager.cc:1434] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:28.878098 27458 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:28.886207 27458 tablet_bootstrap.cc:654] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.888973 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:28.890229 27660 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.897722 27660 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:28.885823 27164 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:28.905537 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:28.904695 27458 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:28.906755 27458 ts_tablet_manager.cc:1403] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:08:28.906769 27783 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.908093 27783 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:28.910717 27458 raft_consensus.cc:359] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.911751 27458 raft_consensus.cc:385] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.912046 27783 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.923420 27802 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:28.934103 27802 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.934950 27802 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.937839 27802 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.939762 27802 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.940531 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:28.940305 27802 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.945986 27459 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:28.946512 27459 ts_tablet_manager.cc:1403] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.121s	user 0.046s	sys 0.048s
I20260709 13:08:28.947549 27457 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:28.943617 27416 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
W20260709 13:08:28.948217 27443 tablet.cc:2406] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:28.950843 27466 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.956223 27466 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.957283 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:28.958317 27484 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:28.958709 27484 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.959081 27484 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.985680 27484 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:28.995724 27802 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:28.996192 27457 ts_tablet_manager.cc:1403] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.162s	user 0.047s	sys 0.054s
I20260709 13:08:29.000789 27457 raft_consensus.cc:359] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.001642 27457 raft_consensus.cc:385] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.001967 27457 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.912103 27458 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.002947 27466 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.003482 27458 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.003767 27459 raft_consensus.cc:359] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.004549 27459 raft_consensus.cc:385] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.004873 27459 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.005573 27459 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.002717 27457 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.008919 27458 ts_tablet_manager.cc:1434] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.000s
I20260709 13:08:29.009549 27457 ts_tablet_manager.cc:1434] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:29.009868 27458 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:29.011716 27459 ts_tablet_manager.cc:1434] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.016s
I20260709 13:08:29.013092 27459 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:29.014998 27342 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.020598 27459 tablet_bootstrap.cc:654] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.025434 27457 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:29.029062 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:29.032984 27457 tablet_bootstrap.cc:654] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.033228 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.033506 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.034017 27262 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:29.034158 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:29.035125 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.035924 27263 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:29.039849 27704 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.040402 27704 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.042426 27704 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.047312 27704 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.053822 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.056416 27484 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.060036 27704 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.062033 27704 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.064000 27343 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.064532 27704 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.057379 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:29.066145 27412 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:29.067096 27415 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:29.068104 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:29.068703 27417 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:29.073925 27380 leader_election.cc:343] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.073513 27166 catalog_manager.cc:5697] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.065279 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.076643 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.075320 27704 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:29.078377 27308 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.075832 27417 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:29.086392 27484 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.093505 27532 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.097123 27309 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:29.097800 27466 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.099838 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.103286 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.104233 27265 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:29.106925 27484 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.108742 27484 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.099277 27343 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:29.106848 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:29.128120 27660 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.129630 27459 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:29.129572 27660 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.130184 27459 ts_tablet_manager.cc:1403] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.004s
I20260709 13:08:29.130424 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.131577 27532 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:29.131883 27532 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.132144 27532 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.142295 27660 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.128582 27268 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.146639 27466 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.137583 27743 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.152093 27743 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:29.152978 27743 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:29.173146 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 68781.7us
W20260709 13:08:29.174396 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74623.1us
I20260709 13:08:29.181501 27459 raft_consensus.cc:359] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.182296 27459 raft_consensus.cc:385] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.182564 27459 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.183107 27459 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.189940 27484 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.204891 27484 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.196738 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:29.210055 27412 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:29.210431 27457 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:29.211071 27457 ts_tablet_manager.cc:1403] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.186s	user 0.031s	sys 0.037s
I20260709 13:08:29.197362 27833 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.208889 27459 ts_tablet_manager.cc:1434] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 13:08:29.181561 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:29.219686 27532 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.227126 27458 tablet_bootstrap.cc:654] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.225323 27459 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
W20260709 13:08:29.226478 27383 leader_election.cc:343] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.229820 27532 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.228902 27383 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:29.233157 27532 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.232731 27735 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:29.239466 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63831.2us
I20260709 13:08:29.239439 27735 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.226998 27833 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.241530 27735 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.242969 27833 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.243603 27416 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.243846 27735 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.246389 27233 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.248627 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:29.249364 27412 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.250746 27163 catalog_manager.cc:5697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.251807 27415 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.253737 27660 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.363989 27660 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.364491 27660 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.363242 27459 tablet_bootstrap.cc:654] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.345816 27412 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:29.372671 27457 raft_consensus.cc:359] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.373647 27457 raft_consensus.cc:385] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.374018 27457 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.374814 27457 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:29.345718 27838 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:08:29.303714 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:29.303580 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 43540.8us
I20260709 13:08:29.268023 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:29.398363 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.400370 27268 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.419266 27457 ts_tablet_manager.cc:1434] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.192s	user 0.013s	sys 0.001s
I20260709 13:08:29.419490 27458 tablet_bootstrap.cc:492] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:29.498219 27458 ts_tablet_manager.cc:1403] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.489s	user 0.009s	sys 0.037s
I20260709 13:08:29.421063 27660 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.426330 27308 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.507750 27830 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.508388 27830 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:08:29.509829 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83585.3us
I20260709 13:08:29.516086 27457 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:29.506505 27268 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:08:29.532392 27459 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:29.533000 27459 ts_tablet_manager.cc:1403] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.308s	user 0.021s	sys 0.019s
I20260709 13:08:29.534525 27458 raft_consensus.cc:359] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.535555 27458 raft_consensus.cc:385] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.535905 27458 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.536728 27458 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.528157 27830 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:29.539687 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 399539us
I20260709 13:08:29.548888 27783 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.561117 27458 ts_tablet_manager.cc:1434] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:08:29.563422 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.564795 27458 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:29.565596 27459 raft_consensus.cc:359] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.566282 27459 raft_consensus.cc:385] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.566591 27459 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.566629 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:29.567257 27337 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:29.568914 27459 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.574057 27459 ts_tablet_manager.cc:1434] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:08:29.621232 27845 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.650185 27383 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:29.657831 27735 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:29.675938 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:29.677212 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.681234 27458 tablet_bootstrap.cc:654] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.681979 27532 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.682454 27532 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.686630 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:29.658344 27845 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.679827 27735 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:29.693898 27845 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.693744 27735 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.694850 27660 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.696542 27459 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:29.697088 27532 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:29.702479 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:08:29.702677 27231 leader_election.cc:343] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.703239 27532 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:29.704407 27231 leader_election.cc:343] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.707481 27457 tablet_bootstrap.cc:654] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.707286 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.708846 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:29.712708 27231 leader_election.cc:343] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.723830 27342 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.717185 27337 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:08:29.771633 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 63861.2us
I20260709 13:08:29.775399 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:29.776187 27417 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:29.764003 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:29.799773 27457 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:29.810714 27457 ts_tablet_manager.cc:1403] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.295s	user 0.015s	sys 0.013s
I20260709 13:08:29.814865 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:29.810158 27262 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:29.824383 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51859.2us
I20260709 13:08:29.789775 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:29.838014 27380 leader_election.cc:343] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.839267 27660 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.839828 27660 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.848790 27457 raft_consensus.cc:359] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.853361 27457 raft_consensus.cc:385] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.853693 27457 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.826290 27851 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.862381 27458 tablet_bootstrap.cc:492] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:29.862879 27458 ts_tablet_manager.cc:1403] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.300s	user 0.030s	sys 0.030s
I20260709 13:08:29.896418 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:29.899821 27231 leader_election.cc:343] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.900557 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:29.901170 27417 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.845445 27261 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:29.858657 27851 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.924880 27484 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.925359 27484 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.899560 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:29.926261 27417 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:29.864768 27845 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 13:08:29.932384 27459 tablet_bootstrap.cc:654] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.935007 27484 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:29.936275 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:29.936331 27458 raft_consensus.cc:359] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.937244 27458 raft_consensus.cc:385] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.937505 27458 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.938027 27458 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:29.924690 27851 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.958268 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:29.959496 27844 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.963886 27458 ts_tablet_manager.cc:1434] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 13:08:29.964924 27861 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.965400 27861 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.965744 27861 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.978286 27233 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:29.986645 27843 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.013656 27458 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:30.072057 27262 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:30.078299 27459 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:30.078809 27459 ts_tablet_manager.cc:1403] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.394s	user 0.014s	sys 0.012s
I20260709 13:08:30.095623 27660 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:30.104130 27459 raft_consensus.cc:359] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.104889 27459 raft_consensus.cc:385] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.105142 27459 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.105749 27459 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.120872 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:30.121668 27411 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:30.137017 27459 ts_tablet_manager.cc:1434] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:08:30.142072 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:30.143666 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:30.146878 27466 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.147584 27466 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.157333 27164 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 0 to 1, leader changed from <none> to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.164636 27855 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.167630 27466 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:30.169253 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:30.170006 27260 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 0.
I20260709 13:08:30.176532 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:30.177382 27466 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.178015 27466 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.178997 27466 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:30.221768 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44882.7us
I20260709 13:08:30.136513 27861 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:30.229861 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76561.3us
I20260709 13:08:30.229770 27457 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.235572 27459 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:30.175563 27843 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:08:30.247736 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 80779.4us
I20260709 13:08:30.248404 27458 tablet_bootstrap.cc:654] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.254199 27466 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.258508 27262 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260709 13:08:30.266126 27861 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:30.259840 27457 ts_tablet_manager.cc:1434] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.449s	user 0.032s	sys 0.045s
I20260709 13:08:30.270439 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:30.273732 27466 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:30.276331 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45710.4us
I20260709 13:08:30.282819 27459 tablet_bootstrap.cc:654] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.292514 27856 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.293128 27856 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.297591 27457 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:30.301013 27871 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:30.301445 27871 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.303215 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:30.304055 27334 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:30.301782 27871 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.297683 27856 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:30.276975 27851 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.318869 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:30.319520 27851 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:30.319658 27335 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:30.321929 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:30.300199 27735 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:08:30.297161 27843 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.331830 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:30.346773 27268 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.350502 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:30.351154 27415 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:08:30.353266 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 80788.2us
I20260709 13:08:30.354951 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:30.355842 27408 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:30.354437 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:30.357687 27790 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.362782 27484 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:08:30.364902 27830 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:30.367429 27790 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.368886 27790 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.367036 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:30.372560 27268 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:30.375208 27457 tablet_bootstrap.cc:654] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:30.359448 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:30.377333 27260 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:30.379551 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:30.403153 27837 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:08:30.381633 27790 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.413980 27343 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260709 13:08:30.400350 27261 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:30.414592 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:30.417621 27417 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:30.427719 27882 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.436465 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:30.436691 27466 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.437587 27484 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:30.428315 27882 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:30.466815 27231 leader_election.cc:343] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.480487 27417 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:30.495724 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:30.501761 27862 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.502321 27862 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:30.504133 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:30.503135 27862 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.520185 27841 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:30.520807 27841 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:30.531517 27458 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:30.532498 27458 ts_tablet_manager.cc:1403] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.543s	user 0.017s	sys 0.011s
I20260709 13:08:30.521700 27841 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.597545 27459 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:30.562165 27790 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:30.626027 27459 ts_tablet_manager.cc:1403] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.459s	user 0.024s	sys 0.029s
I20260709 13:08:30.639103 27458 raft_consensus.cc:359] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.640479 27458 raft_consensus.cc:385] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.640962 27458 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.566912 27833 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:08:30.667294 27458 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:30.677690 27886 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:08:30.611397 27882 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:30.667657 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:30.683925 27337 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:30.844944 27897 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:30.850255 27337 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:30.762253 27871 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.866428 27457 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:30.866945 27457 ts_tablet_manager.cc:1403] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.590s	user 0.020s	sys 0.023s
W20260709 13:08:30.872948 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 107309us
I20260709 13:08:30.763338 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:30.864681 27871 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:30.874970 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:30.877676 27458 ts_tablet_manager.cc:1434] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.345s	user 0.059s	sys 0.059s
W20260709 13:08:30.948150 27492 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.266s	user 0.008s	sys 0.004s
I20260709 13:08:30.953320 27459 raft_consensus.cc:359] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.954293 27459 raft_consensus.cc:385] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.954644 27459 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:30.955408 27459 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.961692 27459 ts_tablet_manager.cc:1434] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.335s	user 0.020s	sys 0.020s
I20260709 13:08:30.966554 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:30.968969 27260 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.950498 27335 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:30.981189 27233 leader_election.cc:343] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:30.986914 27457 raft_consensus.cc:359] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:30.987884 27457 raft_consensus.cc:385] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:30.988221 27457 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.004822 27457 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:31.009719 27892 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.360s	user 0.000s	sys 0.008s
I20260709 13:08:30.996287 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:31.017510 27457 ts_tablet_manager.cc:1434] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.150s	user 0.008s	sys 0.000s
I20260709 13:08:31.021111 27457 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:31.032110 27458 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:31.033697 27901 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.041023 27901 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:31.044546 27458 tablet_bootstrap.cc:654] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.044549 27901 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.055738 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:31.057548 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:31.088455 27457 tablet_bootstrap.cc:654] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.093947 27164 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 101) took 1263 ms. Trace:
I20260709 13:08:31.097383 27837 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.097602 27163 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 88) took 1400 ms. Trace:
I20260709 13:08:31.097906 27837 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.103448 27459 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:31.105918 27260 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
W20260709 13:08:31.115532 27231 leader_election.cc:343] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:31.116444 27231 leader_election.cc:343] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.116917 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:31.094385 27164 rpcz_store.cc:276] 0709 13:08:29.828793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.828992 (+   199us) service_pool.cc:224] Handling call
0709 13:08:31.092451 (+1263459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:30.301914 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:30.347730 (+ 45816us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:30.347789 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:08:30.347826 (+    37us) tablet.cc:662] Decoding operations
0709 13:08:30.348404 (+   578us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:30.348528 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:30.348587 (+    59us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:30.351531 (+  2944us) tablet.cc:701] Row locks acquired
0709 13:08:30.351550 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:30.351677 (+   127us) write_op.cc:270] Start()
0709 13:08:30.351789 (+   112us) write_op.cc:276] Timestamp: P: 1783602510351639 usec, L: 0
0709 13:08:30.351809 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:30.364464 (+ 12655us) log.cc:844] Serialized 543 byte log entry
0709 13:08:30.494305 (+129841us) op_driver.cc:464] REPLICATION: finished
0709 13:08:30.626024 (+131719us) write_op.cc:301] APPLY: starting
0709 13:08:30.626100 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:30.626210 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:30.662638 (+ 36428us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:30.681189 (+ 18551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:30.681394 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:30.681446 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:30.681684 (+   238us) log.cc:844] Serialized 22 byte log entry
0709 13:08:30.681859 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.681944 (+    85us) write_op.cc:454] Released schema lock
0709 13:08:30.681982 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:30.682331 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.682358 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57440,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":131470,"apply.run_cpu_time_us":2108,"apply.run_wall_time_us":56299,"num_ops":1,"prepare.queue_time_us":100187,"prepare.run_cpu_time_us":4063,"prepare.run_wall_time_us":78020,"replication_time_us":142341,"thread_start_us":106795,"threads_started":2}]]}
I20260709 13:08:31.118086 27458 tablet_bootstrap.cc:492] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:31.118462 27783 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.119220 27458 ts_tablet_manager.cc:1403] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.087s	user 0.028s	sys 0.001s
I20260709 13:08:31.120489 27870 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.097936 27163 rpcz_store.cc:276] 0709 13:08:29.696946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.697082 (+   136us) service_pool.cc:224] Handling call
0709 13:08:31.097544 (+1400462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442021,"reported_tablets":3}
I20260709 13:08:31.135497 27457 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:31.136107 27457 ts_tablet_manager.cc:1403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.011s
I20260709 13:08:31.141553 27457 raft_consensus.cc:359] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.142306 27457 raft_consensus.cc:385] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.142597 27457 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.154309 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.151577 27837 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.153640 27901 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.160594 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:31.166347 27408 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:31.169914 27308 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:31.161065 27458 raft_consensus.cc:359] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.170698 27458 raft_consensus.cc:385] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.171057 27458 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.154902 27457 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.163420 27901 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.184566 27458 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.207491 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:31.208256 27412 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.214535 27901 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:31.180190 27837 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:31.218626 27458 ts_tablet_manager.cc:1434] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.002s
I20260709 13:08:31.218835 27837 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.219339 27837 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.229658 27459 tablet_bootstrap.cc:654] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.235234 27458 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:31.246434 27457 ts_tablet_manager.cc:1434] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.110s	user 0.004s	sys 0.002s
I20260709 13:08:31.244045 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:31.248559 27412 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:31.249037 27457 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:31.244433 27856 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.252942 27380 leader_election.cc:343] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.251933 27856 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.255839 27856 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:31.271733 27856 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:08:31.275210 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:31.280578 27458 tablet_bootstrap.cc:654] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.288870 27837 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.294772 27340 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:08:31.298309 27380 leader_election.cc:343] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.301611 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:31.302309 27411 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.304633 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:31.310876 27898 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.310443 27163 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.314405 27457 tablet_bootstrap.cc:654] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.314268 27163 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 3, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:08:31.315776 27163 catalog_manager.cc:5697] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.316780 27804 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.317345 27804 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.319271 27837 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.320724 27804 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.321334 27908 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.321848 27908 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.326116 27908 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.329036 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:31.330328 27416 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:31.331687 27457 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:31.333601 27457 ts_tablet_manager.cc:1403] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.085s	user 0.005s	sys 0.009s
I20260709 13:08:31.338660 27457 raft_consensus.cc:359] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.339594 27804 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.347458 27457 raft_consensus.cc:385] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.347869 27804 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.348342 27804 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:31.347883 27457 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.349289 27804 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.350600 27804 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.350384 27457 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.351025 27411 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:31.352514 27308 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:31.342938 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.344949 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:31.353690 27837 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.354549 27837 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:31.355239 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:31.355820 27231 leader_election.cc:343] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.353508 27457 ts_tablet_manager.cc:1434] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:08:31.357267 27908 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.357882 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.358567 27457 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Bootstrap starting.
I20260709 13:08:31.358742 27268 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:31.362785 27383 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.365612 27458 tablet_bootstrap.cc:492] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:31.366148 27458 ts_tablet_manager.cc:1403] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.131s	user 0.021s	sys 0.000s
I20260709 13:08:31.371156 27898 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.371726 27898 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.372079 27898 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.375409 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.376142 27268 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:31.364037 27837 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.377851 27459 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:31.378351 27459 ts_tablet_manager.cc:1403] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.275s	user 0.012s	sys 0.002s
I20260709 13:08:31.378793 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:31.380432 27416 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 0.
I20260709 13:08:31.381183 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.382011 27870 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.382551 27870 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:31.383497 27870 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.388276 27908 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.389874 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.398386 27856 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.398921 27856 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.399366 27856 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.405467 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.406665 27845 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.407127 27845 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.407529 27845 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.416903 27459 raft_consensus.cc:359] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.417660 27459 raft_consensus.cc:385] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.417940 27459 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.418560 27459 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.419269 27803 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.421064 27459 ts_tablet_manager.cc:1434] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:08:31.422083 27459 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:31.437273 27803 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.437851 27803 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.440301 27803 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.443675 27268 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:31.444886 27898 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.445597 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:31.448395 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:31.448961 27233 leader_election.cc:343] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:31.450582 27231 leader_election.cc:343] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.451067 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:31.454170 27861 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.454589 27804 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.457314 27458 raft_consensus.cc:359] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.458308 27458 raft_consensus.cc:385] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.458739 27458 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.459818 27458 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.468780 27458 ts_tablet_manager.cc:1434] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.002s
I20260709 13:08:31.476642 27458 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:31.480687 27459 tablet_bootstrap.cc:654] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.485558 27845 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.495250 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:31.499600 27457 tablet_bootstrap.cc:654] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.471825 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:31.502301 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:31.496270 27882 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:08:31.493759 27908 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.505014 27908 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.488854 27845 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:31.509542 27908 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:31.511116 27231 leader_election.cc:343] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.511391 27261 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.515530 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:31.512688 27898 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:08:31.518538 27380 leader_election.cc:343] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.525631 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.530609 27856 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.531247 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:31.532141 27414 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:31.532202 27416 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:31.536192 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:31.536841 27908 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.538971 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:31.545116 27261 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:31.542445 27845 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.552958 27383 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.575067 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:31.577140 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:31.577967 27264 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:31.579945 27908 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:08:31.583884 27380 leader_election.cc:343] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.583338 27898 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.570499 27856 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:31.590399 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:31.591856 27901 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:31.596935 27164 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.600423 27164 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 2, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:31.592221 27898 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:31.708118 27898 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:31.813288 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 223386us
I20260709 13:08:31.813936 27457 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: No bootstrap required, opened a new log
I20260709 13:08:31.814500 27457 ts_tablet_manager.cc:1403] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Time spent bootstrapping tablet: real 0.457s	user 0.041s	sys 0.033s
W20260709 13:08:31.817116 27928 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:08:31.821683 27458 tablet_bootstrap.cc:654] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.822955 27459 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:31.823452 27459 ts_tablet_manager.cc:1403] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.402s	user 0.013s	sys 0.012s
W20260709 13:08:31.824232 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 98059.7us
I20260709 13:08:31.806836 27163 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.836452 27457 raft_consensus.cc:359] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.837283 27457 raft_consensus.cc:385] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.837790 27457 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.838925 27457 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.839419 27735 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.842967 27735 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.844910 27457 ts_tablet_manager.cc:1434] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:08:31.844990 27735 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:31.857378 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:31.858068 27262 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:31.865685 27882 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.882144 27341 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:31.883380 27459 raft_consensus.cc:359] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.884132 27459 raft_consensus.cc:385] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.884403 27459 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.885013 27459 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.889706 27459 ts_tablet_manager.cc:1434] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:08:31.889017 27166 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.900704 27383 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:31.901152 27412 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:31.901960 27901 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:31.902348 27901 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.902664 27901 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.902779 27907 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.910049 27901 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.912499 27901 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:31.918027 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:31.918303 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:31.919258 27264 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:31.922677 27459 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Bootstrap starting.
I20260709 13:08:31.925685 27932 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:31.927650 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:31.941684 27164 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.946600 27380 leader_election.cc:343] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.947506 27464 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:31.948403 27380 leader_election.cc:343] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:31.953166 27458 tablet_bootstrap.cc:492] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:31.953666 27458 ts_tablet_manager.cc:1403] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.483s	user 0.014s	sys 0.006s
I20260709 13:08:31.954339 27459 tablet_bootstrap.cc:654] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.959560 27458 raft_consensus.cc:359] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.960275 27458 raft_consensus.cc:385] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:31.960546 27458 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:31.961202 27458 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.961520 27264 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:31.963380 27458 ts_tablet_manager.cc:1434] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:31.967795 27458 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:31.967903 27383 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:31.969611 27901 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:31.970106 27901 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:31.975770 27458 tablet_bootstrap.cc:654] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:31.980997 27261 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:08:31.981536 27261 pending_rounds.cc:85] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 0
I20260709 13:08:31.981922 27261 pending_rounds.cc:107] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:08:31.982317 27261 raft_consensus.cc:2889] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.993968 27735 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.994506 27735 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:31.999752 27735 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:32.005829 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:32.006494 27341 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:31.970932 27901 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.008594 27837 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.008422 27458 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:32.010454 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:32.010483 27458 ts_tablet_manager.cc:1403] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 13:08:32.011528 27704 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.011914 27704 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.012228 27704 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.013705 27458 raft_consensus.cc:359] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.018554 27458 raft_consensus.cc:385] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.018849 27458 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.021065 27458 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.026504 27458 ts_tablet_manager.cc:1434] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:08:32.030735 27458 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:32.034691 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:32.037164 27264 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:32.056383 27704 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.065191 27704 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:32.065409 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:32.066061 27335 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.066236 27459 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: No bootstrap required, opened a new log
I20260709 13:08:32.066793 27459 ts_tablet_manager.cc:1403] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.021s
I20260709 13:08:32.072666 27335 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:32.074944 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:32.081032 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:32.081655 27261 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.081785 27935 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.082337 27935 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:32.082901 27459 raft_consensus.cc:359] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.083125 27935 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.073470 27458 tablet_bootstrap.cc:654] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.083626 27459 raft_consensus.cc:385] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.087494 27459 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.088379 27459 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.090607 27459 ts_tablet_manager.cc:1434] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:08:32.093405 27166 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.098519 27261 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:32.141449 27166 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.145153 27458 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:32.145808 27458 ts_tablet_manager.cc:1403] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.000s
I20260709 13:08:32.148792 27458 raft_consensus.cc:359] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.149732 27458 raft_consensus.cc:385] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.150074 27458 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.150856 27458 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.152964 27458 ts_tablet_manager.cc:1434] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:32.155913 27458 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:32.163093 27458 tablet_bootstrap.cc:654] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:32.175696 27214 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:32.178719 27458 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:32.179296 27458 ts_tablet_manager.cc:1403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.010s
I20260709 13:08:32.181995 27458 raft_consensus.cc:359] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.182570 27458 raft_consensus.cc:385] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.182780 27458 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.183400 27458 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.185158 27458 ts_tablet_manager.cc:1434] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:32.186405 27458 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Bootstrap starting.
I20260709 13:08:32.191614 27458 tablet_bootstrap.cc:654] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:32.196241 27458 tablet_bootstrap.cc:492] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: No bootstrap required, opened a new log
I20260709 13:08:32.196666 27458 ts_tablet_manager.cc:1403] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:32.198930 27458 raft_consensus.cc:359] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.199471 27458 raft_consensus.cc:385] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:32.199669 27458 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Initialized, Role: FOLLOWER
I20260709 13:08:32.200264 27458 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.201826 27458 ts_tablet_manager.cc:1434] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:32.203465 27335 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.211506 27935 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.227809 27464 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.313005 27802 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.313581 27802 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.315331 27802 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:32.316035 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:32.317188 27261 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:32.317184 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:32.318626 27412 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 1: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:08:32.319593 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:32.320387 27802 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.325822 27802 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:32.449126 27901 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.458082 27340 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.465171 27935 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.481519 27464 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.495319 27704 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:32.574632 27935 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.575090 27935 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.576915 27935 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:32.577666 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:32.578186 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:32.578372 27268 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:32.578893 27335 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 0.
I20260709 13:08:32.579455 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:32.580282 27935 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:32.580624 27935 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.580921 27935 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.586118 27935 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.587906 27935 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:32.588634 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:32.588941 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:32.589219 27268 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.589484 27335 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:32.595461 27335 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:32.595484 27268 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:32.596396 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:32.597010 27935 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:32.597388 27935 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:32.598070 27935 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:32.610222 27164 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 0 to 1, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.086112 27877 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.086563 27877 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:33.088323 27877 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:33.089113 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:33.089249 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:33.089893 27414 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:33.089888 27340 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:33.091317 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:33.091938 27877 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:33.092208 27877 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.092555 27877 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.098956 27877 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:33.101532 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:33.102065 27340 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.101975 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:33.102665 27414 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.100975 27877 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:33.107277 27340 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:33.108176 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:33.108515 27414 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:33.108765 27877 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.109266 27877 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:33.110016 27877 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:33.116662 27704 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:33.120719 27164 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 0 to 2, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:33.140422 27935 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:33.645464 27413 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:33.646670 27877 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:33.652527 27335 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:33.659529 27955 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:34.355960 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:34.389845 27969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:34.389884 27970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:34.390874 27972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:34.394344 26158 server_base.cc:1061] running on GCE node
I20260709 13:08:34.396450 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:34.396670 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:34.396938 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602514396901 us; error 0 us; skew 500 ppm
I20260709 13:08:34.397511 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:34.400415 26158 webserver.cc:533] Webserver started at http://127.25.139.132:33107/ using document root <none> and password file <none>
I20260709 13:08:34.400928 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:34.401125 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:34.401463 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:34.402940 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-3-root/instance:
uuid: "b0e4232110db400d8f43fe2170c24c95"
format_stamp: "Formatted at 2026-07-09 13:08:34 on dist-test-slave-v5z2"
I20260709 13:08:34.408401 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:08:34.412223 27977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:34.413004 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:08:34.413341 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
uuid: "b0e4232110db400d8f43fe2170c24c95"
format_stamp: "Formatted at 2026-07-09 13:08:34 on dist-test-slave-v5z2"
I20260709 13:08:34.413640 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:34.434705 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:34.436362 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:34.437875 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:34.440305 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:34.440537 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:34.440793 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:34.440992 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:34.499929 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.132:42123
I20260709 13:08:34.500042 28039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.132:42123 every 8 connection(s)
I20260709 13:08:34.504892 26158 auto_leader_rebalancer-test.cc:384] add a tserver: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:34.520697 28040 heartbeater.cc:344] Connected to a master server at 127.25.139.190:43657
I20260709 13:08:34.521270 28040 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:34.522251 28040 heartbeater.cc:507] Master 127.25.139.190:43657 requested a full tablet report, sending...
I20260709 13:08:34.524842 27163 ts_manager.cc:194] Registered new tserver with Master: b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:34.526743 27163 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55118
I20260709 13:08:35.375753 27413 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:35.382424 27261 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.384076 27335 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.384007 28044 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.385572 27935 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.404696 27464 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:08:35.406739 27380 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83dcb012538c4a0eb307834fbfd9752a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:35.406134 27261 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.410094 27335 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.426414 27163 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.460191 27335 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:35.470914 27413 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.471879 27261 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.472386 27954 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.473557 27837 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.481459 27954 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.483729 27413 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.500380 27164 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.501540 27413 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:08:35.509192 27306 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0287d5309a46494ca6fc1acd716c9c17. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:35.514626 27261 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:08:35.520560 27380 consensus_peers.cc:597] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5b64b3a0d3c44ff1893b67152ebe2c50. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:35.522692 27260 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.525645 27935 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.526222 27335 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.527740 27464 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:35.529831 28040 heartbeater.cc:499] Master 127.25.139.190:43657 was elected leader, sending a full tablet report...
I20260709 13:08:35.548142 27464 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.549809 27268 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.551609 27340 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.569845 27163 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.602139 27268 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:35.621644 27413 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.623673 28069 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:35.626734 27340 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:35.629643 27955 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:35.643312 27231 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 189d9bcac7d24abe800257c915b738c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:35.644085 27955 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.646035 27412 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.646718 27341 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:35.661399 27166 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.863718 28073 ts_tablet_manager.cc:933] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:35.880128 28073 tablet_copy_client.cc:323] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:35.900815 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet 0287d5309a46494ca6fc1acd716c9c17 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:35.901342 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet 0287d5309a46494ca6fc1acd716c9c17 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-0287d5309a46494ca6fc1acd716c9c17
I20260709 13:08:35.909405 27353 tablet_copy_source_session.cc:215] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:35.913425 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287d5309a46494ca6fc1acd716c9c17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.925704 28073 tablet_copy_client.cc:806] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:35.926396 28073 tablet_copy_client.cc:670] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:35.930711 28073 tablet_copy_client.cc:538] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:35.937844 28073 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:35.960851 28073 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:35.961688 28073 tablet_bootstrap.cc:492] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:35.962296 28073 ts_tablet_manager.cc:1403] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:08:35.964726 28073 raft_consensus.cc:359] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:35.965605 28073 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:35.966225 28073 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:35.970510 28073 ts_tablet_manager.cc:1434] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:08:35.972677 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-0287d5309a46494ca6fc1acd716c9c17 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:35.973188 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-0287d5309a46494ca6fc1acd716c9c17 on tablet 0287d5309a46494ca6fc1acd716c9c17 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:35.980315 28073 ts_tablet_manager.cc:933] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:35.996862 28079 ts_tablet_manager.cc:933] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:36.000121 28073 tablet_copy_client.cc:323] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:36.004612 28079 tablet_copy_client.cc:323] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:36.017215 27427 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:36.017472 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 83dcb012538c4a0eb307834fbfd9752a from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:36.017915 27427 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 5b64b3a0d3c44ff1893b67152ebe2c50 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-5b64b3a0d3c44ff1893b67152ebe2c50
I20260709 13:08:36.018738 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 83dcb012538c4a0eb307834fbfd9752a from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-83dcb012538c4a0eb307834fbfd9752a
I20260709 13:08:36.026643 27427 tablet_copy_source_session.cc:215] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:36.030627 28073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b64b3a0d3c44ff1893b67152ebe2c50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:36.034312 27426 tablet_copy_source_session.cc:215] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:36.038023 28079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dcb012538c4a0eb307834fbfd9752a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:36.045838 28073 tablet_copy_client.cc:806] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:36.046505 28073 tablet_copy_client.cc:670] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:36.052556 28073 tablet_copy_client.cc:538] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:36.056629 28079 tablet_copy_client.cc:806] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:36.057420 28079 tablet_copy_client.cc:670] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:36.060819 28073 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:36.068079 28079 tablet_copy_client.cc:538] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:36.081225 28079 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:36.090119 28078 ts_tablet_manager.cc:933] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:36.091756 28073 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.092945 28073 tablet_bootstrap.cc:492] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:36.093776 28073 ts_tablet_manager.cc:1403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.014s
I20260709 13:08:36.098347 28073 raft_consensus.cc:359] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.099407 28073 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:36.100194 28073 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.103717 28073 ts_tablet_manager.cc:1434] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:08:36.106881 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-5b64b3a0d3c44ff1893b67152ebe2c50 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:36.107354 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-5b64b3a0d3c44ff1893b67152ebe2c50 on tablet 5b64b3a0d3c44ff1893b67152ebe2c50 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:36.118755 28078 tablet_copy_client.cc:323] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:36.154178 28079 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.155280 28079 tablet_bootstrap.cc:492] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:36.156387 28079 ts_tablet_manager.cc:1403] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.075s	user 0.023s	sys 0.004s
I20260709 13:08:36.202888 28079 raft_consensus.cc:359] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.203825 28079 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:36.204357 28079 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.206138 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet 189d9bcac7d24abe800257c915b738c7 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:36.206785 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet 189d9bcac7d24abe800257c915b738c7 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-189d9bcac7d24abe800257c915b738c7
I20260709 13:08:36.207620 28079 ts_tablet_manager.cc:1434] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.020s
I20260709 13:08:36.246160 27278 tablet_copy_source_session.cc:215] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:36.248533 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-83dcb012538c4a0eb307834fbfd9752a received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:36.249022 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-83dcb012538c4a0eb307834fbfd9752a on tablet 83dcb012538c4a0eb307834fbfd9752a with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:36.253297 28078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 189d9bcac7d24abe800257c915b738c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:36.270776 28078 tablet_copy_client.cc:806] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:36.271878 28078 tablet_copy_client.cc:670] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:36.275934 28078 tablet_copy_client.cc:538] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:36.286031 28078 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:36.361181 28014 raft_consensus.cc:1217] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.391381 28078 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:36.392678 28078 tablet_bootstrap.cc:492] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:36.393705 28078 ts_tablet_manager.cc:1403] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.108s	user 0.027s	sys 0.008s
I20260709 13:08:36.407995 28014 raft_consensus.cc:1217] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.444216 28078 raft_consensus.cc:359] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.446091 28078 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:36.446918 28078 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:36.457954 28078 ts_tablet_manager.cc:1434] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.002s
I20260709 13:08:36.492110 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-189d9bcac7d24abe800257c915b738c7 received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:36.495482 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-189d9bcac7d24abe800257c915b738c7 on tablet 189d9bcac7d24abe800257c915b738c7 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:36.567710 28014 raft_consensus.cc:1217] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.621395 28014 raft_consensus.cc:1217] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:36.814383 27464 raft_consensus.cc:1064] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:36.819706 27464 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:36.844779 28014 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.844921 27335 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.846292 27935 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.847278 28088 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.849866 27260 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.853216 28089 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.865061 28088 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:36.871310 28014 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:36.878523 27268 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:36.884681 27336 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:36.920157 28091 raft_consensus.cc:1064] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:36.922653 28091 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:36.922585 27163 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.948347 27413 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.950893 28062 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:36.954790 28014 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:36.957549 28062 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:36.992128 27268 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.038213 28062 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.040082 28091 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.041896 27413 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.050540 27412 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.061532 28014 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.068190 27335 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.069655 28088 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.071799 27165 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.069815 28015 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.079754 27464 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.080622 27804 raft_consensus.cc:1064] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:37.081748 27935 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.083091 27804 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.090104 27268 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.103240 27335 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.136754 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:37.143564 27464 raft_consensus.cc:1064] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:37.146773 28015 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.148864 28092 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.143595 28014 raft_consensus.cc:2955] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.158654 27166 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.162572 27412 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.164376 27336 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.168876 28069 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.178238 28069 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.180838 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet 5b64b3a0d3c44ff1893b67152ebe2c50 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:37.204818 28114 tablet_replica.cc:333] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:37.206270 28114 raft_consensus.cc:2243] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.146492 27464 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.208958 28094 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.212792 27335 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.237221 28114 raft_consensus.cc:2272] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.229255 28015 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.258505 27164 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.264139 27412 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.287711 28114 ts_tablet_manager.cc:1916] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.313598 28015 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.314792 28114 ts_tablet_manager.cc:1929] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.315477 28114 log.cc:1199] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/5b64b3a0d3c44ff1893b67152ebe2c50
I20260709 13:08:37.317272 27339 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.317211 27464 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.318925 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet 5b64b3a0d3c44ff1893b67152ebe2c50 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:37.321873 28089 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.335958 27261 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:37.343470 27261 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.346092 28089 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.349576 27464 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.357528 28014 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.356380 28015 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.359814 28092 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:37.364295 27339 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.376749 27804 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.375145 27164 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.380777 28094 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.386493 27268 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.390774 27339 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.410835 27335 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.420953 27412 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.421113 28015 raft_consensus.cc:2955] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.434238 28014 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.436661 28089 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:37.437160 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 189d9bcac7d24abe800257c915b738c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:37.452287 27268 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.455395 27165 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.459787 28089 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.461205 28111 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:37.467869 28015 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.472381 27268 raft_consensus.cc:2955] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.481003 27163 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.488354 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83dcb012538c4a0eb307834fbfd9752a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:37.494179 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 83dcb012538c4a0eb307834fbfd9752a with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:37.517714 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet 189d9bcac7d24abe800257c915b738c7 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:37.524631 28121 tablet_replica.cc:333] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:37.526244 28121 raft_consensus.cc:2243] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.527069 28121 raft_consensus.cc:2272] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.529002 28120 tablet_replica.cc:333] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:37.532089 28121 ts_tablet_manager.cc:1916] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.536185 28120 raft_consensus.cc:2243] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.536955 28120 raft_consensus.cc:2272] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.543409 28120 ts_tablet_manager.cc:1916] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.554190 28121 ts_tablet_manager.cc:1929] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.554768 28121 log.cc:1199] T 189d9bcac7d24abe800257c915b738c7 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/189d9bcac7d24abe800257c915b738c7
I20260709 13:08:37.563287 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet 189d9bcac7d24abe800257c915b738c7 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:37.568624 28120 ts_tablet_manager.cc:1929] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.569221 28120 log.cc:1199] T 83dcb012538c4a0eb307834fbfd9752a P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/83dcb012538c4a0eb307834fbfd9752a
I20260709 13:08:37.571557 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 83dcb012538c4a0eb307834fbfd9752a (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:37.624861 27338 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:37.629709 28015 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.629788 27268 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:37.631179 28102 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:37.632998 28102 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:37.639281 28015 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.643215 27268 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.637550 28102 raft_consensus.cc:2955] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.653326 27164 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:37.655292 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0287d5309a46494ca6fc1acd716c9c17 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:37.672995 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet 0287d5309a46494ca6fc1acd716c9c17 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:37.673944 28121 tablet_replica.cc:333] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:37.675016 28121 raft_consensus.cc:2243] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:37.675830 28121 raft_consensus.cc:2272] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:37.681593 28121 ts_tablet_manager.cc:1916] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:37.700975 28121 ts_tablet_manager.cc:1929] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:37.701385 28121 log.cc:1199] T 0287d5309a46494ca6fc1acd716c9c17 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/0287d5309a46494ca6fc1acd716c9c17
I20260709 13:08:37.702869 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet 0287d5309a46494ca6fc1acd716c9c17 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:38.738824 27412 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:38.745326 27339 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:38.745613 27380 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a2fa29e3bcf4670ab310ce67ee127c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.746742 27261 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.746578 28087 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.748150 28089 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.758462 28087 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.760713 27339 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.771891 27339 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:38.775036 27164 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.766077 27261 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.782131 27268 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:38.785416 27306 consensus_peers.cc:597] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05efe4ee1469496f84eca86709a6b478. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.788210 28124 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:38.783625 27412 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.793386 28131 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.809363 28131 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.811350 27412 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.825852 27339 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:38.826669 27260 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:08:38.834369 27306 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfbd4344db4a4ffb8868b58ddc53af83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.838141 27261 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.839844 28124 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.841804 27412 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.844305 28124 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.859259 27165 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.879383 28131 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.884307 27413 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.884307 27261 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.912410 27164 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.920460 27335 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:08:38.931874 27306 consensus_peers.cc:597] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d07722edbe05448eaa1edebf1ce562cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.937181 27261 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.937188 27413 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:38.939074 28131 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.939965 28124 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:38.951869 28124 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.954979 27413 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.960984 27261 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:38.969587 27163 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:39.221297 28144 ts_tablet_manager.cc:933] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:39.223984 28144 tablet_copy_client.cc:323] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:39.226779 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet cfbd4344db4a4ffb8868b58ddc53af83 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:39.227470 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet cfbd4344db4a4ffb8868b58ddc53af83 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-cfbd4344db4a4ffb8868b58ddc53af83
I20260709 13:08:39.235661 27353 tablet_copy_source_session.cc:215] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.240099 28144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfbd4344db4a4ffb8868b58ddc53af83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.251653 28146 ts_tablet_manager.cc:933] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:39.253818 28146 tablet_copy_client.cc:323] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:39.255754 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet 05efe4ee1469496f84eca86709a6b478 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:39.256390 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet 05efe4ee1469496f84eca86709a6b478 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-05efe4ee1469496f84eca86709a6b478
I20260709 13:08:39.264932 27353 tablet_copy_source_session.cc:215] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.264039 28144 tablet_copy_client.cc:806] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:39.268111 28144 tablet_copy_client.cc:670] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:39.272584 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05efe4ee1469496f84eca86709a6b478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.275833 28144 tablet_copy_client.cc:538] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:39.285254 28144 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:39.293188 28146 tablet_copy_client.cc:806] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:39.293874 28146 tablet_copy_client.cc:670] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:39.298133 28146 tablet_copy_client.cc:538] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:39.308601 28146 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:39.316185 28149 ts_tablet_manager.cc:933] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:39.319152 28144 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.320166 28144 tablet_bootstrap.cc:492] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:39.320922 28144 ts_tablet_manager.cc:1403] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.005s
I20260709 13:08:39.324218 28144 raft_consensus.cc:359] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.325122 28144 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:39.325868 28144 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.339110 28144 ts_tablet_manager.cc:1434] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:08:39.342320 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-cfbd4344db4a4ffb8868b58ddc53af83 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:39.342857 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-cfbd4344db4a4ffb8868b58ddc53af83 on tablet cfbd4344db4a4ffb8868b58ddc53af83 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:39.352454 28146 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.353492 28146 tablet_bootstrap.cc:492] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:39.354272 28146 ts_tablet_manager.cc:1403] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.012s
I20260709 13:08:39.357283 28146 raft_consensus.cc:359] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.358188 28146 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:39.358918 28146 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.361380 28146 ts_tablet_manager.cc:1434] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:39.363155 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-05efe4ee1469496f84eca86709a6b478 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:39.363649 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-05efe4ee1469496f84eca86709a6b478 on tablet 05efe4ee1469496f84eca86709a6b478 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:39.369732 28149 tablet_copy_client.cc:323] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:39.371459 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet d07722edbe05448eaa1edebf1ce562cd from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:39.372022 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet d07722edbe05448eaa1edebf1ce562cd from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-d07722edbe05448eaa1edebf1ce562cd
I20260709 13:08:39.381381 27353 tablet_copy_source_session.cc:215] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.385347 28149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07722edbe05448eaa1edebf1ce562cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.382026 28146 ts_tablet_manager.cc:933] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:39.402114 28146 tablet_copy_client.cc:323] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:39.404366 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:39.405001 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 1a2fa29e3bcf4670ab310ce67ee127c4 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-1a2fa29e3bcf4670ab310ce67ee127c4
I20260709 13:08:39.407217 28149 tablet_copy_client.cc:806] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:39.407876 28149 tablet_copy_client.cc:670] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:39.411818 28149 tablet_copy_client.cc:538] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:39.415627 27426 tablet_copy_source_session.cc:215] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.419585 28146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2fa29e3bcf4670ab310ce67ee127c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.422195 28149 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:39.439810 28146 tablet_copy_client.cc:806] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:39.440919 28146 tablet_copy_client.cc:670] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:39.448175 28146 tablet_copy_client.cc:538] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:39.462311 28146 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:39.493468 28149 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.494527 28149 tablet_bootstrap.cc:492] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:39.494575 28146 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:39.495921 28149 ts_tablet_manager.cc:1403] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.019s
I20260709 13:08:39.496140 28146 tablet_bootstrap.cc:492] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:39.496980 28146 ts_tablet_manager.cc:1403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.000s
I20260709 13:08:39.500486 28149 raft_consensus.cc:359] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.502617 28149 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:39.503758 28149 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.504231 28146 raft_consensus.cc:359] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.507475 28149 ts_tablet_manager.cc:1434] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:08:39.505239 28146 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:39.509542 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-d07722edbe05448eaa1edebf1ce562cd received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:39.509934 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-d07722edbe05448eaa1edebf1ce562cd on tablet d07722edbe05448eaa1edebf1ce562cd with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:39.509968 28146 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:39.512446 28146 ts_tablet_manager.cc:1434] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:08:39.514503 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-1a2fa29e3bcf4670ab310ce67ee127c4 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:39.514938 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-1a2fa29e3bcf4670ab310ce67ee127c4 on tablet 1a2fa29e3bcf4670ab310ce67ee127c4 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:39.604899 28015 raft_consensus.cc:1217] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:39.735129 28015 raft_consensus.cc:1217] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:39.827193 28015 raft_consensus.cc:1217] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:39.852768 28015 raft_consensus.cc:1217] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:40.103626 28091 raft_consensus.cc:1064] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:40.107723 28091 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.116466 28015 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.116456 27416 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.118144 28091 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.119572 27260 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.120090 28131 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.123982 28124 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.142402 28091 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.144652 27416 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.148592 27260 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.155308 28015 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.161290 27164 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.205070 27335 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.213065 28015 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.213452 27261 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.214933 28091 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.215894 28124 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.222343 28124 raft_consensus.cc:1064] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:40.226298 28124 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.229188 28131 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.230880 28015 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.232587 27260 raft_consensus.cc:2955] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.248750 28091 raft_consensus.cc:1064] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:40.253167 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfbd4344db4a4ffb8868b58ddc53af83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.266026 28091 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.255396 27163 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.268486 28014 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.272343 28167 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.289887 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet cfbd4344db4a4ffb8868b58ddc53af83 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:40.301937 28014 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.303782 27416 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.303905 28166 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:40.308055 28172 tablet_replica.cc:333] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:40.313454 28172 raft_consensus.cc:2243] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.314246 28172 raft_consensus.cc:2272] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.316716 27416 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.319489 28124 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.321141 27260 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.325824 28131 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.326916 28172 ts_tablet_manager.cc:1916] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:40.334685 28091 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.338723 27261 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.338610 28167 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.339866 27412 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.344820 28169 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:40.357607 28015 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.383661 27161 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.390725 28169 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.401818 27416 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.405809 27339 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.416062 28172 ts_tablet_manager.cc:1929] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:40.416620 28172 log.cc:1199] T cfbd4344db4a4ffb8868b58ddc53af83 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/cfbd4344db4a4ffb8868b58ddc53af83
I20260709 13:08:40.419935 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet cfbd4344db4a4ffb8868b58ddc53af83 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:40.421126 28015 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.417974 27268 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.424809 28124 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.424194 27163 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.430784 28152 raft_consensus.cc:1064] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:40.436318 28015 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.447576 28167 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.448971 27339 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.452901 28014 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.458345 27412 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.460582 27416 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.462102 28170 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:40.462960 28124 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.433894 28152 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.476573 27412 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.477360 28169 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.485955 27416 raft_consensus.cc:2955] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.505811 27163 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.527315 27268 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.529188 28013 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:08:40.532145 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68353.5us
I20260709 13:08:40.533437 28170 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.535483 28013 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.534989 27161 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.538480 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d07722edbe05448eaa1edebf1ce562cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.529160 28152 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:08:40.544638 27341 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:40.546602 28013 raft_consensus.cc:2955] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.550104 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05efe4ee1469496f84eca86709a6b478 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.554111 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet 05efe4ee1469496f84eca86709a6b478 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:40.565904 28089 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.576948 28152 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.581893 27252 tablet_service.cc:1558] Processing DeleteTablet for tablet d07722edbe05448eaa1edebf1ce562cd with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:40.585414 28181 tablet_replica.cc:333] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:40.587626 28181 raft_consensus.cc:2243] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.588234 28181 pending_rounds.cc:70] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Trying to abort 1 pending ops.
I20260709 13:08:40.588591 28181 pending_rounds.cc:77] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635922839228416 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "05efe4ee1469496f84eca86709a6b478" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } } }
I20260709 13:08:40.590390 28181 raft_consensus.cc:2917] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:08:40.590866 28181 raft_consensus.cc:2889] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:40.591655 28181 raft_consensus.cc:2272] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.599536 28181 ts_tablet_manager.cc:1916] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:40.620000 28089 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.632676 27268 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.638722 27341 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.640131 28014 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.659746 28181 ts_tablet_manager.cc:1929] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:40.660307 28181 log.cc:1199] T 05efe4ee1469496f84eca86709a6b478 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/05efe4ee1469496f84eca86709a6b478
I20260709 13:08:40.662593 28181 tablet_replica.cc:333] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:40.663806 28181 raft_consensus.cc:2243] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.664680 28181 raft_consensus.cc:2272] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.667241 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet 05efe4ee1469496f84eca86709a6b478 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:40.667631 27165 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.671631 28181 ts_tablet_manager.cc:1916] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:40.684736 27416 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:40.692371 28181 ts_tablet_manager.cc:1929] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:40.693961 28181 log.cc:1199] T d07722edbe05448eaa1edebf1ce562cd P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/d07722edbe05448eaa1edebf1ce562cd
I20260709 13:08:40.696512 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet d07722edbe05448eaa1edebf1ce562cd (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:40.704782 28014 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.704869 27260 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:40.707197 28159 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:40.709062 28087 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.716081 28089 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.717687 28014 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.723017 27260 raft_consensus.cc:2955] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.727325 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:40.734516 27161 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:40.749970 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a2fa29e3bcf4670ab310ce67ee127c4 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:40.764209 28185 tablet_replica.cc:333] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:40.771026 28185 raft_consensus.cc:2243] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.771855 28185 raft_consensus.cc:2272] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.776196 28185 ts_tablet_manager.cc:1916] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:40.787600 28185 ts_tablet_manager.cc:1929] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:40.787979 28185 log.cc:1199] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/1a2fa29e3bcf4670ab310ce67ee127c4
I20260709 13:08:40.789486 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 1a2fa29e3bcf4670ab310ce67ee127c4 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:41.831468 27414 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:08:41.839187 27380 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ea7b8babc1b46fbad021d233647b834. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.840950 27260 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.840951 27341 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.842449 28186 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.843647 28087 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.853003 27339 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.853924 27260 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.852056 28189 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.869190 27164 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.879472 27416 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:41.886444 27339 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:41.886888 27380 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f872873b55df4f2ab953481b0bbe5229. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.888034 28189 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.889467 27260 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.890909 28189 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:41.896548 28189 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.906836 27339 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.909722 27268 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:41.934459 27163 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.941293 27416 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.942812 27335 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.942759 28092 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:41.944432 27231 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a44de1887e445a5b020fd0cbae6a5a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.945727 28092 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:41.954344 28094 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.960260 27260 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.958546 27416 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.967763 27335 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:41.968501 27268 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:41.979326 27161 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:41.987361 27231 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1a9f1b01ac8406691c2d1c83b5dcca0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.988601 27414 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.989568 27335 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:41.990748 28203 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:08:41.999133 28092 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:42.014036 28092 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:42.014971 27414 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:42.019882 27338 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:42.031531 27161 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:42.454452 28208 ts_tablet_manager.cc:933] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:42.456194 28208 tablet_copy_client.cc:323] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:42.457829 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 2ea7b8babc1b46fbad021d233647b834 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:42.458305 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 2ea7b8babc1b46fbad021d233647b834 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-2ea7b8babc1b46fbad021d233647b834
I20260709 13:08:42.466818 27426 tablet_copy_source_session.cc:215] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:42.475543 28208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7b8babc1b46fbad021d233647b834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.492484 28208 tablet_copy_client.cc:806] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:42.493139 28208 tablet_copy_client.cc:670] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.493772 28210 ts_tablet_manager.cc:933] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:42.495797 28210 tablet_copy_client.cc:323] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:42.497262 28208 tablet_copy_client.cc:538] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:42.497227 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet f872873b55df4f2ab953481b0bbe5229 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:42.497926 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet f872873b55df4f2ab953481b0bbe5229 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-f872873b55df4f2ab953481b0bbe5229
I20260709 13:08:42.503706 28208 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:42.506131 27426 tablet_copy_source_session.cc:215] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:42.509583 28210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f872873b55df4f2ab953481b0bbe5229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.535079 28210 tablet_copy_client.cc:806] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:42.535683 28210 tablet_copy_client.cc:670] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.541914 28210 tablet_copy_client.cc:538] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:42.543460 28212 ts_tablet_manager.cc:933] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:42.546499 28208 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.548135 28208 tablet_bootstrap.cc:492] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:42.549257 28208 ts_tablet_manager.cc:1403] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.009s
I20260709 13:08:42.553251 28210 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:42.552829 28208 raft_consensus.cc:359] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.553689 28208 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:42.555276 28208 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.564075 28212 tablet_copy_client.cc:323] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:42.565785 28208 ts_tablet_manager.cc:1434] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:08:42.569927 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet 0a44de1887e445a5b020fd0cbae6a5a3 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:42.570528 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet 0a44de1887e445a5b020fd0cbae6a5a3 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-0a44de1887e445a5b020fd0cbae6a5a3
I20260709 13:08:42.570852 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-2ea7b8babc1b46fbad021d233647b834 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:42.571376 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-2ea7b8babc1b46fbad021d233647b834 on tablet 2ea7b8babc1b46fbad021d233647b834 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:42.584674 28208 ts_tablet_manager.cc:933] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:42.585542 27278 tablet_copy_source_session.cc:215] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:42.588047 28208 tablet_copy_client.cc:323] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:42.589262 28212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a44de1887e445a5b020fd0cbae6a5a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.592315 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:42.592916 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet d1a9f1b01ac8406691c2d1c83b5dcca0 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-d1a9f1b01ac8406691c2d1c83b5dcca0
I20260709 13:08:42.597992 28210 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.598908 28210 tablet_bootstrap.cc:492] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:42.599795 28210 ts_tablet_manager.cc:1403] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.010s
I20260709 13:08:42.602425 27278 tablet_copy_source_session.cc:215] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:42.608006 28208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a9f1b01ac8406691c2d1c83b5dcca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:42.618028 28210 raft_consensus.cc:359] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.619124 28210 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:42.619946 28210 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.632089 28210 ts_tablet_manager.cc:1434] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
I20260709 13:08:42.635059 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-f872873b55df4f2ab953481b0bbe5229 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:42.635574 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-f872873b55df4f2ab953481b0bbe5229 on tablet f872873b55df4f2ab953481b0bbe5229 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:42.636037 28208 tablet_copy_client.cc:806] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:42.636667 28208 tablet_copy_client.cc:670] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.639127 28212 tablet_copy_client.cc:806] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:42.639837 28212 tablet_copy_client.cc:670] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:42.642431 28208 tablet_copy_client.cc:538] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:42.643623 28212 tablet_copy_client.cc:538] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:42.653164 28212 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:42.654228 28208 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:42.677481 28212 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.678381 28212 tablet_bootstrap.cc:492] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:42.679068 28212 ts_tablet_manager.cc:1403] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.012s
I20260709 13:08:42.681998 28212 raft_consensus.cc:359] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.682627 28212 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:42.682837 28208 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:42.683212 28212 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.684520 28208 tablet_bootstrap.cc:492] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:42.685258 28208 ts_tablet_manager.cc:1403] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.005s
I20260709 13:08:42.685818 28212 ts_tablet_manager.cc:1434] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:42.688422 28208 raft_consensus.cc:359] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.689405 28208 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:42.691531 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-0a44de1887e445a5b020fd0cbae6a5a3 received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:42.691874 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-0a44de1887e445a5b020fd0cbae6a5a3 on tablet 0a44de1887e445a5b020fd0cbae6a5a3 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:42.690104 28208 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:42.697045 28208 ts_tablet_manager.cc:1434] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:08:42.699723 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-d1a9f1b01ac8406691c2d1c83b5dcca0 received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:42.700117 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-d1a9f1b01ac8406691c2d1c83b5dcca0 on tablet d1a9f1b01ac8406691c2d1c83b5dcca0 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:42.881786 28013 raft_consensus.cc:1217] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:42.899801 28013 raft_consensus.cc:1217] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:42.921015 28013 raft_consensus.cc:1217] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:43.069933 28013 raft_consensus.cc:1217] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:43.365576 28223 raft_consensus.cc:1064] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:43.368234 28223 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.377315 28013 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.377488 27335 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.378942 27268 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.379276 28223 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.381129 28189 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.386901 28222 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.399796 28221 raft_consensus.cc:1064] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:43.401327 28189 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.402597 28221 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.417120 27335 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.418404 27416 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.420583 28220 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.426525 27339 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.428009 28221 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:43.433302 27164 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.433566 27268 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.434860 28013 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.464078 28014 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.466180 28207 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.470922 28189 raft_consensus.cc:1064] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:43.473770 28189 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.499790 28221 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.510003 27414 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.512693 27260 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.516304 28014 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.518297 27338 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.506819 27416 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.527508 28223 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.530699 28237 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.523406 27164 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.521281 28013 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.559409 28223 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.575294 28015 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.576928 28237 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.578126 27341 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.584640 28237 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.587734 28015 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.595132 27262 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.596575 28207 raft_consensus.cc:1064] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:43.605014 28207 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.619665 28231 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:43.620494 28223 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:08:43.623449 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 103419us
I20260709 13:08:43.641160 27260 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.641224 27262 raft_consensus.cc:2955] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.644279 27163 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.656733 28012 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.659227 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ea7b8babc1b46fbad021d233647b834 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:43.659875 28092 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.663213 27412 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.672858 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ea7b8babc1b46fbad021d233647b834 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:43.674894 27412 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.676928 28015 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.678654 28241 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.696578 27339 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:43.699399 28240 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.699347 28207 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:43.708411 28240 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:43.718725 28240 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.721979 28014 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.731748 27335 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.718756 28246 tablet_replica.cc:333] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:43.734368 28015 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.739374 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a44de1887e445a5b020fd0cbae6a5a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:43.761690 27164 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.785616 27262 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:08:43.828505 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54814us
W20260709 13:08:43.833112 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48705.5us
I20260709 13:08:43.858259 28207 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.860894 27414 raft_consensus.cc:2955] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.878057 27161 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.885958 27412 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.898473 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a44de1887e445a5b020fd0cbae6a5a3 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:43.901885 27335 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.902966 28015 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.904000 28014 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.905099 27412 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.906843 28231 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.908213 27338 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.928007 27163 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.918408 28249 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:08:43.947813 28237 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.958210 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f872873b55df4f2ab953481b0bbe5229 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:43.957304 28014 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.964627 27335 raft_consensus.cc:2955] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.970136 27260 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:43.976974 28014 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.978166 28241 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.982646 27338 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:43.985499 27164 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:43.987244 28207 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.994369 28246 raft_consensus.cc:2243] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:43.995096 28246 raft_consensus.cc:2272] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:43.996109 28220 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:44.001368 28246 ts_tablet_manager.cc:1916] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.001852 27338 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:44.006151 28014 raft_consensus.cc:2955] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:44.007324 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:44.013738 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet f872873b55df4f2ab953481b0bbe5229 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:44.016361 28256 tablet_replica.cc:333] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:44.017364 28256 raft_consensus.cc:2243] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:44.018195 28256 raft_consensus.cc:2272] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:44.021739 28256 ts_tablet_manager.cc:1916] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.038352 27163 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:44.043645 28246 ts_tablet_manager.cc:1929] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:44.044135 28246 log.cc:1199] T 2ea7b8babc1b46fbad021d233647b834 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/2ea7b8babc1b46fbad021d233647b834
I20260709 13:08:44.045723 28246 tablet_replica.cc:333] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:44.047631 28246 raft_consensus.cc:2243] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:44.047757 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 2ea7b8babc1b46fbad021d233647b834 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:44.048266 28246 raft_consensus.cc:2272] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:44.048569 28256 ts_tablet_manager.cc:1929] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:44.049064 28256 log.cc:1199] T f872873b55df4f2ab953481b0bbe5229 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/f872873b55df4f2ab953481b0bbe5229
I20260709 13:08:44.051512 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet f872873b55df4f2ab953481b0bbe5229 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:44.052817 28246 ts_tablet_manager.cc:1916] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.056816 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet d1a9f1b01ac8406691c2d1c83b5dcca0 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:44.066439 28257 tablet_replica.cc:333] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:44.067675 28257 raft_consensus.cc:2243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:44.069361 28257 raft_consensus.cc:2272] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:44.074888 28257 ts_tablet_manager.cc:1916] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.077593 28246 ts_tablet_manager.cc:1929] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:44.077989 28246 log.cc:1199] T 0a44de1887e445a5b020fd0cbae6a5a3 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/0a44de1887e445a5b020fd0cbae6a5a3
I20260709 13:08:44.079224 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 0a44de1887e445a5b020fd0cbae6a5a3 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:44.087844 28257 ts_tablet_manager.cc:1929] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:44.088279 28257 log.cc:1199] T d1a9f1b01ac8406691c2d1c83b5dcca0 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/d1a9f1b01ac8406691c2d1c83b5dcca0
I20260709 13:08:44.089681 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet d1a9f1b01ac8406691c2d1c83b5dcca0 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:45.127657 27414 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.1, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.134554 27335 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:45.134923 27380 consensus_peers.cc:597] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f07af3920db4e9da19de0ec4eba7c75. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.134562 27260 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:45.136317 28249 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.137204 28237 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.145275 28237 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Committing config change with OpId 3.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.149102 27335 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Committing config change with OpId 3.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.157371 27264 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Committing config change with OpId 3.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.163586 27163 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.169548 27260 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.181995 27335 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:45.182055 27231 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf4fb4f20e74427f86180930e86a7afc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.183456 27414 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:45.183792 28241 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.185132 28207 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.196002 28207 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.197662 27335 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.212823 27260 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.228492 27412 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.226200 27165 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.243017 27412 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:45.243005 27231 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b390ed75f2f14d258d4cdff9c656d787. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.245455 27335 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:45.245095 28241 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:45.247792 28270 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.260057 28271 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.263384 27338 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.264060 27412 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.277238 27414 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.296278 27164 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.300704 27260 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:45.300798 27380 consensus_peers.cc:597] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbda0aef93534e40827c2bc13b826560. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.302055 28231 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.302906 27338 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:45.304663 28231 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:45.325346 28231 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.327142 27260 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.328141 27338 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:45.348836 27164 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.590881 28279 ts_tablet_manager.cc:933] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:45.598518 28279 tablet_copy_client.cc:323] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:45.600234 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 0f07af3920db4e9da19de0ec4eba7c75 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:45.600773 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 0f07af3920db4e9da19de0ec4eba7c75 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-0f07af3920db4e9da19de0ec4eba7c75
I20260709 13:08:45.607498 27426 tablet_copy_source_session.cc:215] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.610077 28279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f07af3920db4e9da19de0ec4eba7c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.627588 28279 tablet_copy_client.cc:806] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.628197 28279 tablet_copy_client.cc:670] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.632823 28279 tablet_copy_client.cc:538] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.643297 28279 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:45.665891 28279 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.667330 28279 tablet_bootstrap.cc:492] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:45.668056 28279 ts_tablet_manager.cc:1403] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
I20260709 13:08:45.671207 28279 raft_consensus.cc:359] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.672147 28279 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:45.672855 28279 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.676440 28279 ts_tablet_manager.cc:1434] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:45.678566 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-0f07af3920db4e9da19de0ec4eba7c75 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:45.679060 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-0f07af3920db4e9da19de0ec4eba7c75 on tablet 0f07af3920db4e9da19de0ec4eba7c75 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:45.745687 28279 ts_tablet_manager.cc:933] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:45.754957 28279 tablet_copy_client.cc:323] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:45.756641 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet bf4fb4f20e74427f86180930e86a7afc from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:45.757149 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet bf4fb4f20e74427f86180930e86a7afc from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-bf4fb4f20e74427f86180930e86a7afc
I20260709 13:08:45.763345 27278 tablet_copy_source_session.cc:215] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.766113 28279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf4fb4f20e74427f86180930e86a7afc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.777722 28284 ts_tablet_manager.cc:933] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:45.779475 28284 tablet_copy_client.cc:323] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:45.780997 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet b390ed75f2f14d258d4cdff9c656d787 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:45.781433 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet b390ed75f2f14d258d4cdff9c656d787 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-b390ed75f2f14d258d4cdff9c656d787
I20260709 13:08:45.781611 28279 tablet_copy_client.cc:806] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.782423 28279 tablet_copy_client.cc:670] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.786319 28279 tablet_copy_client.cc:538] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.788340 27278 tablet_copy_source_session.cc:215] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.791518 28284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b390ed75f2f14d258d4cdff9c656d787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.794618 28279 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:45.809533 28284 tablet_copy_client.cc:806] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.810092 28284 tablet_copy_client.cc:670] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.816339 28284 tablet_copy_client.cc:538] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.825397 28287 ts_tablet_manager.cc:933] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:45.829604 28284 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:45.841403 28287 tablet_copy_client.cc:323] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:45.843483 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet fbda0aef93534e40827c2bc13b826560 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:45.844041 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet fbda0aef93534e40827c2bc13b826560 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-fbda0aef93534e40827c2bc13b826560
I20260709 13:08:45.875977 27426 tablet_copy_source_session.cc:215] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.880065 28279 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.880352 28287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbda0aef93534e40827c2bc13b826560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.880722 28284 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.881016 28279 tablet_bootstrap.cc:492] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:45.881578 28284 tablet_bootstrap.cc:492] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:45.881731 28279 ts_tablet_manager.cc:1403] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.014s
I20260709 13:08:45.882293 28284 ts_tablet_manager.cc:1403] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.012s
I20260709 13:08:45.885365 28284 raft_consensus.cc:359] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.886235 28284 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:45.886893 28284 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.896286 28284 ts_tablet_manager.cc:1434] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:08:45.898054 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-b390ed75f2f14d258d4cdff9c656d787 received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:45.898504 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-b390ed75f2f14d258d4cdff9c656d787 on tablet b390ed75f2f14d258d4cdff9c656d787 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:45.893649 28279 raft_consensus.cc:359] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.900777 28279 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:45.903966 28279 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:45.909703 28279 ts_tablet_manager.cc:1434] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:08:45.953919 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-bf4fb4f20e74427f86180930e86a7afc received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:45.954391 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-bf4fb4f20e74427f86180930e86a7afc on tablet bf4fb4f20e74427f86180930e86a7afc with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:45.962056 28287 tablet_copy_client.cc:806] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.962679 28287 tablet_copy_client.cc:670] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.971228 28287 tablet_copy_client.cc:538] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.982127 28287 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:45.998903 28287 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.999863 28287 tablet_bootstrap.cc:492] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:46.000514 28287 ts_tablet_manager.cc:1403] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.019s	user 0.019s	sys 0.000s
I20260709 13:08:46.003281 28287 raft_consensus.cc:359] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:46.003937 28287 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:46.004501 28287 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:46.006927 28287 ts_tablet_manager.cc:1434] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:46.008735 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-fbda0aef93534e40827c2bc13b826560 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:46.009181 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-fbda0aef93534e40827c2bc13b826560 on tablet fbda0aef93534e40827c2bc13b826560 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:46.166751 28014 raft_consensus.cc:1217] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 13:08:46.240643 28015 raft_consensus.cc:1217] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:46.308328 28015 raft_consensus.cc:1217] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:46.346661 28014 raft_consensus.cc:1217] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:08:46.418123 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53955.1us
W20260709 13:08:46.551324 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 61825.2us
W20260709 13:08:46.586750 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52722.1us
I20260709 13:08:46.731717 28231 raft_consensus.cc:1064] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:46.738801 28231 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 0, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:46.770850 28014 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:46.772433 27338 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:46.776130 27260 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:46.777709 28301 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.778801 28231 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.779887 28304 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.807668 28231 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:46.836306 28296 raft_consensus.cc:1064] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:46.837623 28015 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:46.840003 28261 raft_consensus.cc:1064] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:46.841954 27338 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:46.846975 28261 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:46.853420 27260 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:46.856005 28297 raft_consensus.cc:1064] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:46.859050 28297 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:46.840142 28296 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:46.892241 28014 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.894166 27414 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.896278 28271 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.897692 28241 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.900343 27339 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.902140 28014 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.904246 28241 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.902439 27164 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:46.908521 27416 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.910856 28298 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.921860 28271 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.932248 27339 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.936359 28241 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:46.952024 28011 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.954571 28302 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.960824 27336 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:46.964810 28304 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:46.990648 27263 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:47.009629 28297 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.011391 28015 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.011286 28296 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.022245 28261 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:47.027068 27413 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.025974 27414 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.050470 27338 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.051776 27335 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.053393 28015 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.069814 28304 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.074533 27340 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.075378 27260 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.085834 28015 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.122234 27416 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:47.124645 27165 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.126345 27165 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.127873 27165 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.134124 28015 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:47.133368 27335 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:47.135718 28237 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:47.137487 28303 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:47.158308 28302 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.161237 27335 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.187078 27268 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:47.193091 27335 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.193984 28014 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.196237 28296 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:47.208753 27416 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:47.208461 28014 raft_consensus.cc:2955] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.212911 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f07af3920db4e9da19de0ec4eba7c75 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.210393 27164 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.211911 28297 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:47.222606 28015 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.224258 28231 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:47.227416 27335 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.220664 28297 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.229054 28011 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.232121 28231 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:47.234838 28301 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.240581 27268 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:47.244328 28015 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.246733 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f07af3920db4e9da19de0ec4eba7c75 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:47.253621 27340 raft_consensus.cc:2955] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.279253 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fbda0aef93534e40827c2bc13b826560 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.278723 27163 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.268095 27416 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.297318 28014 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:47.308857 28326 tablet_replica.cc:333] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:47.309798 28270 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:08:47.322151 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf4fb4f20e74427f86180930e86a7afc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.321964 27338 raft_consensus.cc:2955] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.325192 28296 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:47.326265 28326 raft_consensus.cc:2243] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:47.327083 28326 raft_consensus.cc:2272] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:47.334010 28326 ts_tablet_manager.cc:1916] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:47.336992 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet bf4fb4f20e74427f86180930e86a7afc with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:47.338136 28298 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.347540 27416 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.361106 28327 tablet_replica.cc:333] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:47.362449 27164 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.362350 28327 raft_consensus.cc:2243] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:47.368289 28327 raft_consensus.cc:2272] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:47.377599 28327 ts_tablet_manager.cc:1916] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:47.378603 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b390ed75f2f14d258d4cdff9c656d787 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.390463 28011 raft_consensus.cc:2955] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:47.393359 27165 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.396175 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet fbda0aef93534e40827c2bc13b826560 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:47.377851 28326 ts_tablet_manager.cc:1929] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.3
I20260709 13:08:47.399490 28326 log.cc:1199] T 0f07af3920db4e9da19de0ec4eba7c75 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/0f07af3920db4e9da19de0ec4eba7c75
I20260709 13:08:47.401552 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet 0f07af3920db4e9da19de0ec4eba7c75 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:47.402122 28326 tablet_replica.cc:333] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:47.403370 28326 raft_consensus.cc:2243] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:47.404199 28326 raft_consensus.cc:2272] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:47.408846 28327 ts_tablet_manager.cc:1929] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:47.409376 28327 log.cc:1199] T bf4fb4f20e74427f86180930e86a7afc P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/bf4fb4f20e74427f86180930e86a7afc
I20260709 13:08:47.411293 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet bf4fb4f20e74427f86180930e86a7afc (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:47.412032 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet b390ed75f2f14d258d4cdff9c656d787 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:47.414078 28328 tablet_replica.cc:333] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:47.414624 28326 ts_tablet_manager.cc:1916] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:47.415349 28328 raft_consensus.cc:2243] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:47.416356 28328 raft_consensus.cc:2272] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:47.420298 28328 ts_tablet_manager.cc:1916] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:47.432701 28326 ts_tablet_manager.cc:1929] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:47.433171 28326 log.cc:1199] T fbda0aef93534e40827c2bc13b826560 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/fbda0aef93534e40827c2bc13b826560
I20260709 13:08:47.434806 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet fbda0aef93534e40827c2bc13b826560 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:47.443760 28328 ts_tablet_manager.cc:1929] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:47.444219 28328 log.cc:1199] T b390ed75f2f14d258d4cdff9c656d787 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/b390ed75f2f14d258d4cdff9c656d787
I20260709 13:08:47.445873 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet b390ed75f2f14d258d4cdff9c656d787 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:48.538656 27339 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:48.546214 27263 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:48.546159 27413 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:48.546706 27306 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21d14940356a45ada8e16731853b8769. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.547863 28300 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.548688 28294 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.557269 28300 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.559269 27413 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.561355 27263 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.573493 27414 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:48.577221 27164 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.594234 27339 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:48.594497 27380 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4841dcf8d05d4ecaa8771d888fc649c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.598773 28237 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.600607 27263 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.603291 28237 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.615443 27338 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.613153 28329 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.617350 27263 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.633219 27165 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.643641 27268 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:08:48.662528 27231 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 099c52bc6b98406cadce31d6411cb635. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.662842 27413 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.664439 27338 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.665143 28296 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:48.668208 28297 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.686895 27339 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.685081 28297 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.688472 27413 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.705789 27413 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:48.705523 27163 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.765805 27338 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:48.766481 27380 consensus_peers.cc:597] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f43efa5ed2d4349a1025bedcb71ff49. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.773003 27263 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:48.775588 28342 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:48.777135 28302 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:48.786346 28302 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.789326 27268 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.793123 27338 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.807130 27164 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:48.926661 28350 ts_tablet_manager.cc:933] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:48.928987 28350 tablet_copy_client.cc:323] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:48.931274 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet 21d14940356a45ada8e16731853b8769 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:48.931872 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet 21d14940356a45ada8e16731853b8769 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-21d14940356a45ada8e16731853b8769
I20260709 13:08:48.938220 27353 tablet_copy_source_session.cc:215] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:48.943326 28350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21d14940356a45ada8e16731853b8769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:48.958202 28350 tablet_copy_client.cc:806] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:48.958894 28350 tablet_copy_client.cc:670] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:48.963024 28350 tablet_copy_client.cc:538] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:48.972210 28350 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:48.990064 28350 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.990840 28350 tablet_bootstrap.cc:492] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:48.991473 28350 ts_tablet_manager.cc:1403] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:08:48.994313 28350 raft_consensus.cc:359] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:48.995240 28350 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:48.996002 28350 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.001936 28350 ts_tablet_manager.cc:1434] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:08:49.006910 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-21d14940356a45ada8e16731853b8769 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:49.007445 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-21d14940356a45ada8e16731853b8769 on tablet 21d14940356a45ada8e16731853b8769 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:49.088277 28350 ts_tablet_manager.cc:933] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:49.089980 28350 tablet_copy_client.cc:323] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:49.091778 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 4841dcf8d05d4ecaa8771d888fc649c0 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:49.092252 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 4841dcf8d05d4ecaa8771d888fc649c0 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-4841dcf8d05d4ecaa8771d888fc649c0
I20260709 13:08:49.098903 27426 tablet_copy_source_session.cc:215] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:49.101547 28350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4841dcf8d05d4ecaa8771d888fc649c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:49.114048 28350 tablet_copy_client.cc:806] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:49.114679 28350 tablet_copy_client.cc:670] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:49.118422 28350 tablet_copy_client.cc:538] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:49.132472 28350 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:49.156108 28350 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:49.156862 28350 tablet_bootstrap.cc:492] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:49.157436 28350 ts_tablet_manager.cc:1403] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.001s
I20260709 13:08:49.160254 28350 raft_consensus.cc:359] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.161136 28350 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:49.162075 28350 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.164721 28350 ts_tablet_manager.cc:1434] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:08:49.169341 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-4841dcf8d05d4ecaa8771d888fc649c0 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:49.169962 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-4841dcf8d05d4ecaa8771d888fc649c0 on tablet 4841dcf8d05d4ecaa8771d888fc649c0 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:49.247036 28350 ts_tablet_manager.cc:933] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:49.249892 28350 tablet_copy_client.cc:323] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:49.252081 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet 099c52bc6b98406cadce31d6411cb635 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:49.252751 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet 099c52bc6b98406cadce31d6411cb635 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-099c52bc6b98406cadce31d6411cb635
I20260709 13:08:49.262634 27278 tablet_copy_source_session.cc:215] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:49.267360 28350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 099c52bc6b98406cadce31d6411cb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:49.281833 28350 tablet_copy_client.cc:806] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:49.282518 28350 tablet_copy_client.cc:670] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:49.287315 28350 tablet_copy_client.cc:538] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:49.296067 28350 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:49.334950 28350 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:49.335728 28350 tablet_bootstrap.cc:492] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:49.336293 28350 ts_tablet_manager.cc:1403] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.012s
I20260709 13:08:49.339097 28350 raft_consensus.cc:359] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.340039 28350 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:49.340727 28350 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.343684 28350 ts_tablet_manager.cc:1434] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:49.345831 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-099c52bc6b98406cadce31d6411cb635 received from {username='slave'} at 127.0.0.1:48160
I20260709 13:08:49.346300 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-099c52bc6b98406cadce31d6411cb635 on tablet 099c52bc6b98406cadce31d6411cb635 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:49.356920 28350 ts_tablet_manager.cc:933] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:49.359023 28350 tablet_copy_client.cc:323] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:49.360674 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 1f43efa5ed2d4349a1025bedcb71ff49 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:49.361264 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 1f43efa5ed2d4349a1025bedcb71ff49 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-1f43efa5ed2d4349a1025bedcb71ff49
I20260709 13:08:49.369896 27426 tablet_copy_source_session.cc:215] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:49.373641 28350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43efa5ed2d4349a1025bedcb71ff49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:49.389578 28350 tablet_copy_client.cc:806] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:49.390219 28350 tablet_copy_client.cc:670] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:49.393841 28350 tablet_copy_client.cc:538] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:49.401557 28350 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:49.417939 28350 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:49.418828 28350 tablet_bootstrap.cc:492] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:49.419535 28350 ts_tablet_manager.cc:1403] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.003s
I20260709 13:08:49.422060 28350 raft_consensus.cc:359] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.422811 28350 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:49.423421 28350 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:49.425393 28350 ts_tablet_manager.cc:1434] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:49.427588 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-1f43efa5ed2d4349a1025bedcb71ff49 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:49.428015 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-1f43efa5ed2d4349a1025bedcb71ff49 on tablet 1f43efa5ed2d4349a1025bedcb71ff49 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:49.466954 28011 raft_consensus.cc:1217] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.484889 28011 raft_consensus.cc:1217] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:49.721737 28011 raft_consensus.cc:1217] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.903198 28011 raft_consensus.cc:1217] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:49.908275 28342 raft_consensus.cc:1064] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:49.911234 28342 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:49.920704 28011 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.922068 27339 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.922245 27263 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:49.922283 28342 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:49.923866 28302 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.924840 28329 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.948087 28342 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:49.952463 27263 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:49.954228 27339 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:49.963459 28011 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:49.977432 27165 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.006999 27413 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.012971 27263 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.013876 28011 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.014457 28302 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.016099 28302 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.025311 28329 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.026564 28011 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.029389 27263 raft_consensus.cc:2955] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.047122 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4841dcf8d05d4ecaa8771d888fc649c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.049242 27165 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.062022 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 4841dcf8d05d4ecaa8771d888fc649c0 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:50.067703 28370 tablet_replica.cc:333] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:50.069162 28370 raft_consensus.cc:2243] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.069937 28370 raft_consensus.cc:2272] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.073279 28356 raft_consensus.cc:1064] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:50.074760 28370 ts_tablet_manager.cc:1916] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.075742 28356 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.093065 28370 ts_tablet_manager.cc:1929] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.093541 28370 log.cc:1199] T 4841dcf8d05d4ecaa8771d888fc649c0 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/4841dcf8d05d4ecaa8771d888fc649c0
I20260709 13:08:50.095271 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 4841dcf8d05d4ecaa8771d888fc649c0 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:50.098459 28011 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:50.099905 27413 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:50.100131 28372 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:50.102348 27263 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:50.109687 28297 raft_consensus.cc:1064] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:50.105881 28356 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:50.115432 28330 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.129079 28297 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.159400 28372 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:08:50.162525 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45275.9us
W20260709 13:08:50.167091 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 50692.1us
I20260709 13:08:50.167025 27413 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.182838 28015 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.186299 27339 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.187207 27414 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.188386 28297 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.190344 28331 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.191495 28361 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.216990 28361 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.228240 27335 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.232288 27414 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.240679 27161 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.256372 28011 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.263818 28014 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.270433 27263 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.287518 27268 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.302029 27163 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.306267 28011 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.317678 28375 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.323041 27414 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.327414 27335 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.331243 28302 raft_consensus.cc:1064] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:50.330533 28361 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:08:50.333698 28302 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.347844 27268 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:50.355770 28297 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.363823 27413 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.367491 28015 raft_consensus.cc:2955] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.376834 28356 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.373575 28014 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:50.383285 28356 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:50.394927 28374 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.404767 27153 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 099c52bc6b98406cadce31d6411cb635 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:50.405380 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 52649.2us
I20260709 13:08:50.406646 28011 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.419818 27163 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.420742 27263 raft_consensus.cc:2955] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.440896 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 099c52bc6b98406cadce31d6411cb635 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:50.441952 28370 tablet_replica.cc:333] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:50.442942 28370 raft_consensus.cc:2243] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.443861 28370 raft_consensus.cc:2272] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.449544 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21d14940356a45ada8e16731853b8769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.458001 28370 ts_tablet_manager.cc:1916] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.465437 27163 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.468458 28011 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.469455 27335 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.470089 28342 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.471328 28384 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.471629 27263 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:50.481869 28302 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:50.494856 28370 ts_tablet_manager.cc:1929] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.497820 28370 log.cc:1199] T 099c52bc6b98406cadce31d6411cb635 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/099c52bc6b98406cadce31d6411cb635
I20260709 13:08:50.501585 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 099c52bc6b98406cadce31d6411cb635 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:50.513315 28342 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.514452 28011 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.527603 27335 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.541285 27161 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.544603 27268 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.557801 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet 21d14940356a45ada8e16731853b8769 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:50.560936 28388 tablet_replica.cc:333] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:50.562417 28388 raft_consensus.cc:2243] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.563257 28388 raft_consensus.cc:2272] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.566288 27416 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:50.573693 28011 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.574028 27335 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:50.575243 28342 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.578088 28342 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:50.584142 28388 ts_tablet_manager.cc:1916] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.584551 28302 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.590221 28011 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.595789 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f43efa5ed2d4349a1025bedcb71ff49 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.601501 28388 ts_tablet_manager.cc:1929] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:08:50.602034 28388 log.cc:1199] T 21d14940356a45ada8e16731853b8769 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/21d14940356a45ada8e16731853b8769
I20260709 13:08:50.603749 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet 21d14940356a45ada8e16731853b8769 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:50.605412 27335 raft_consensus.cc:2955] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.611577 27163 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:50.624536 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f43efa5ed2d4349a1025bedcb71ff49 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:50.630548 28389 tablet_replica.cc:333] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:50.631810 28389 raft_consensus.cc:2243] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.632723 28389 raft_consensus.cc:2272] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.636185 28389 ts_tablet_manager.cc:1916] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:50.650818 28389 ts_tablet_manager.cc:1929] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:50.651211 28389 log.cc:1199] T 1f43efa5ed2d4349a1025bedcb71ff49 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/1f43efa5ed2d4349a1025bedcb71ff49
I20260709 13:08:50.652891 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet 1f43efa5ed2d4349a1025bedcb71ff49 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:51.695966 27335 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:51.703473 27263 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.703465 27416 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:51.704613 27306 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e622bd20107a4c4190d71a5b581aa506. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.705426 28356 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.706310 28374 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.714830 28356 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.716887 27416 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.716706 27263 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.734143 27161 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.735416 27335 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:51.744232 27416 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:51.744343 27306 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0b732e9fe744ccfb9006867b9ec2cd7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.746105 28374 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.746704 27268 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.750097 28374 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.756995 28394 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.760216 27416 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.784689 27163 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.790524 27268 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.808872 27340 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:51.818801 27416 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:51.819262 27306 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c760b3987ef34e0189563d3ccb585eed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.820188 28391 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.831753 27268 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:51.831606 28391 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.834103 27416 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.833057 28394 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:08:51.857318 27416 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:51.870565 27163 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.871603 27268 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.900288 27340 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:51.903095 27380 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c247f301fde4963b4d1761a0b3254a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.903818 27268 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:51.906098 28402 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:51.907461 28408 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:51.916877 28384 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.919230 27339 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.918957 27268 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:51.936883 27164 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:08:52.209232 28411 ts_tablet_manager.cc:933] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:52.211043 28411 tablet_copy_client.cc:323] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:52.212564 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet e622bd20107a4c4190d71a5b581aa506 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:52.212997 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet e622bd20107a4c4190d71a5b581aa506 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-e622bd20107a4c4190d71a5b581aa506
I20260709 13:08:52.219367 27353 tablet_copy_source_session.cc:215] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.222316 28411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e622bd20107a4c4190d71a5b581aa506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.235973 28411 tablet_copy_client.cc:806] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.236581 28411 tablet_copy_client.cc:670] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.240442 28411 tablet_copy_client.cc:538] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.249235 28411 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:52.269711 28411 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.270691 28411 tablet_bootstrap.cc:492] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:52.271468 28411 ts_tablet_manager.cc:1403] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 13:08:52.278302 28411 raft_consensus.cc:359] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.279251 28411 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:52.280268 28411 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.280732 28413 ts_tablet_manager.cc:933] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:52.285036 28411 ts_tablet_manager.cc:1434] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:52.289582 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-e622bd20107a4c4190d71a5b581aa506 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:52.290022 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-e622bd20107a4c4190d71a5b581aa506 on tablet e622bd20107a4c4190d71a5b581aa506 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:52.294570 28413 tablet_copy_client.cc:323] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:52.297297 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet e0b732e9fe744ccfb9006867b9ec2cd7 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:52.298162 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet e0b732e9fe744ccfb9006867b9ec2cd7 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-e0b732e9fe744ccfb9006867b9ec2cd7
I20260709 13:08:52.301466 28417 ts_tablet_manager.cc:933] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:52.309621 27353 tablet_copy_source_session.cc:215] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.311623 28417 tablet_copy_client.cc:323] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:08:52.313429 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 3c247f301fde4963b4d1761a0b3254a9 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:08:52.313956 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 3c247f301fde4963b4d1761a0b3254a9 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-3c247f301fde4963b4d1761a0b3254a9
I20260709 13:08:52.314365 28413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b732e9fe744ccfb9006867b9ec2cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.321403 27426 tablet_copy_source_session.cc:215] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.334838 28417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c247f301fde4963b4d1761a0b3254a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.353754 28413 tablet_copy_client.cc:806] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.354449 28413 tablet_copy_client.cc:670] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.354874 28417 tablet_copy_client.cc:806] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.355574 28417 tablet_copy_client.cc:670] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.359681 28413 tablet_copy_client.cc:538] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.365275 28417 tablet_copy_client.cc:538] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.375299 28417 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:52.377293 28413 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:52.406049 28417 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.407191 28417 tablet_bootstrap.cc:492] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:52.407905 28417 ts_tablet_manager.cc:1403] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.007s
I20260709 13:08:52.410894 28417 raft_consensus.cc:359] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.411795 28417 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:52.412506 28417 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.414337 28413 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.415501 28413 tablet_bootstrap.cc:492] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:52.416313 28413 ts_tablet_manager.cc:1403] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.009s
I20260709 13:08:52.422434 28417 ts_tablet_manager.cc:1434] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:08:52.425256 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-3c247f301fde4963b4d1761a0b3254a9 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:08:52.425668 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-3c247f301fde4963b4d1761a0b3254a9 on tablet 3c247f301fde4963b4d1761a0b3254a9 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:52.427835 28411 ts_tablet_manager.cc:933] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:52.432736 28413 raft_consensus.cc:359] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.434613 28413 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:52.434962 28411 tablet_copy_client.cc:323] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:08:52.435467 28413 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.436964 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet c760b3987ef34e0189563d3ccb585eed from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:08:52.437506 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet c760b3987ef34e0189563d3ccb585eed from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-c760b3987ef34e0189563d3ccb585eed
I20260709 13:08:52.438889 28413 ts_tablet_manager.cc:1434] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:08:52.444139 27352 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-e0b732e9fe744ccfb9006867b9ec2cd7 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:52.444620 27352 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-e0b732e9fe744ccfb9006867b9ec2cd7 on tablet e0b732e9fe744ccfb9006867b9ec2cd7 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:52.444891 27353 tablet_copy_source_session.cc:215] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:52.448199 28411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c760b3987ef34e0189563d3ccb585eed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:52.472653 28411 tablet_copy_client.cc:806] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:52.473332 28411 tablet_copy_client.cc:670] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:52.476810 28411 tablet_copy_client.cc:538] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:52.484211 28411 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:08:52.502125 28411 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:52.503240 28411 tablet_bootstrap.cc:492] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:08:52.504040 28411 ts_tablet_manager.cc:1403] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.000s
I20260709 13:08:52.507052 28411 raft_consensus.cc:359] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.508016 28411 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:08:52.508680 28411 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:52.511535 28411 ts_tablet_manager.cc:1434] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:52.513211 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-c760b3987ef34e0189563d3ccb585eed received from {username='slave'} at 127.0.0.1:49416
I20260709 13:08:52.513657 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-c760b3987ef34e0189563d3ccb585eed on tablet c760b3987ef34e0189563d3ccb585eed with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:52.736559 28014 raft_consensus.cc:1217] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:52.744704 28014 raft_consensus.cc:1217] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:52.774091 28014 raft_consensus.cc:1217] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:08:52.980317 28014 raft_consensus.cc:1217] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:53.244947 28394 raft_consensus.cc:1064] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:53.247771 28394 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.257160 27416 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.257488 28015 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.259016 28394 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.259711 27268 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.259876 28391 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.260928 28356 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.282294 28356 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.286094 27416 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.286311 27268 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.373872 27164 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.389554 28011 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.397763 28391 raft_consensus.cc:1064] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:53.411108 28407 raft_consensus.cc:1064] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:08:53.400769 28391 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.413723 28407 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.421144 27340 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.550314 28011 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.553015 28430 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:08:53.555254 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 132139us
I20260709 13:08:53.562376 28015 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.565855 28429 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.568120 27416 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.568727 28011 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:53.571993 27340 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:53.573557 28402 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.574813 27412 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.574251 28430 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.583462 27268 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.584820 28391 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.587178 28394 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.588462 28429 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.589361 28427 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.594902 28011 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.597703 27416 raft_consensus.cc:2955] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.636461 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0b732e9fe744ccfb9006867b9ec2cd7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.623195 27163 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.622401 28391 raft_consensus.cc:1064] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
W20260709 13:08:53.667565 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54279.8us
W20260709 13:08:53.674129 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 80779.7us
I20260709 13:08:53.676172 27263 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:53.730914 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet e0b732e9fe744ccfb9006867b9ec2cd7 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:56410
I20260709 13:08:53.676481 28407 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.731227 27412 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.685436 28011 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.736446 28449 tablet_replica.cc:333] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:08:53.737490 28449 raft_consensus.cc:2243] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:53.738126 28449 raft_consensus.cc:2272] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:53.719805 28394 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.655097 28391 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.723939 28014 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.759894 27161 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.764617 28449 ts_tablet_manager.cc:1916] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:53.771431 28427 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.774300 27163 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.787381 28449 ts_tablet_manager.cc:1929] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:53.787981 28449 log.cc:1199] T e0b732e9fe744ccfb9006867b9ec2cd7 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/e0b732e9fe744ccfb9006867b9ec2cd7
I20260709 13:08:53.789837 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet e0b732e9fe744ccfb9006867b9ec2cd7 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:53.797963 27268 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.804415 27335 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.810825 27263 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.829579 28011 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.831687 28394 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.834308 27413 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.835279 27263 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:53.840324 28391 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:53.844100 28430 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:53.846342 27339 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:53.855885 28014 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.857622 28430 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:53.867026 28431 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.868839 28011 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.879067 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e622bd20107a4c4190d71a5b581aa506 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.898208 27164 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.901253 27263 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:53.906980 28429 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:53.920475 27264 raft_consensus.cc:2955] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.924589 27413 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.941139 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet e622bd20107a4c4190d71a5b581aa506 with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:53.930104 28429 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.957053 27264 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.958827 27161 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:53.986457 28014 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.012115 28455 tablet_replica.cc:333] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:54.013983 28455 raft_consensus.cc:2243] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.018795 27340 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.032434 28014 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:54.015977 28455 raft_consensus.cc:2272] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.034096 28430 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:54.041481 27264 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:54.044273 28391 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.045863 28455 ts_tablet_manager.cc:1916] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.047086 28011 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.056290 28429 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.064344 27163 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New cstate: current_term: 1 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.066578 27264 raft_consensus.cc:2955] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.072702 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c760b3987ef34e0189563d3ccb585eed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:54.076978 27400 tablet_service.cc:1558] Processing DeleteTablet for tablet c760b3987ef34e0189563d3ccb585eed with delete_type TABLET_DATA_TOMBSTONED (TS d02eb2355bc54e7f8c13a30c33793d95 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49638
I20260709 13:08:54.078050 28455 ts_tablet_manager.cc:1929] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:54.078567 28455 log.cc:1199] T e622bd20107a4c4190d71a5b581aa506 P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/e622bd20107a4c4190d71a5b581aa506
I20260709 13:08:54.080355 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet e622bd20107a4c4190d71a5b581aa506 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:54.080570 28455 tablet_replica.cc:333] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:08:54.082155 28455 raft_consensus.cc:2243] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.082944 28455 raft_consensus.cc:2272] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.087013 28455 ts_tablet_manager.cc:1916] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.103380 28455 ts_tablet_manager.cc:1929] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:54.103912 28455 log.cc:1199] T c760b3987ef34e0189563d3ccb585eed P d02eb2355bc54e7f8c13a30c33793d95: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/wals/c760b3987ef34e0189563d3ccb585eed
I20260709 13:08:54.108701 27152 catalog_manager.cc:5028] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): tablet c760b3987ef34e0189563d3ccb585eed (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:54.269861 27413 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.275195 27260 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:54.275290 28011 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:54.277349 28407 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.279659 28407 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:54.284752 28433 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.286211 27260 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.289842 28011 raft_consensus.cc:2955] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.303922 27161 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 3 to 4, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:08:54.313485 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c247f301fde4963b4d1761a0b3254a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:54.321378 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c247f301fde4963b4d1761a0b3254a9 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41280
I20260709 13:08:54.323426 28456 tablet_replica.cc:333] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:08:54.324664 28456 raft_consensus.cc:2243] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.325387 28456 raft_consensus.cc:2272] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.329041 28456 ts_tablet_manager.cc:1916] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.343235 28456 ts_tablet_manager.cc:1929] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:08:54.343672 28456 log.cc:1199] T 3c247f301fde4963b4d1761a0b3254a9 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/3c247f301fde4963b4d1761a0b3254a9
I20260709 13:08:54.345265 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet 3c247f301fde4963b4d1761a0b3254a9 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:08:54.506197 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.559634 27260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:54.560240 27260 raft_consensus.cc:606] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:54.562693 27260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60414d130cdc460696513fb91e20161f"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:54.563227 27260 raft_consensus.cc:606] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:54.576658 27413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:08:54.577195 27413 raft_consensus.cc:606] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:54.579684 27260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:54.580147 27260 raft_consensus.cc:606] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:54.582496 27260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:54.582995 27260 raft_consensus.cc:606] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:54.585285 27260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:54.585690 27260 raft_consensus.cc:606] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:54.586728 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:54.588151 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:54.686097 28361 raft_consensus.cc:993] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.686584 28445 raft_consensus.cc:1081] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.688058 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60414d130cdc460696513fb91e20161f"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:08:54.688539 27335 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.688861 27335 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.693352 27335 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.696709 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.696978 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:54.697458 27260 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.697551 27416 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.697815 27335 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:54.697841 27260 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:54.700205 27260 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.701356 27260 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.706074 27416 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.707808 27260 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.708042 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:54.708880 28429 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.709362 28429 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:54.710197 28429 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.720366 27164 catalog_manager.cc:5697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.765094 28361 raft_consensus.cc:993] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: : Instructing follower b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:08:54.765537 28445 raft_consensus.cc:1081] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Signalling peer b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:08:54.766932 28011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:55770
I20260709 13:08:54.767582 28011 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.767910 28011 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.774684 28011 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.776608 28011 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:54.777644 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.777724 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:54.778367 27260 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.778434 27335 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.778677 27260 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:54.779531 27260 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.780413 27260 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.784924 27335 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:54.786368 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:54.786566 27260 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:54.787305 28415 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.788733 28415 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:54.789145 28407 raft_consensus.cc:993] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:08:54.789695 28427 raft_consensus.cc:1081] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Signalling peer b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:08:54.789646 28415 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.791365 28014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:55754
I20260709 13:08:54.792001 28014 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.792393 28014 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.798506 27164 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.799480 28014 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.801424 28014 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:54.802498 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:54.802567 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.803220 27416 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.803349 27260 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.803601 27416 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:54.804469 27416 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.805675 27416 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.810180 27260 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:54.813200 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:54.814970 28415 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.815517 28415 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:54.816396 28415 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:54.820375 27416 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:54.825109 27164 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.864722 28361 raft_consensus.cc:993] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.865178 28445 raft_consensus.cc:1081] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.866887 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:08:54.868445 27335 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.868932 27335 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.874317 27335 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.876143 27335 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:54.876948 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.877758 27260 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:54.878173 27260 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:54.878538 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:54.879215 27416 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.879233 27260 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.881289 27260 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:54.886317 27416 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:08:54.887643 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:54.888186 28445 raft_consensus.cc:993] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.888531 28429 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:54.888715 28445 raft_consensus.cc:1081] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.889127 28429 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:54.888103 27260 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:08:54.890138 28429 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.891218 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:08:54.891791 27340 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.892122 27340 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.901398 27340 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.905480 27340 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:54.905606 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:54.906165 27413 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.908206 28445 raft_consensus.cc:993] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.908733 28445 raft_consensus.cc:1081] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:54.913846 27164 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 3, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.916216 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.917609 27335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:08:54.918401 27264 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.918800 27264 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:54.918838 27335 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.919634 27335 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.919754 27264 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.921154 27264 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.916908 27413 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.937770 27264 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.938083 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:54.940101 28429 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.940910 28429 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:54.941924 28429 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.939864 27335 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.944653 27335 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:54.945732 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:54.947055 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:54.947772 27260 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:54.948076 27260 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:54.948839 27260 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.950078 27260 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.946476 27413 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:54.960114 27413 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.961066 27260 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:54.958611 27164 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.962558 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:54.965198 28428 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:54.966241 28428 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:54.967550 28428 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:54.983750 27164 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.101050 27413 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.102407 28428 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:55.114573 27263 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:55.116110 28429 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:56.338799 28476 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.339619 28476 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.344408 28477 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.344838 28476 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.345203 28475 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.346088 28475 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.345813 28477 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.348676 28475 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.350041 28477 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.354602 28477 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.355023 28475 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.355294 28477 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.355913 28478 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.355747 28475 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.361205 28476 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.362601 28475 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.358187 28477 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.362489 28476 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.363296 28475 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.363827 28475 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.365954 28476 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.366953 28475 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.359475 28478 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.377740 28478 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.404558 28480 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.406996 28480 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.418073 28484 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.418915 28484 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.421871 28480 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.422257 28484 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.424513 28481 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.425253 28481 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.428555 28481 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.430855 28481 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.431564 28481 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.432653 28491 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.433956 28475 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.435031 28481 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.434677 28475 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.437135 28475 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.433357 28491 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.442687 28491 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.445103 28482 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.470721 28482 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.473516 28482 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.445672 28484 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.451314 28475 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.453476 28487 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.474718 28484 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.475487 28475 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.475857 28487 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.478165 28487 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.454211 28479 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.455555 28485 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.479488 28485 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.458498 28480 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.466537 28476 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.482578 28482 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.483119 28482 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.483632 28484 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.468868 28478 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.466812 28486 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.478724 28475 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.467036 28481 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.484460 28476 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.495432 28478 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.501303 28493 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.481809 28479 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.512553 28475 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.511554 28481 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.513654 28488 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.492724 28477 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.492280 28480 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.520494 28477 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.537775 28487 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.515475 28493 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.525075 28485 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.524451 28482 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.517500 28475 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.552588 28490 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.553459 28493 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.553294 28490 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.511335 28486 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.536641 28476 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.541975 28484 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.521618 28488 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.561632 28485 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.556967 28481 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.572784 28482 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.563575 28487 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.588327 28490 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.594676 28495 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.588956 28484 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.594849 28498 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.580014 28494 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.594961 28490 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.595345 28495 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.581923 28479 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.586702 28501 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.589672 28485 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.599468 28482 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.595615 28498 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.605670 28482 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.581753 28496 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.597885 28489 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.595752 28494 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.610383 28497 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.603811 28478 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.618824 28477 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.606686 28479 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.599087 28490 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.610985 28501 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.618867 28475 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.612557 28497 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.624559 28479 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.629703 28486 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.630112 28494 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.632728 28510 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.633314 28510 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.622463 28505 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.630559 28502 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.625126 28489 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.617590 28496 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.636325 28505 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.638147 28499 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.635268 28484 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.676657 28480 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.679029 28495 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.693845 28490 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.695371 28501 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.701145 28489 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.702039 28489 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.704510 28505 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.705304 28505 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.706115 28505 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.695075 28486 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.638746 28499 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.742136 28509 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.743441 28509 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.746776 28509 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.747500 28509 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.748483 28509 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.763432 28491 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.764815 28491 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.771716 28503 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.727857 28489 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.778522 28486 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.776840 28509 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.785611 28497 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.773523 28491 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.789825 28495 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.790604 28480 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.790812 28495 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.791460 28480 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.791965 28486 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.793833 28484 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.794174 28480 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.794595 28484 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.795128 28494 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.795900 28494 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.798264 28496 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.798513 28494 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.781405 28505 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.806430 28499 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.772845 28503 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.803098 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.808321 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.809813 28489 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.799041 28496 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.639245 28502 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.821631 28503 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.822376 28511 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.823467 27412 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:56.823284 28511 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.826071 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.799154 28494 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.823895 28490 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.831055 28478 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.827768 28496 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.838395 28478 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.831933 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.830109 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.833384 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.842094 28502 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.844794 28482 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.846122 28503 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.846244 28483 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.846807 28511 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.843636 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.876313 28475 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.859440 28494 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.878333 28482 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.878402 28475 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.881942 28503 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.895220 28475 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.895735 28503 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:56.882112 28490 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.872948 28489 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.885900 27413 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:56.902379 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.909225 28482 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.911866 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.902463 28509 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.902057 28478 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.917040 28509 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.920444 28518 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.920806 28480 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.921423 28518 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.900415 28496 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.925302 28519 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.883765 28483 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.904184 28505 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:56.921893 28480 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.930498 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.932766 28505 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.936614 28483 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.937989 28489 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.942966 28514 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.946435 28516 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.952836 28511 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.953770 28494 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.950201 28490 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.947443 28516 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.943915 28514 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.954736 28509 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.954599 28489 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.955644 28519 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.968235 28505 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.970742 28520 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.976475 28511 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.973112 28496 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.971578 28494 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.980151 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.978008 28520 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.973870 28490 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.982427 27413 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:56.982589 28511 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.980938 28512 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:56.984355 28518 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.984747 28514 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.985419 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.984608 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.985514 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.980872 28496 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.986037 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.987264 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.990797 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.992388 27261 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:56.990590 28512 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:56.996745 28479 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:56.994050 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:56.995085 28511 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:56.997498 27265 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:56.998668 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:56.991701 28494 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.000236 27412 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:57.000572 28511 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:56.991549 28483 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.001904 28483 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.002354 28494 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:56.994356 28485 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.007509 27263 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.002873 28511 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.008948 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.011334 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.012121 27260 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.012413 27265 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:57.014293 27408 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.014719 28516 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.015515 28496 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.013303 28490 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.020376 28521 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.021185 28490 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.021355 28520 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.004408 28512 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.030274 28488 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.032374 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.034337 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.034806 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.035495 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.036207 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.035864 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.086673 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.035746 27408 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:57.109608 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.112182 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.113260 27409 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:57.116642 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.117379 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.117512 27341 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.117836 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.118573 27340 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:57.092756 28519 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.119837 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.131655 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.134239 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.119901 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.021262 28521 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.141010 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.130003 28499 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.142843 28521 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.140692 28506 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.142604 28499 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.143702 28506 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.144034 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.133450 27338 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.144656 27339 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.145509 28499 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.141017 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.146467 28506 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.146757 27334 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.147068 28506 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.136998 27335 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.150136 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.152004 27417 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:57.126075 28483 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.164165 27414 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.165433 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.166879 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.167656 27260 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.168474 28510 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.148052 28506 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.170694 28506 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.171836 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.136061 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.176129 28487 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.180418 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.181855 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:57.183055 28475 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.183579 28475 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.183744 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.184158 28475 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.184633 27340 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:08:57.186812 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:57.189466 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.190330 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.190824 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.194007 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.194448 28483 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.195118 28483 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.198457 28519 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.198572 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.199558 28484 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.199293 28519 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.200289 28484 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.200711 28484 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.201159 28484 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.201666 28491 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.202428 28491 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.203384 28503 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.203998 28503 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.199746 27233 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.207693 28490 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.214200 28510 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.214334 28490 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.207454 28498 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.215065 28490 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.216995 28519 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.218888 28488 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.219574 28488 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.221755 28488 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.221421 28475 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.222980 28488 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.223416 28503 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.223554 28488 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.225282 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.233311 28483 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.215085 28510 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.231690 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.380934 28510 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.345670 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.242354 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.404223 27416 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:57.235494 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.242877 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.230228 28498 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.210608 28487 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.230507 28516 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.425736 28475 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.431244 27414 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:57.408034 28490 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.230406 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:57.303687 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 116907us
I20260709 13:08:57.441072 27978 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:57.441345 28523 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.442778 28525 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.443562 28475 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.445564 28475 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.447651 28516 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.439572 28487 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.449857 28516 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:08:57.429556 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 187369us
I20260709 13:08:57.450423 28487 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.444483 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.450881 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.432169 28483 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:57.448091 28475 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.432353 28498 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.455365 28483 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.456135 28483 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.461299 28525 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.442134 28523 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.467881 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.430850 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.430001 28488 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.452306 28512 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:57.452926 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.523433 27264 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.455312 28524 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.524029 28475 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.522322 28512 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.509991 28491 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.533834 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.535615 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.536821 28512 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.536561 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:57.540382 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.525883 27263 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:08:57.550146 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.550931 27266 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.552134 28480 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.554483 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:57.555497 28495 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.556514 28523 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.557080 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.557824 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.560531 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.557768 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.547976 28527 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.558580 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.562011 28527 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.558794 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.562649 28527 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.564204 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.565925 27262 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:08:57.566272 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.559703 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.573961 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.559801 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.530817 28524 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.578677 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.559392 28525 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.579900 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.580930 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.565938 28498 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.546150 28475 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:08:57.577785 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 136847us
W20260709 13:08:57.595417 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb1e0 after lost signal to thread 26161
I20260709 13:08:57.595567 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.596486 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:08:57.596755 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf8c0 after lost signal to thread 27200
I20260709 13:08:57.597182 28014 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
W20260709 13:08:57.598173 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800317ea0 after lost signal to thread 27292
I20260709 13:08:57.599129 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.600539 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.600915 27266 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.601303 28011 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
W20260709 13:08:57.601817 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800065b80 after lost signal to thread 27367
I20260709 13:08:57.602528 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:57.603145 27438 debug-util.cc:398] Leaking SignalData structure 0x7b080033a060 after lost signal to thread 27441
W20260709 13:08:57.603475 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800314ce0 after lost signal to thread 27442
I20260709 13:08:57.602569 27268 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.603647 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:57.604496 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800305720 after lost signal to thread 28039
W20260709 13:08:57.604821 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08002efb20 after lost signal to thread 28040
I20260709 13:08:57.604519 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.606258 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:57.607321 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51908us
I20260709 13:08:57.607649 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.591820 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:57.578752 28523 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.610561 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.611753 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.612383 28488 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:57.612697 28528 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:57.614109 28522 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:57.613911 27980 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:57.577817 28524 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.616134 27417 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
W20260709 13:08:57.616895 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.591588 27411 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:57.618223 28523 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.589139 28525 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.624071 28523 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.624215 28525 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.620337 28484 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.626103 27260 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.627197 28525 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.625195 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.629292 28014 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.618932 28475 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.631798 28484 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.631927 28528 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:57.634358 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:08:57.635636 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 43881.1us
I20260709 13:08:57.634407 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:57.636443 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:57.636680 28525 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.614986 28490 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.637315 28523 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.637372 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:57.637938 28528 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:57.639991 28528 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.640416 28528 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.641192 28014 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.639288 28523 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.643134 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.643520 28523 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.643687 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.644438 28011 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:57.646003 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.646080 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.647269 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.638468 28525 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.648166 28525 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.648916 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.649507 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.647578 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.650604 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.652750 28516 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.652690 28475 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:57.653328 28516 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.578667 28483 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.654054 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.656148 28475 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.656374 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.657162 28013 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:08:57.659873 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.660480 27264 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:57.661741 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.663298 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.663259 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:57.663998 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.639804 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.667711 28522 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.668112 28522 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.668464 28522 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.614596 28526 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:57.653820 28516 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.677242 28515 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.677682 28515 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.678053 28515 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.680030 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.672526 28526 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.686086 28526 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.686228 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.686743 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.670126 28508 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.685258 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.686259 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.689888 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.692981 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.693127 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.699609 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.699883 28506 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.669072 28524 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.687245 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:08:57.717543 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 79878.4us
W20260709 13:08:57.726642 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61526.5us
I20260709 13:08:57.727051 28531 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.727536 28531 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.727595 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:57.728016 28531 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.743892 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.744590 27413 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:57.756538 28014 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.752245 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.725944 28506 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.767784 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.771692 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.771970 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.780787 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.781868 27265 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:57.783653 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.821897 28475 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:57.820837 28512 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.823287 27260 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.788964 28524 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.823625 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.824180 28524 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.824592 28524 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.825057 28524 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.825896 28512 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.732362 28508 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.825803 28523 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.770641 28506 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.792238 28530 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.765736 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.820837 28525 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.837072 28480 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:57.840337 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.842461 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.846853 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.850674 28011 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:57.850910 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.853649 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.835387 28488 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.829668 28530 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:57.861120 27335 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.836526 28523 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.871248 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.867599 28488 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.871464 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.880366 28488 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.871788 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.871953 28525 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.872143 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:57.846800 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 209522us
I20260709 13:08:57.859366 28508 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.875049 28483 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:57.888227 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.886432 28516 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.868088 28530 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.892711 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.894017 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.843605 28528 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.888381 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.880805 28527 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.897773 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:57.898792 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.901207 28528 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:57.903972 28015 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.904189 28013 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:57.907982 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.908670 27335 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.909488 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.910784 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.912024 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.913913 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.915632 28015 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:57.915769 28014 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:57.919566 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.920338 28011 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:57.921028 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.921820 28010 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:57.922659 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:57.911352 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:57.910215 28516 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.908649 28527 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.928223 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.931272 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:57.932569 28014 raft_consensus.cc:2393] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:57.933717 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.933866 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.935650 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.936205 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.936571 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.937049 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.937821 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.935642 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.938468 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:57.938993 27268 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:57.943208 28491 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.949532 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.949999 28491 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:57.950165 27412 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:57.950495 28491 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.938050 28508 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:57.939796 28527 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:57.934962 28522 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:57.956395 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.957448 28522 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.957509 27341 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:57.957682 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.959028 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.960372 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.961015 27334 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.952625 28508 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:57.962124 28508 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:57.981065 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.981419 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:57.982481 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 54958.4us
I20260709 13:08:57.983337 28512 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:57.983642 27411 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:57.984004 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.984666 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.985121 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.985729 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:57.983673 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.986900 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:08:57.988883 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:57.989480 28524 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:57.991041 27233 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:57.992734 28524 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:57.992832 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:08:57.993870 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.994472 27342 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:08:57.995589 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.995951 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.996623 27340 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:08:57.996609 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:57.998945 28496 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:58.007632 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 69981.4us
I20260709 13:08:57.993618 27409 raft_consensus.cc:606] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:57.999378 28496 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.011845 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:58.011766 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.014350 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.014644 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.034409 27342 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.033737 27260 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:08:58.014050 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.039850 27342 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.015628 28496 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.034847 28483 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.043942 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.010332 28526 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.037374 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.045194 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.013087 28512 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:58.027627 28488 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.062589 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:58.039392 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 311898us
I20260709 13:08:58.045850 28483 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:58.067039 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:58.071805 27340 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:58.081786 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 69720.1us
I20260709 13:08:58.082828 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.082831 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.086953 28522 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.088680 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.072618 28483 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.093963 28495 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.095692 28526 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.100060 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.112396 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.119009 27412 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:08:58.119853 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.120585 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.122133 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.088670 28494 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:58.124230 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44643.8us
I20260709 13:08:58.124447 27408 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:58.124333 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.125177 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.114022 28522 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.128283 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.129511 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:58.125926 28534 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:08:58.126755 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 100914us
I20260709 13:08:58.131958 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.116966 28521 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.135991 28512 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:58.136650 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.137153 28512 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.137231 27260 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:08:58.137663 28512 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.134346 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.139921 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.140136 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.141193 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.141676 28488 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.142352 28524 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.146545 28484 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.146957 28484 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.126960 28494 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:58.148159 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:08:58.134789 27981 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.129:44339 timed out after 1.693s (SENT) [suppressed 3 similar messages]
I20260709 13:08:58.144922 28506 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.152437 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.153103 28539 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:58.153390 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:08:58.153644 27231 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b44d9e3827f45eabce8235344e58d0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:58.154517 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.143093 28524 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.158802 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.159018 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.158860 28484 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.160149 27265 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:58.160368 28484 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.149339 28521 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.157850 28520 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.161899 28520 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:58.161654 28530 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.162335 28520 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.156751 28488 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.150374 28494 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.164489 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.164744 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.165326 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.167395 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.167564 27414 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.138801 28512 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.169831 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.164522 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.172657 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.158089 28524 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:58.175833 27265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:08:58.177224 27265 raft_consensus.cc:606] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:08:58.178083 28015 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.182174 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.182209 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.171757 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.184963 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.180162 28524 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.179271 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.195739 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.196327 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.200064 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.200719 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.204402 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.215553 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.222781 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.224716 27268 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:08:58.175303 28547 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:58.228111 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.228613 28547 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.229007 28547 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:08:58.235916 28515 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.557s	user 0.018s	sys 0.003s
I20260709 13:08:58.236357 28515 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.237442 27417 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.238509 28515 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:58.246502 28540 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:08:58.247740 28503 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.248121 28503 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:58.204924 28526 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:58.223343 28537 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:08:58.253335 28503 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.255789 28503 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.255640 28483 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.265210 28512 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.268318 28526 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:58.268779 28526 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:58.269263 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.271437 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.271735 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.272176 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.272814 27339 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:58.271466 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.275885 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:08:58.279397 28531 consensus_meta.cc:287] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.014s
I20260709 13:08:58.229664 28496 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.279958 28531 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.259879 28491 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.281306 28009 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.281598 28496 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.269711 28526 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.282626 27411 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.285753 27260 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:58.270846 28540 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.286799 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.270781 28530 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.282624 28491 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:58.291366 28506 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:58.309437 28542 raft_consensus.cc:993] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:08:58.310159 28483 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:58.312276 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:58.313410 28531 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.313764 28520 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.314464 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.314988 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.287870 28540 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:58.319044 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.361289 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.360862 28540 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.361969 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.362355 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.362627 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.363250 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.363610 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.364048 27337 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:58.353662 28524 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.344363 28526 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.370798 27259 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:08:58.331590 28547 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.373018 28508 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.374440 27415 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.356092 28542 raft_consensus.cc:1081] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:08:58.357740 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:58.356894 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.374338 28547 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:58.383203 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.384771 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.385480 28520 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:08:58.386214 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 345078us
I20260709 13:08:58.387702 28524 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.382028 28543 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:58.403326 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.403432 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.408574 28495 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:58.412210 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:08:58.414942 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:58.418319 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.405385 28543 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:58.401544 28508 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:58.437548 28009 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.419588 28496 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:58.448431 28484 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:58.449287 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.449661 28484 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:58.452481 28548 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.452889 28521 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.453346 28521 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.458312 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.438716 28496 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.431875 28543 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.467144 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.406278 28494 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.454348 28484 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.474404 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:58.471328 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:08:58.499375 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 366144us
W20260709 13:08:58.505604 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.471328 28484 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.506419 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:58.512151 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.515869 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.483348 28521 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.517561 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.519335 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:58.520282 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 363189us
W20260709 13:08:58.520711 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 331136us
I20260709 13:08:58.525180 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.488718 28501 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:08:58.515280 28524 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.517328 28531 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.558466 28015 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:58.522322 28530 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.566993 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:58.566805 28521 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.584772 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.562951 28524 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:08:58.587234 28009 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.529402 28559 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.525890 28527 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.594347 28013 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:58.588485 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.585059 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:58.599539 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:58.600457 28012 raft_consensus.cc:2393] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:58.567956 28526 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:58.604841 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 79746us
I20260709 13:08:58.606127 27264 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:08:58.612107 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.593364 28524 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.628808 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:58.633558 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 121483us
I20260709 13:08:58.592854 28484 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.517716 28496 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.639400 28551 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:58.640384 28484 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.640882 28494 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:58.629984 28527 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.627528 28488 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.656952 28487 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.657708 28487 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:58.659132 28524 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.669801 28495 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.688269 28495 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:58.689438 28495 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.694242 28539 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.695031 28539 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.696573 28539 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:58.697443 28539 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:58.699374 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 135102us
I20260709 13:08:58.704747 27261 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:08:58.704816 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57572.3us
I20260709 13:08:58.706765 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.710191 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.711403 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.712476 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.713512 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:58.716238 28494 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.716614 28560 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.691092 28495 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.717305 28560 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.717749 28484 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.667285 28522 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:58.705669 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84253.4us
I20260709 13:08:58.715101 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.717085 28494 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.749889 28521 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.658876 28487 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:08:58.755671 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 170967us
I20260709 13:08:58.767419 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.769070 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.772316 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.772886 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:08:58.780249 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.792428 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:58.771507 28521 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.790671 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.803189 28508 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.812116 28508 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:58.812605 28508 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.815657 28540 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.788033 28501 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.751761 28551 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:58.774015 28490 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.766270 28516 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:58.820081 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.823097 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:58.823424 28494 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.824714 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.825644 28494 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.825888 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.826524 28494 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:58.827101 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.816397 28484 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.837410 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:58.817426 28487 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.844826 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.826975 28494 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:08:58.852037 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.853634 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.812623 28539 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.856580 28548 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:58.858736 27411 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.830672 28521 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.836249 28490 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.854898 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.866650 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.848948 28559 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.847786 28501 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.856856 28484 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.856012 28494 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:58.860327 28512 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:58.878268 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 85963.1us
W20260709 13:08:58.879071 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.026s	sys 0.049s
W20260709 13:08:58.880457 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.027s	sys 0.049s
W20260709 13:08:58.881322 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 504132us
I20260709 13:08:58.887238 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:58.879796 28521 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.877272 28524 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:58.882890 28506 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.903084 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:58.904402 28543 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.909441 28543 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:58.902393 28506 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:08:58.921375 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 164607us
W20260709 13:08:58.921592 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 307522us
I20260709 13:08:58.922546 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:58.932101 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:08:58.918607 28547 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.000s
I20260709 13:08:58.943573 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:58.946605 27340 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:08:58.947326 28545 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.939343 27261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59104
I20260709 13:08:58.947896 28545 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:58.948413 28545 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:58.946985 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 383241us
I20260709 13:08:58.920763 28506 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.944923 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:58.951040 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.951483 27261 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:58.954864 27261 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.957922 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:08:58.959774 28524 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:58.960345 28524 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:58.960855 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.961048 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.961194 28009 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.961622 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.961256 28524 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.962648 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.966252 28564 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:58.966662 27411 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:58.966784 28564 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:58.967274 28564 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.935556 28498 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.968240 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:58.913475 28563 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:58.972422 28565 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:08:58.973140 28561 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:58.980262 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.980921 27267 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:58.981563 28494 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:58.982175 27261 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:58.983286 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.983790 27259 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:58.984052 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:58.985548 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.986047 27261 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:58.949297 28552 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:58.991736 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:58.945060 28548 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:08:58.997037 28548 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:58.997534 28548 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:08:59.002193 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 135713us
I20260709 13:08:59.002413 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.006130 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:59.012315 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:59.012889 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.013806 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:59.016575 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50868.9us
I20260709 13:08:59.019111 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.021404 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.008427 28521 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:58.998589 28548 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.024617 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.028039 28496 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.031507 27380 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.035208 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.029440 28520 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.022964 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:59.019690 28487 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:59.042667 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.037149 27411 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.038581 28494 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.051291 28569 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.052076 28551 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.052583 28551 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.009364 28561 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:59.033996 28553 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:08:59.052626 28508 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.061968 28563 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:59.063427 28549 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.063804 27267 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:08:59.037233 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.056007 28491 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:59.064527 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.065032 28498 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.049734 28548 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.056847 28483 raft_consensus.cc:993] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:59.081926 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.082612 28498 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.085969 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.086395 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:59.090693 28556 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.034195 28573 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 13:08:59.093592 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61218.3us
I20260709 13:08:59.095605 28483 raft_consensus.cc:1081] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:08:59.098287 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.060686 28487 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.094116 28527 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.064519 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:59.097517 28569 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.113384 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.078089 28570 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:08:59.117286 28010 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:59.117740 28010 pending_rounds.cc:85] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Aborting all ops after (but not including) 4
I20260709 13:08:59.117985 28010 pending_rounds.cc:107] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:59.118294 28010 raft_consensus.cc:2889] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:59.122680 28480 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.123144 28480 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.124140 28480 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.107731 28522 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.133579 28488 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.134229 28488 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.134577 28516 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.136238 28498 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.137039 28565 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.156711 28565 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:59.133438 28506 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.157281 28565 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.141491 28508 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:59.159832 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.141736 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.168123 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.135027 28516 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.141852 27164 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 2 to 3, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 3 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:59.169858 28522 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.139599 28520 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.179340 28526 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.136185 28545 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.139739 28487 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.179504 27259 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:59.190224 28562 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.185045 27334 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
W20260709 13:08:59.189481 28575 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:08:59.194175 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.179960 28498 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:59.112565 28551 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.194650 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.192186 28487 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.209339 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.211328 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.218089 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.170053 28488 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.219334 28527 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.221700 28487 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.200177 28506 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:59.215070 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.213713 28522 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.213853 28569 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.214027 28539 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.216529 28526 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.220216 28491 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.221726 28488 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.238833 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.240109 28487 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.204499 28562 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:08:59.246431 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 214972us
I20260709 13:08:59.213371 28516 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.252170 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.259550 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.238068 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:08:59.279930 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45362us
I20260709 13:08:59.280802 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.282011 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.283033 28571 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.283073 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.283778 28571 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.283911 28531 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.285142 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.286028 28526 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.287261 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.287959 28526 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.289124 27978 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.289839 28526 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.290117 28571 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:59.292249 28520 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:59.293406 28520 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.263655 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.243953 28573 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:08:59.297578 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.263408 28566 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.261768 28522 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.261441 28506 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:59.301383 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 93210.2us
I20260709 13:08:59.268266 28570 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.299786 28547 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.305089 28573 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:59.318348 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.320012 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.323307 28576 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:59.333550 28576 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.326100 28566 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.313730 28545 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:59.311430 28522 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.328415 28543 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:59.307089 28515 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:59.339871 28543 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.329041 28491 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:08:59.318049 28573 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.330608 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:59.331338 28564 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.332420 27417 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.337464 27409 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.342108 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.348531 27413 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.351862 28551 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.334528 28576 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.353169 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:59.353950 28578 ts_tablet_manager.cc:933] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:08:59.354318 28491 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.355512 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:59.357079 27233 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.350428 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:08:59.358197 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.359337 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:08:59.368394 28515 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.370911 27414 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.309077 28561 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:59.363621 27309 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.367312 27417 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.372852 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.373948 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.374789 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.372519 27417 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.346009 28570 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.377161 28573 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.379865 27417 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.428639 27417 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.441027 27262 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.441033 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.444169 28569 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.444653 28569 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:59.445063 28569 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.365068 28522 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.451210 28581 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.451741 28581 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.452796 28581 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.454555 28581 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:59.457338 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 401817us
I20260709 13:08:59.450541 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:59.381269 28547 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.460590 27413 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.384920 28539 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:59.378211 28483 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.462373 28571 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.461834 28573 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:59.472764 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.476025 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:08:59.479732 28571 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:59.471850 28508 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:59.468604 28570 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.489295 28571 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.468815 28539 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:08:59.511184 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 136426us
I20260709 13:08:59.496399 28543 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:59.500682 28527 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:59.505560 27417 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:59.480360 28576 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:59.512253 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.483467 28564 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:08:59.484702 28552 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.519767 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:08:59.520757 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.511023 28578 tablet_copy_client.cc:323] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
I20260709 13:08:59.513517 28539 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.528532 27264 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:59.506728 27334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:44086
W20260709 13:08:59.529481 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58587.5us
I20260709 13:08:59.512789 28508 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.533527 28549 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:59.536309 27410 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.544130 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.515558 28527 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:08:59.530503 27411 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.525374 28570 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.548403 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet 4b44d9e3827f45eabce8235344e58d0f from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:08:59.553187 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.555382 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.532706 28566 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.556741 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.546936 27334 raft_consensus.cc:606] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.560202 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:08:59.547034 28549 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.548848 28585 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.565505 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.531591 28565 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.570298 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.569430 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.574873 27342 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.556747 28553 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:59.578058 28553 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:08:59.579902 27263 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:59.580922 27261 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:59.582253 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.563580 28498 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.555665 28589 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.565042 28487 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.578506 28553 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:59.569170 28522 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.586570 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:59.590085 27340 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:08:59.576601 28561 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.578791 27337 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:08:59.565346 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet 4b44d9e3827f45eabce8235344e58d0f from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-4b44d9e3827f45eabce8235344e58d0f
I20260709 13:08:59.587463 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:59.573992 28562 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:59.592744 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.592818 28522 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:08:59.592773 27265 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.593206 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.593952 28503 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.595314 27337 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.597252 28516 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.586606 28491 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.599298 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.619630 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.611931 27337 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.589996 28508 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.599615 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:59.673022 27410 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:59.673578 28565 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:59.615043 28503 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.674820 28503 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.677412 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:08:59.678124 28556 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.002s
I20260709 13:08:59.678524 28556 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.678399 27337 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:08:59.681905 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.678966 27341 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.683678 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.599153 28539 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.603086 28522 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.708334 28539 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:59.710875 27342 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:59.715224 27338 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.715600 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.715830 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.717428 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.721292 27341 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:08:59.722328 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69101.9us
I20260709 13:08:59.724843 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:59.726832 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.727743 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.730382 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.712877 27337 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:59.737866 28490 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:59.740473 28561 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:59.741730 28595 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:08:59.729996 28491 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.758538 28491 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.759531 28491 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.760694 28548 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.761132 28548 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:59.761240 27338 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.761938 28595 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.764283 28595 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.765048 28539 raft_consensus.cc:993] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: : Instructing follower b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:08:59.734118 28576 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.752358 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.753719 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.757345 27342 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.768360 27343 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:08:59.772063 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:08:59.782187 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:08:59.782509 27343 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:59.766042 28579 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.791109 27337 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:59.791221 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:59.791908 28007 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:59.790158 28595 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.794751 28595 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:08:59.794997 28571 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:59.795825 28595 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.777442 28576 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.796311 27278 tablet_copy_source_session.cc:215] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:59.761955 28548 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.800043 28576 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.778743 28540 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.777020 28564 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:59.796800 28569 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.784046 28490 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:59.797353 28579 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.808445 27342 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:59.881289 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.802906 28490 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:08:59.889715 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 165800us
I20260709 13:08:59.882282 28543 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:08:59.885720 28490 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:59.897468 28569 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:08:59.899453 28579 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.811816 28553 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.894163 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:08:59.910816 28553 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.930047 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:59.939321 28490 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:08:59.940845 28548 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.941898 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:08:59.942498 28602 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:08:59.944614 28508 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:59.944999 28480 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.945533 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:08:59.946092 28506 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.946171 27338 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.946517 28506 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.947463 28506 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.945628 28508 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:59.953972 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.954588 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:08:59.955559 28012 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:08:59.955968 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:08:59.954902 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:08:59.965121 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:08:59.973383 27338 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:08:59.941700 28490 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:08:59.982649 27340 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.965570 28508 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:59.995730 28508 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.996251 28508 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:08:59.997886 27335 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:08:59.993070 28549 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.002120 28549 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.002236 27338 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:00.004748 28571 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.983373 28600 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:00.007499 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.008972 28490 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:59.988044 28561 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:59.997334 28508 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:08:59.998960 27336 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:00.010648 28578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b44d9e3827f45eabce8235344e58d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:59.928506 28007 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:00.013756 27261 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:00.014382 28508 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.976802 28564 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.012212 28552 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:00.026048 28564 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.026552 28564 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.029584 28487 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:00.030562 28571 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:00.031946 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.032429 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.032987 27263 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.033294 27263 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:00.034137 27263 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.035817 28527 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.037118 28527 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.039621 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.040449 28561 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:00.041568 28561 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.043641 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.044239 28487 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:00.044497 27264 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:00.044783 28487 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:00.044559 28592 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.373s	user 0.000s	sys 0.011s
I20260709 13:09:00.045990 28487 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.047209 28556 raft_consensus.cc:1081] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Signalling peer b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:09:00.050100 28552 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.050683 28552 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:00.050769 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:00.062849 28552 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.060103 28010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:55768
I20260709 13:09:00.064450 28010 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.064610 28552 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.064896 28010 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.051455 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:00.066252 27408 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:00.051632 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:00.060698 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:00.069793 28543 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.069494 27163 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.070518 28543 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:00.071802 28543 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.020515 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.080683 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:00.085336 28487 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.085429 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:00.093086 27263 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:59.989995 28548 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:00.099125 27409 raft_consensus.cc:606] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:00.102738 27408 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:00.104621 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:00.009398 28490 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:00.121770 27411 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:00.121894 28010 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.141294 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:00.142936 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:00.151983 28553 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.116967 28581 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.175800 27340 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:00.166227 28553 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:00.166735 28581 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:00.191025 27335 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.200858 28527 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:00.202454 28506 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.208868 27161 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.210924 27161 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.213788 27161 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.215303 27161 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:00.216660 28553 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.155951 28490 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.222725 28581 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.228036 28564 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.229848 28010 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:00.240473 27342 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.246201 27260 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.249151 28012 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.250232 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:00.250576 28009 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:00.250957 27334 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.251384 27334 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:00.260581 27263 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:00.262679 28537 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:00.240247 28491 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:09:00.269227 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 376990us
W20260709 13:09:00.275358 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 306445us
I20260709 13:09:00.273986 28598 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.299046 27260 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.262943 27334 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.285334 28480 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:09:00.301774 28520 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.321211 28520 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.302299 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:00.302914 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:00.326144 27260 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:00.308614 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.307859 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:00.351263 27417 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:00.356467 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:00.315820 27334 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.316941 28480 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:00.325847 28604 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.337642 28487 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.337364 28552 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.318159 28483 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:00.307503 28571 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:00.384678 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.334313 28598 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.385444 27338 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:00.368341 28606 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.361585 28480 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:00.365864 28540 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:00.392541 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:00.391654 28579 raft_consensus.cc:993] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:09:00.390029 28487 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:00.407140 27261 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:00.408259 28487 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.410166 27260 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:00.411055 28595 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:00.411664 28595 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:00.384804 28604 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.412555 28595 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.413792 28604 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.383608 27259 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:09:00.414597 27259 raft_consensus.cc:606] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:00.412940 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:00.414975 27259 raft_consensus.cc:614] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:00.429804 27260 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.394156 28520 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.414919 28579 raft_consensus.cc:1081] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:09:00.436463 28564 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.397903 28606 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.431843 28527 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:00.414935 28569 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 13:09:00.545729 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 106738us
W20260709 13:09:00.548751 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125078us
I20260709 13:09:00.549117 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:00.549232 27334 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:00.549930 28007 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:00.549831 28619 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:00.553583 27338 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.556128 27338 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:00.563524 27261 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:00.573719 27259 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.562440 28599 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:00.567589 27414 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:00.583876 28527 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:00.584647 28627 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:00.585680 28627 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.585716 28527 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.576717 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:00.594969 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:00.596920 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.597908 27343 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:00.601004 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:00.596249 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:00.589722 28627 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:00.628366 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 58764.3us
I20260709 13:09:00.579726 28490 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.643469 27413 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.618710 28540 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.633365 28483 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:00.659978 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.611613 28508 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:00.658960 28625 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:00.639912 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 62118.6us
I20260709 13:09:00.634255 28604 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:09:00.642112 28506 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:09:00.686579 28598 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:00.667346 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:00.687646 28625 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:00.689234 28548 consensus_meta.cc:287] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.012s
I20260709 13:09:00.689337 27410 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:00.619484 28599 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.671434 28483 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.719580 28606 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.722350 28578 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55770 (request call id 203) took 1712 ms. Trace:
I20260709 13:09:00.724752 28625 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.678128 28540 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.742280 28540 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.737202 28578 rpcz_store.cc:276] 0709 13:08:59.012199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.020103 (+  7904us) service_pool.cc:224] Handling call
0709 13:08:59.365727 (+345624us) ts_tablet_manager.cc:934] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
0709 13:09:00.008539 (+642812us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:00.354161 (+345622us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:00.360286 (+  6125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:00.721334 (+361048us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:00.721782 (+   448us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:00.722181 (+   399us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:00.722257 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4369,"tablet-copy.queue_time_us":283763,"thread_start_us":353056,"threads_started":2}
I20260709 13:09:00.745796 28599 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.747884 28578 tablet_copy_client.cc:806] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:00.753317 28578 tablet_copy_client.cc:670] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:00.736055 28483 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.763427 28627 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:00.320443 28556 consensus_queue.cc:1175] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b0e4232110db400d8f43fe2170c24c95" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:00.765213 28627 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.781343 28480 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:00.792359 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 197468us
W20260709 13:09:00.802655 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 224066us
I20260709 13:09:00.809566 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.810717 27337 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:00.819840 28480 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.833775 28599 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.836311 28599 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.838315 28599 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:00.838498 28483 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.847932 28627 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:00.861858 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:00.863924 28543 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:00.864480 28543 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.864876 28543 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.872069 27342 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:00.877192 28015 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.885819 28506 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:00.886372 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:00.886582 28506 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.887135 28013 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:00.888592 28503 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:09:00.890946 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:00.898619 28007 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.891800 27334 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:00.908123 28483 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.909267 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.910141 27341 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:00.894277 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:00.924182 28009 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:00.893047 28520 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:00.892832 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:00.928133 27337 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:00.937414 28543 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.892576 28506 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:00.953089 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:00.956700 28490 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.957257 27263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59104
I20260709 13:09:00.957304 28490 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.957943 27263 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.958110 28628 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.958392 27263 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:00.958635 28628 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:00.960162 28490 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:00.961211 28628 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:00.962961 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.966195 27263 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:00.966831 28508 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:00.968160 28579 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:00.969899 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:00.968565 28543 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:00.968719 28579 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:00.979390 28576 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:00.982569 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 344902us
I20260709 13:09:00.986289 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:00.986680 28579 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:00.945609 28553 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:09:00.998167 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.001046 27264 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:00.987403 27265 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:01.003261 27335 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:01.005860 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.006588 27261 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:01.009347 28578 tablet_copy_client.cc:538] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:01.009852 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:00.999647 27267 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.026261 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:00.981401 28007 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:01.031388 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 392551us
I20260709 13:09:01.032374 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:01.033077 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:00.986960 28576 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:01.042219 27338 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:09:01.057631 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51784.4us
I20260709 13:09:01.034572 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.047086 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:01.060670 27341 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.055539 28010 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.034260 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:01.068569 27336 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:01.070339 27263 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.030200 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:00.998675 27337 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:01.077390 28619 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:01.061746 28009 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.061350 28576 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.069937 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.080322 28628 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.089188 27340 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:01.072762 28543 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.079838 28619 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.076107 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:01.079857 27334 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.103587 28540 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.088610 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:01.090778 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:01.104471 28008 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.086127 28548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48150 (request call id 6) took 3627 ms. Trace:
I20260709 13:09:01.091660 28012 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:01.107348 28556 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:01.107842 28619 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.107430 28540 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:01.108500 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.092535 28553 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.109656 28633 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:01.132092 28553 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.133257 28009 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:01.130203 28571 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.111474 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.134006 28571 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.134500 27334 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:01.115097 27338 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:01.130548 28569 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.136269 28569 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:01.137213 28569 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.075773 27341 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:01.128885 28556 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.131575 27266 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:01.100217 28543 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.142076 28522 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:01.146479 28008 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:01.147568 28543 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.142026 28540 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.139873 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:01.092790 28599 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:01.091444 28627 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:01.160348 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:01.161206 27341 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.163499 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:01.166695 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.130995 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:01.168399 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:01.181221 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.186038 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:01.189399 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 58507.6us
I20260709 13:09:01.177696 27411 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:01.194147 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.194921 27261 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:01.191675 28619 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.195957 28619 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:01.196504 28619 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.201064 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:01.201756 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.202497 27263 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:01.159761 28491 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.214828 27382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.042s
I20260709 13:09:01.190979 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:01.177114 28506 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.112494 28548 rpcz_store.cc:276] 0709 13:08:57.453732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.453880 (+   148us) service_pool.cc:224] Handling call
0709 13:08:57.553152 (+ 99272us) log.cc:844] Serialized 513 byte log entry
0709 13:08:57.815725 (+262573us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800100e40. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82b8ab0b 00007fbd82c0fb63 00007fbd82c37752 00007fbd87bf7d29
0709 13:09:01.081238 (+3265513us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34181,"raft.queue_time_us":110035,"raft.run_cpu_time_us":2157,"raft.run_wall_time_us":71379,"spinlock_wait_cycles":2784512,"thread_start_us":156994,"threads_started":1,"wal-append.queue_time_us":236156,"wal-append.run_cpu_time_us":2151,"wal-append.run_wall_time_us":1024332}
I20260709 13:09:01.204497 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:01.168401 28480 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:01.223924 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.035s
I20260709 13:09:01.207253 28581 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.203744 28635 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.207484 28516 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:01.220533 28491 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.220124 28571 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:01.247296 27414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.047s
W20260709 13:09:01.248824 27382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.006s	sys 0.043s
W20260709 13:09:01.283901 27414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.050s
I20260709 13:09:01.252143 28506 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:01.292374 28506 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.294584 27267 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:01.252339 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.295543 27340 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:01.253305 28598 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.296289 28010 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:01.296684 28598 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.297283 28598 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.276031 27266 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:01.254835 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.015s	sys 0.035s
W20260709 13:09:01.300045 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 670107us
I20260709 13:09:01.255112 28635 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.301095 28571 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:01.301470 28635 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.301594 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.301875 27266 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:01.257275 28491 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:01.249656 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58792.6us
I20260709 13:09:01.256384 28581 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.302335 27416 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.310489 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:01.311362 27416 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:01.311686 27416 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:01.300827 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:01.277801 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.307301 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:01.259511 28556 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.313311 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.314855 27412 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.307653 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.279326 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.322803 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.261883 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.277765 28579 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.324486 27410 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:01.324174 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.325657 27413 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4.
I20260709 13:09:01.329118 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:01.268925 28578 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:09:01.333657 28581 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.333978 28579 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.269796 28553 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.338003 28633 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:01.263895 28628 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.341317 28571 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:01.315809 27416 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.340955 28633 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.338966 28621 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:01.342423 28628 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.344858 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:01.349045 28571 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.352312 28571 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:01.350054 28581 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:01.297308 27341 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.372699 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:01.383536 28012 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:01.386233 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 181849us
I20260709 13:09:01.375437 27416 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.392549 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:01.278702 28576 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.356782 28621 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:01.344218 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:01.414644 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.420285 27413 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:01.415282 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.362411 28548 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.384420 28581 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.387073 28487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.008s	sys 0.046s
I20260709 13:09:01.421720 27414 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:01.385807 28480 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:01.362651 28009 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:01.391301 28483 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.431569 28630 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:01.432225 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:01.362080 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61354.6us
I20260709 13:09:01.399326 28556 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:01.429373 28487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.049s
I20260709 13:09:01.417752 28552 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.443768 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.444027 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:01.445410 27340 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:01.446378 28627 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.399510 28553 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:01.400305 28599 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:01.441017 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:01.461506 28632 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.446646 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:01.442723 28483 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:01.438107 28609 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.010s	sys 0.048s
I20260709 13:09:01.451040 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:01.411944 28600 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:09:01.442775 28007 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:01.470160 28625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.028s	sys 0.040s
I20260709 13:09:01.486961 27267 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.481467 28522 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:01.491726 28522 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.492133 28522 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:01.473268 28627 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.464237 28556 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:01.446074 28630 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.429427 28581 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:01.497869 28625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.028s	sys 0.041s
I20260709 13:09:01.469830 28552 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.498438 27340 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:01.482242 28609 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.010s	sys 0.048s
W20260709 13:09:01.461714 28515 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.019s	sys 0.030s
I20260709 13:09:01.504690 28556 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:01.507906 27334 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:01.507834 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:01.482896 28599 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:01.497395 27416 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:01.478255 28553 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.502436 28627 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:01.471009 28013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.023s	sys 0.030s
I20260709 13:09:01.499317 28619 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.501600 28621 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.541257 28543 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:01.542407 28543 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.542759 28543 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.543290 27409 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
W20260709 13:09:01.520004 28515 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.020s	sys 0.030s
I20260709 13:09:01.507855 28480 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.521713 28526 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.538466 28013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.023s	sys 0.030s
I20260709 13:09:01.501940 28632 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.565093 28632 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.541851 28619 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.516496 28635 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.569901 27263 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:01.572573 28526 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.573522 28581 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.546779 28576 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.561082 28516 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:09:01.587832 28526 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:01.567467 28598 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.606503 28487 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.609503 28483 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.607081 28487 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.591410 28633 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.612566 28553 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.614776 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.615581 27416 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:01.617137 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:01.612607 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:01.614445 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:01.620716 28011 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:01.580415 28630 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.590974 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:01.625795 27260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.005s	sys 0.036s
I20260709 13:09:01.594281 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:01.631623 27260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.006s	sys 0.036s
W20260709 13:09:01.623004 27259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.017s	sys 0.030s
I20260709 13:09:01.623842 28553 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:01.581040 28599 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:01.642751 27259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.017s	sys 0.030s
I20260709 13:09:01.672796 28553 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:01.685669 28635 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.745730 28487 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.747292 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:01.685249 28552 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:01.742853 28553 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:01.758311 27268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.031s	sys 0.058s
W20260709 13:09:01.765511 27268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.031s	sys 0.058s
I20260709 13:09:01.764930 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.769412 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:01.770334 28007 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:01.770514 28487 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:01.759413 28608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.013s	sys 0.056s
I20260709 13:09:01.771354 28632 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:01.757100 28628 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:01.775846 28608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.013s	sys 0.057s
I20260709 13:09:01.809466 28628 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.810555 28010 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:01.810248 28522 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.812716 28522 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.801131 28625 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:01.816738 28625 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:01.829895 28625 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.786880 28571 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:01.827903 28598 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.805210 27267 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:01.865614 27262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.014s	sys 0.023s
I20260709 13:09:01.874215 28014 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:01.887346 27262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.015s	sys 0.023s
I20260709 13:09:01.847395 28556 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:01.896652 27264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.004s	sys 0.032s
W20260709 13:09:01.897264 27264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.004s	sys 0.032s
W20260709 13:09:01.876345 27415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.016s	sys 0.029s
I20260709 13:09:01.888265 28634 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:01.964015 27415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.018s	sys 0.031s
I20260709 13:09:01.961105 27263 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:01.897742 27339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.013s	sys 0.024s
I20260709 13:09:01.963442 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:01.967803 27416 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:01.968187 27339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.013s	sys 0.024s
I20260709 13:09:01.974995 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1389) took 1397 ms. Trace:
I20260709 13:09:01.975598 27415 rpcz_store.cc:276] 0709 13:09:00.568224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.568351 (+   127us) service_pool.cc:224] Handling call
0709 13:09:00.568641 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.577855 (+  9214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.577888 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.623668 (+ 45780us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.983483 (+359815us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:01.964503 (+981020us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.964841 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.964931 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.964979 (+    48us) raft_consensus.cc:1685] finished
0709 13:09:01.964993 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.965139 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8633,"prepare.queue_time_us":897405,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":4286,"raft.queue_time_us":26711,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":18866,"thread_start_us":1285990,"threads_started":2,"wal-append.queue_time_us":522582}
W20260709 13:09:02.007722 28647 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:09:02.009109 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 334) took 1091 ms. Trace:
W20260709 13:09:02.009390 28644 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:09:02.009689 28013 rpcz_store.cc:276] 0709 13:09:00.918219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.918483 (+   264us) service_pool.cc:224] Handling call
0709 13:09:00.919010 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.919629 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.919667 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.920330 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.572370 (+652040us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:01.572434 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.574476 (+  2042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.008746 (+434270us) raft_consensus.cc:1685] finished
0709 13:09:02.008791 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.008995 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":131,"thread_start_us":645575,"threads_started":1,"wal-append.queue_time_us":955393}
I20260709 13:09:02.011561 27267 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:02.013063 28543 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:02.014400 27409 raft_consensus.cc:2368] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5.
I20260709 13:09:02.019889 28633 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:01.967059 28635 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.020505 28633 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.021365 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:02.021965 27410 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:02.022747 28633 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:01.966645 28625 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.023923 28625 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.020588 28635 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.003353 28552 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.027869 28552 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.030720 28543 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:02.055954 28487 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.058238 28625 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.058595 28487 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.059360 28635 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.060961 28487 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.064018 28552 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:02.065569 28556 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.092955 27263 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:02.093756 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 130018us
I20260709 13:09:02.097036 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:02.098637 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:02.100198 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:02.103578 27413 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:02.099502 27415 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:01.998858 28634 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.146136 27308 leader_election.cc:400] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5.
I20260709 13:09:02.144212 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:02.070605 28543 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:02.148605 27308 leader_election.cc:403] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:02.150484 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46327.9us
I20260709 13:09:02.134567 28522 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.151790 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:02.146705 28571 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:02.150508 28630 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.150172 28543 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:02.157318 28553 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:02.166157 27265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.025s	sys 0.044s
W20260709 13:09:02.167680 27265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.026s	sys 0.044s
I20260709 13:09:02.161037 28516 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:02.169772 27338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.024s	sys 0.030s
W20260709 13:09:02.176854 27338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.025s	sys 0.030s
W20260709 13:09:02.178213 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.019s	sys 0.025s
W20260709 13:09:02.178639 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.019s	sys 0.025s
W20260709 13:09:02.166040 28569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.020s	sys 0.034s
W20260709 13:09:02.174335 27335 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.013s	sys 0.074s
W20260709 13:09:02.183959 27335 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.014s	sys 0.074s
W20260709 13:09:02.180171 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 781268us
I20260709 13:09:02.147217 27263 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:02.168119 27411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.007s	sys 0.016s
I20260709 13:09:02.159574 28522 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:02.183722 28569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.020s	sys 0.034s
W20260709 13:09:02.231011 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.008s	sys 0.015s
I20260709 13:09:02.177719 28516 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.220562 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:02.239990 27233 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:02.220366 28540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.000s	sys 0.024s
W20260709 13:09:02.236506 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.008s	sys 0.015s
W20260709 13:09:02.228121 27411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.007s	sys 0.017s
W20260709 13:09:02.230194 27408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.013s	sys 0.014s
I20260709 13:09:02.221490 28639 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:02.249497 27414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.014s	sys 0.031s
W20260709 13:09:02.268294 27414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.014s	sys 0.031s
I20260709 13:09:02.243358 28516 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:02.249015 28012 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.865s	user 0.022s	sys 0.000s
I20260709 13:09:02.279024 27263 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
W20260709 13:09:02.250078 27408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.014s	sys 0.014s
W20260709 13:09:02.246483 28540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.025s
I20260709 13:09:02.243091 28598 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:02.303753 27341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.020s	sys 0.033s
I20260709 13:09:02.245996 28638 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:02.269078 27234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.007s	sys 0.043s
W20260709 13:09:02.304456 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.025s	sys 0.032s
W20260709 13:09:02.326349 27234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.009s	sys 0.043s
W20260709 13:09:02.306475 28627 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.758s	user 0.014s	sys 0.003s
W20260709 13:09:02.279354 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.025s	sys 0.032s
I20260709 13:09:02.326195 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:02.270581 28552 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:02.320907 27341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.021s	sys 0.033s
I20260709 13:09:02.318192 28012 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:02.332206 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.017s	sys 0.033s
W20260709 13:09:02.394634 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.017s	sys 0.033s
W20260709 13:09:02.395021 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 948394us
I20260709 13:09:02.268752 28639 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:02.328163 27233 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4.
I20260709 13:09:02.385679 27263 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:02.407155 27233 leader_election.cc:403] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:02.365299 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.006s	sys 0.022s
W20260709 13:09:02.408375 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.007s	sys 0.022s
W20260709 13:09:02.327741 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.025s	sys 0.032s
W20260709 13:09:02.333633 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.025s	sys 0.032s
W20260709 13:09:02.391314 28599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.010s	sys 0.017s
W20260709 13:09:02.329108 28506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.011s	sys 0.016s
W20260709 13:09:02.386198 27343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.316s	user 0.020s	sys 0.044s
W20260709 13:09:02.453860 27343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.384s	user 0.020s	sys 0.044s
W20260709 13:09:02.368049 27266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.027s	sys 0.049s
W20260709 13:09:02.469455 27261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.010s	sys 0.020s
W20260709 13:09:02.471383 27261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.273s	user 0.011s	sys 0.020s
W20260709 13:09:02.455190 28599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.010s	sys 0.019s
I20260709 13:09:02.480167 28634 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:02.480513 28648 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:09:02.480825 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 973021us
I20260709 13:09:02.481724 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:02.482448 27334 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.393929 28631 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:02.483448 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:02.483659 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:02.363866 28627 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:02.484241 28522 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:02.450006 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:02.485265 27263 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:02.453672 28553 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:02.394155 28621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.012s	sys 0.044s
W20260709 13:09:02.453722 28506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.013s	sys 0.016s
I20260709 13:09:02.468321 28543 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:02.466619 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:02.470949 27266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.029s	sys 0.055s
I20260709 13:09:02.484408 28014 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:02.446611 28571 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:02.385776 28609 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.023s	sys 0.044s
W20260709 13:09:02.500654 27340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.045s	sys 0.059s
W20260709 13:09:02.537612 27340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.046s	sys 0.059s
W20260709 13:09:02.447105 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 119899us
I20260709 13:09:02.509276 27342 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:02.513859 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:02.482910 28491 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:02.540642 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:02.510586 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:02.543533 27413 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:02.543736 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:02.435086 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 340) took 1048 ms. Trace:
I20260709 13:09:02.543843 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:02.549692 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:02.550917 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:02.551783 27342 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:02.557906 27263 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:02.448169 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 902898us
I20260709 13:09:02.566345 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:02.567615 28008 raft_consensus.cc:2368] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5.
I20260709 13:09:02.455503 28635 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4.
I20260709 13:09:02.570142 28635 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:02.499755 28621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.012s	sys 0.044s
W20260709 13:09:02.544934 28515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.008s	sys 0.033s
W20260709 13:09:02.571339 28515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.008s	sys 0.033s
W20260709 13:09:02.544139 28609 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.023s	sys 0.045s
W20260709 13:09:02.542546 28009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.020s	sys 0.015s
I20260709 13:09:02.484429 27409 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:02.510082 28618 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.511590 28553 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:02.426506 28552 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.558822 28508 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.573975 28608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.008s	sys 0.033s
I20260709 13:09:02.580075 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:02.602259 28649 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
I20260709 13:09:02.603281 28526 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:02.603868 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1540) took 1625 ms. Trace:
I20260709 13:09:02.603904 28526 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:02.604467 27260 rpcz_store.cc:276] 0709 13:09:00.978500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.979831 (+  1331us) service_pool.cc:224] Handling call
0709 13:09:00.980167 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:00.980542 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.980570 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:00.981146 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:09:01.634360 (+653214us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:01.634705 (+   345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.634783 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.603593 (+968810us) raft_consensus.cc:1685] finished
0709 13:09:02.603616 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.603810 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12129,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":652762,"threads_started":1,"wal-append.queue_time_us":1172974}
I20260709 13:09:02.606559 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:02.607208 28526 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:02.575937 28009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.021s	sys 0.015s
I20260709 13:09:02.585242 28638 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:02.607828 28652 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:02.608180 28638 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:02.608435 28526 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:02.608987 28526 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:02.609416 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1536) took 1573 ms. Trace:
I20260709 13:09:02.609210 28638 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:02.584308 28578 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.024s	sys 0.019s
W20260709 13:09:02.610858 28578 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.024s	sys 0.019s
I20260709 13:09:02.609902 27339 rpcz_store.cc:276] 0709 13:09:01.035537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.035625 (+    88us) service_pool.cc:224] Handling call
0709 13:09:01.035909 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.036240 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.036268 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.055836 (+ 19568us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.969391 (+913555us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:01.969428 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.969486 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.609113 (+639627us) raft_consensus.cc:1685] finished
0709 13:09:02.609152 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.609318 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18210,"raft.queue_time_us":15392,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2433,"thread_start_us":913115,"threads_started":1,"wal-append.queue_time_us":1272642}
I20260709 13:09:02.580734 28618 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.614523 27260 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:02.616140 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:02.558792 28571 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:02.607447 28655 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:09:02.561659 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1537) took 1554 ms. Trace:
W20260709 13:09:02.561009 28480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.002s	sys 0.048s
I20260709 13:09:02.562296 28491 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.580626 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 799) took 1323 ms. Trace:
I20260709 13:09:02.620643 27263 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:02.559111 28012 rpcz_store.cc:276] 0709 13:09:01.364283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.372323 (+  8040us) service_pool.cc:224] Handling call
0709 13:09:02.412269 (+1039946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:02.582901 28633 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:02.584626 28508 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:02.622120 28608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.008s	sys 0.034s
I20260709 13:09:02.622929 27260 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:02.631270 28480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.002s	sys 0.048s
I20260709 13:09:02.661656 27413 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:02.662089 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:02.662760 27263 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:02.583603 28553 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.666700 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:02.670629 28663 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 13:09:02.670830 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 800) took 1626 ms. Trace:
I20260709 13:09:02.672259 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 802) took 1199 ms. Trace:
I20260709 13:09:02.664610 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:02.674168 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 55) took 1686 ms. Trace:
I20260709 13:09:02.674105 27263 raft_consensus.cc:2368] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:02.671437 27262 rpcz_store.cc:276] 0709 13:09:01.044057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.044212 (+   155us) service_pool.cc:224] Handling call
0709 13:09:01.071748 (+ 27536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.082836 (+ 11088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.082885 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.084137 (+  1252us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.207920 (+123783us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b48002907d8. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd87b5aaa1 00007fbd87b51b37 00007fbd87b519ca 00007fbd87c4926f 00007fbd87c48f37 00007fbd87c5d55c 00007fbd87c5d508 00007fbd87c5d488 00007fbd87c5d443 00007fbd87c5c6ec 00007fbd86b86a96
0709 13:09:01.888020 (+680100us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:01.888092 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.889007 (+   915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.666317 (+777310us) raft_consensus.cc:1685] finished
0709 13:09:02.666345 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.670733 (+  4388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11984,"raft.queue_time_us":11019,"raft.run_cpu_time_us":3698,"raft.run_wall_time_us":123865,"spinlock_wait_cycles":11808000,"thread_start_us":774039,"threads_started":1,"wal-append.queue_time_us":1176875}
I20260709 13:09:02.681550 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:02.682431 27263 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:02.667591 27410 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
W20260709 13:09:02.669091 28662 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:09:02.674798 27265 rpcz_store.cc:276] 0709 13:09:00.988073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.014751 (+ 26678us) service_pool.cc:224] Handling call
0709 13:09:01.026281 (+ 11530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.026686 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.026720 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.037717 (+ 10997us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.179775 (+1142058us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.179833 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.179927 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.673923 (+493996us) raft_consensus.cc:1685] finished
0709 13:09:02.673943 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.674103 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8549,"raft.queue_time_us":540,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":24950,"thread_start_us":1084409,"threads_started":1,"wal-append.queue_time_us":1496983}
I20260709 13:09:02.681138 28618 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.663952 28526 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.672693 27414 rpcz_store.cc:276] 0709 13:09:01.473027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.473318 (+   291us) service_pool.cc:224] Handling call
0709 13:09:01.473763 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.474023 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.474061 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.483349 (+  9288us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.268776 (+785427us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.268832 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.268906 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.672052 (+403146us) raft_consensus.cc:1685] finished
0709 13:09:02.672072 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.672197 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":757680,"threads_started":1,"wal-append.queue_time_us":1080145}
I20260709 13:09:02.672735 28639 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:02.677214 28480 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:02.699361 27410 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:02.713789 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 65) took 1514 ms. Trace:
W20260709 13:09:02.720228 28643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.017s	sys 0.029s
W20260709 13:09:02.720752 28643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.017s	sys 0.029s
I20260709 13:09:02.632930 27411 rpcz_store.cc:276] 0709 13:09:01.257181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.257347 (+   166us) service_pool.cc:224] Handling call
0709 13:09:01.257759 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.258210 (+   451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.258272 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.258965 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.269946 (+1010981us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.270323 (+   377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.307041 (+ 36718us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.572145 (+265104us) raft_consensus.cc:1685] finished
0709 13:09:02.573482 (+  1337us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.579152 (+  5670us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2659,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":989922,"threads_started":1,"wal-append.queue_time_us":1285508}
I20260709 13:09:02.715271 27338 rpcz_store.cc:276] 0709 13:09:01.199806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.201140 (+  1334us) service_pool.cc:224] Handling call
0709 13:09:01.201529 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.204583 (+  3054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.204613 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.209100 (+  4487us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.177402 (+968302us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.177449 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.177554 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.613290 (+435736us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:02.713441 (+100151us) raft_consensus.cc:1685] finished
0709 13:09:02.713468 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.713714 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2492,"raft.queue_time_us":4616,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":70803328,"thread_start_us":870417,"threads_started":1,"wal-append.queue_time_us":1003918}
I20260709 13:09:02.668390 28633 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:02.728178 27306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.006s	sys 0.026s
W20260709 13:09:02.729321 27306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.006s	sys 0.026s
W20260709 13:09:02.729734 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 572821us
W20260709 13:09:02.720301 28660 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:09:02.736089 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1425) took 1348 ms. Trace:
I20260709 13:09:02.739391 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1534) took 1708 ms. Trace:
I20260709 13:09:02.736665 27341 rpcz_store.cc:276] 0709 13:09:01.387422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.389612 (+  2190us) service_pool.cc:224] Handling call
0709 13:09:01.390045 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.429056 (+ 39011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.429088 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.431659 (+  2571us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.444556 (+ 12897us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18001b98e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:02.387127 (+942571us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.387211 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.387313 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.725363 (+338050us) raft_consensus.cc:1685] finished
0709 13:09:02.725385 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.736018 (+ 10633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33408,"raft.queue_time_us":33611,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":27604,"spinlock_wait_cycles":5314304,"thread_start_us":942351,"threads_started":1,"wal-append.queue_time_us":1191114}
I20260709 13:09:02.740074 27335 rpcz_store.cc:276] 0709 13:09:01.031045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.031381 (+   336us) service_pool.cc:224] Handling call
0709 13:09:01.031779 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.051862 (+ 20083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.051914 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.063158 (+ 11244us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.184431 (+1121273us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.184486 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.184582 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.739040 (+554458us) raft_consensus.cc:1685] finished
0709 13:09:02.739070 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.739310 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46640,"raft.queue_time_us":19782,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15758,"thread_start_us":1098495,"threads_started":1,"wal-append.queue_time_us":1142299}
W20260709 13:09:02.728956 28556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.022s	sys 0.013s
I20260709 13:09:02.755295 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:02.724203 28627 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:02.758565 28014 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
W20260709 13:09:02.766232 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 370534us
W20260709 13:09:02.768514 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.013s	sys 0.025s
W20260709 13:09:02.768986 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.013s	sys 0.025s
W20260709 13:09:02.769372 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 604434us
W20260709 13:09:02.758196 28556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.022s	sys 0.013s
I20260709 13:09:02.725085 28480 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:02.765018 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:02.758906 28552 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:02.762079 28491 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:02.811981 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.021s
W20260709 13:09:02.812531 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.013s	sys 0.021s
I20260709 13:09:02.629562 27259 rpcz_store.cc:276] 0709 13:09:00.957330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.960898 (+  3568us) service_pool.cc:224] Handling call
0709 13:09:00.961361 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.961754 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.961810 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.962487 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.697906 (+735419us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:01.697961 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.698078 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.484696 (+786618us) raft_consensus.cc:1685] finished
0709 13:09:02.499408 (+ 14712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.511534 (+ 12126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3025,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"thread_start_us":732627,"threads_started":1,"wal-append.queue_time_us":1207516}
W20260709 13:09:02.802071 28651 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.325s	user 0.005s	sys 0.000s
I20260709 13:09:02.802927 28631 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:09:02.847746 28598 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:02.949474 27381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.010s	sys 0.020s
I20260709 13:09:02.850870 28522 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:02.953878 27381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.010s	sys 0.020s
I20260709 13:09:02.862747 28571 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:02.818392 28487 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.018s	sys 0.030s
W20260709 13:09:02.959481 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.017s	sys 0.041s
W20260709 13:09:02.962620 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.017s	sys 0.042s
I20260709 13:09:02.876065 28012 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:02.865891 28552 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.965569 28571 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:02.965682 28526 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:02.969985 28674 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:02.872763 28556 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:02.988876 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 480077us
I20260709 13:09:03.184157 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:02.954483 28673 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.152871 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.036s	sys 0.038s
W20260709 13:09:03.361573 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.037s	sys 0.063s
W20260709 13:09:03.362943 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 52622.8us
W20260709 13:09:03.362900 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 819203us
W20260709 13:09:02.962164 28487 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.019s	sys 0.030s
I20260709 13:09:03.279524 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 809) took 1583 ms. Trace:
I20260709 13:09:03.466831 27262 rpcz_store.cc:276] 0709 13:09:01.696026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.688718 (+992692us) service_pool.cc:224] Handling call
0709 13:09:02.689235 (+   517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.689688 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.689729 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.711794 (+ 22065us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.166708 (+454914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:03.166769 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.166868 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.279098 (+112230us) raft_consensus.cc:1685] finished
0709 13:09:03.279135 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.279393 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6020,"raft.queue_time_us":137,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7396,"thread_start_us":428254,"threads_started":1,"wal-append.queue_time_us":552629}
I20260709 13:09:03.468669 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:03.256686 27306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.025s	sys 0.018s
I20260709 13:09:02.963950 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 54) took 1976 ms. Trace:
W20260709 13:09:03.469187 27306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.027s	sys 0.027s
I20260709 13:09:02.952728 28627 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:03.167794 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.012s	sys 0.026s
W20260709 13:09:03.471019 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.021s	sys 0.053s
W20260709 13:09:03.471451 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 932267us
I20260709 13:09:03.329324 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:03.236714 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:03.284811 27334 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.802s	user 0.011s	sys 0.002s
I20260709 13:09:02.961984 28599 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:02.962208 28491 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:03.265092 28678 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:09:03.136799 28661 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.475s	user 0.001s	sys 0.000s
I20260709 13:09:02.955893 28598 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.264636 28686 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.136963 28522 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:03.166288 28630 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.004s	user 0.012s	sys 0.000s
I20260709 13:09:03.234118 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:03.281180 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:03.110742 28515 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.330166 28556 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.193537 28553 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.136808 28506 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.281769 28689 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.261425 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 248) took 1647 ms. Trace:
I20260709 13:09:03.270287 28631 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:03.256417 28691 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.217192 28688 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.216605 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:03.166260 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1546) took 2175 ms. Trace:
I20260709 13:09:03.191594 28687 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.142696 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:03.216866 27267 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.205s	user 0.007s	sys 0.005s
I20260709 13:09:03.469244 27264 rpcz_store.cc:276] 0709 13:09:00.987814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.005517 (+ 17703us) service_pool.cc:224] Handling call
0709 13:09:01.062297 (+ 56780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.062488 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:01.967508 (+905020us) log.cc:844] Serialized 14 byte log entry
0709 13:09:02.963493 (+995985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:02.963564 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:02.963632 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.963726 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.963881 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17224,"prepare.queue_time_us":1203561,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":196892,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":18280,"thread_start_us":1811089,"threads_started":2,"wal-append.queue_time_us":1308708}
W20260709 13:09:03.518116 28683 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.518s	user 0.001s	sys 0.000s
I20260709 13:09:03.261897 28665 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.136739 28666 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:03.484300 28677 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.529s	user 0.000s	sys 0.001s
I20260709 13:09:03.484292 28690 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:09:03.485316 28008 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 246) took 1904 ms (client timeout 2145 ms). Trace:
I20260709 13:09:03.485128 28491 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.109100 28571 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.055346 28552 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.332501 28692 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.155s
I20260709 13:09:03.494513 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:03.484328 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:03.495054 28699 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.495695 28671 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.626s	user 0.001s	sys 0.000s
W20260709 13:09:03.496183 28680 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.529s	user 0.000s	sys 0.001s
I20260709 13:09:03.366940 28674 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:03.640236 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet d0aa2cbbfc6b45fe8d8f862c301f1909: Illegal state: Replica d02eb2355bc54e7f8c13a30c33793d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:03.497840 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:03.640925 27335 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:03.499377 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:03.500675 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:03.372985 28673 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:03.504155 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 139976us
W20260709 13:09:03.582834 28008 rpcz_store.cc:269] 0709 13:09:01.581096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.582332 (+  1236us) service_pool.cc:224] Handling call
0709 13:09:03.485044 (+1902712us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540060ead4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:03.485230 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013150080}
I20260709 13:09:03.513258 27263 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:03.367691 28526 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.516279 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:03.524331 28689 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:03.482553 27334 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:03.522778 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:03.496855 28630 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5.
I20260709 13:09:03.521903 27268 rpcz_store.cc:276] 0709 13:09:00.984707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.984834 (+   127us) service_pool.cc:224] Handling call
0709 13:09:00.985222 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.992758 (+  7536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.992787 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.998744 (+  5957us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.765998 (+767254us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:01.766053 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.766192 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.570824 (+804632us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:03.155824 (+585000us) raft_consensus.cc:1685] finished
0709 13:09:03.155847 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.160157 (+  4310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7128,"raft.queue_time_us":7434,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":5188864,"thread_start_us":766782,"threads_started":1,"wal-append.queue_time_us":1222206}
I20260709 13:09:03.217550 28633 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.482936 28627 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.512516 28556 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:03.660727 28491 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:03.661309 28491 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.661826 28491 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.492002 28599 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.664064 28491 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:03.519284 28553 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:03.521754 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 798) took 2336 ms. Trace:
I20260709 13:09:03.525220 28487 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.664577 28491 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.497632 28686 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.537535 27411 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:03.523844 28691 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.526947 28480 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.534437 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:03.587409 28665 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.518867 28009 rpcz_store.cc:276] 0709 13:09:01.613673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.621292 (+  7619us) service_pool.cc:224] Handling call
0709 13:09:01.635902 (+ 14610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.685563 (+ 49661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.687415 (+  1852us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.777183 (+ 89768us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.608036 (+830853us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.608091 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.608174 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.193461 (+585287us) raft_consensus.cc:1685] finished
0709 13:09:03.195922 (+  2461us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.247413 (+ 51491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11135,"thread_start_us":830452,"threads_started":1,"wal-append.queue_time_us":1021334}
I20260709 13:09:03.726284 28665 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:03.726994 27265 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:09:03.727607 28686 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.729050 28526 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.729596 28526 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:03.730123 28526 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:03.630062 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 135596us
I20260709 13:09:03.536250 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 808) took 1955 ms. Trace:
I20260709 13:09:03.743564 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 224) took 1286 ms. Trace:
I20260709 13:09:03.743872 28571 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.744406 28480 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.528198 28667 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.533365 28696 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.588344 28578 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:09:03.521356 28506 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.515079 28515 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.523909 28631 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.528138 28688 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.643664 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:03.508566 28625 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.582875 28670 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:03.636134 28516 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.315s	user 0.007s	sys 0.006s
I20260709 13:09:03.649551 27339 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
W20260709 13:09:03.517521 28664 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.555s	user 0.000s	sys 0.001s
I20260709 13:09:03.635886 28608 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:03.651001 27341 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:03.653317 28706 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.589780 28666 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.664263 28552 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:03.666195 27413 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:03.667044 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:03.664709 28553 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.666774 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:03.665171 28491 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.676774 28709 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:03.536201 28540 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:03.664734 28653 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:09:03.536552 28687 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:03.669189 28685 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.639s	user 0.000s	sys 0.001s
I20260709 13:09:03.589289 28522 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.664984 28487 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.712852 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1426) took 2149 ms. Trace:
I20260709 13:09:03.688608 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1433) took 1191 ms. Trace:
I20260709 13:09:03.678053 28012 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:03.686946 28704 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.688941 28630 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.732813 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 41a124c306f9418a8556266f795a58b3: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:03.664732 27408 rpcz_store.cc:276] 0709 13:09:01.176466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.178440 (+  1974us) service_pool.cc:224] Handling call
0709 13:09:01.178785 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.179247 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.179314 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.179970 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.333731 (+1153761us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.365369 (+ 31638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.387008 (+ 21639us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.493294 (+1106286us) raft_consensus.cc:1685] finished
0709 13:09:03.493324 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.513269 (+ 19945us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1127444,"threads_started":1,"wal-append.queue_time_us":1393710}
I20260709 13:09:03.732103 28674 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.735879 28701 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.736568 28679 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:09:03.648918 28699 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.739148 28691 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:03.740604 28689 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.741923 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:03.742480 28718 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.747231 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 60) took 2433 ms. Trace:
I20260709 13:09:03.788487 27164 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 208) took 4828 ms. Trace:
I20260709 13:09:03.748407 28598 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:03.744939 28714 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:03.788910 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 180528us
I20260709 13:09:03.752353 28634 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:03.751534 28686 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.745057 28480 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.743185 27267 rpcz_store.cc:276] 0709 13:09:01.580392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.011156 (+430764us) service_pool.cc:224] Handling call
0709 13:09:02.011446 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.535819 (+1524373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.535861 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.535917 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:03.535952 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.536043 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.536193 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38617,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9555}
I20260709 13:09:04.040814 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:03.797407 27415 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:03.866314 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.047353 27414 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
W20260709 13:09:03.828554 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 183724us
I20260709 13:09:04.048466 28708 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:04.050429 28540 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.908162 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 803) took 2745 ms. Trace:
I20260709 13:09:04.046676 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:03.768913 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 400357us
I20260709 13:09:04.021647 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 343) took 1096 ms. Trace:
W20260709 13:09:04.041577 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 125877us
I20260709 13:09:04.058593 28508 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.117527 28014 rpcz_store.cc:276] 0709 13:09:02.925597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.961776 (+ 36179us) service_pool.cc:224] Handling call
0709 13:09:03.110352 (+148576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.659268 (+548916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.659301 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.659346 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.659373 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.021379 (+362006us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54005e38d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:04.021436 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.021585 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262040192}
I20260709 13:09:04.056135 27340 rpcz_store.cc:276] 0709 13:09:01.555814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.555951 (+   137us) service_pool.cc:224] Handling call
0709 13:09:01.556280 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.560083 (+  3803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.560126 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.562792 (+  2666us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.538200 (+975408us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.538263 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.538368 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.705137 (+1166769us) raft_consensus.cc:1685] finished
0709 13:09:03.705157 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.705281 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3350,"raft.queue_time_us":4377,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8509,"thread_start_us":956431,"threads_started":1,"wal-append.queue_time_us":1234625}
I20260709 13:09:04.054823 27261 rpcz_store.cc:276] 0709 13:09:01.162585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.195743 (+ 33158us) service_pool.cc:224] Handling call
0709 13:09:01.196232 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.196578 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.196613 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.197813 (+  1200us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.471863 (+1274050us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.471923 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.472035 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.907844 (+1435809us) raft_consensus.cc:1685] finished
0709 13:09:03.907883 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.908080 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1273590,"threads_started":1,"wal-append.queue_time_us":1620674}
W20260709 13:09:04.049455 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 382474us
I20260709 13:09:04.139812 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.065788 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:04.162863 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 97300.2us
I20260709 13:09:04.166563 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:04.019227 28682 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.909s	user 0.001s	sys 0.002s
I20260709 13:09:03.791754 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.172567 28638 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:04.072911 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1149454700000661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 13:09:04.174131 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.183835 27265 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:09:03.901007 28713 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.059500 28515 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:03.843693 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.045998 28578 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:04.060966 28608 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:03.828735 28722 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.182236 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:04.186699 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:04.066149 28526 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.187799 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.060442 28569 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:03.790555 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 108587us
I20260709 13:09:04.016660 28719 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:03.872828 27336 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:04.048700 28686 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.844046 28710 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.050676 28480 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:03.807412 28516 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.793586 28625 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.168295 28010 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:03.783205 28696 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.229846 27409 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:04.224370 28713 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:03.788865 28667 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.229717 28665 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.185096 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:04.182363 28674 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:04.231536 28578 tablet_bootstrap.cc:492] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:09:04.378170 28665 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.098258 28714 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.186038 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:03.846285 28556 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.181187 28709 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.173498 28718 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.116353 28630 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.378829 28578 ts_tablet_manager.cc:1403] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 3.110s	user 0.061s	sys 0.036s
I20260709 13:09:03.828800 28670 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.163197 28634 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:04.303539 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 251284us
I20260709 13:09:04.337728 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1416) took 3330 ms. Trace:
I20260709 13:09:04.057348 27334 rpcz_store.cc:276] 0709 13:09:02.477228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.481411 (+  4183us) service_pool.cc:224] Handling call
0709 13:09:03.668313 (+1186902us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:04.381438 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 199295us
I20260709 13:09:04.107812 28706 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.395180 28639 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:04.384660 28722 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.303858 28689 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.187558 28701 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.412284 27343 rpcz_store.cc:276] 0709 13:09:01.007117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.007711 (+   594us) service_pool.cc:224] Handling call
0709 13:09:01.008143 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.026620 (+ 18477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.026671 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.061009 (+ 34338us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.455275 (+1394266us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:02.455333 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.455433 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.337477 (+1882044us) raft_consensus.cc:1685] finished
0709 13:09:04.337496 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.337649 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17850,"raft.queue_time_us":17989,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2024,"thread_start_us":1384367,"threads_started":1,"wal-append.queue_time_us":1905958}
I20260709 13:09:04.378263 28553 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.393610 28480 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:04.397542 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 730787us
W20260709 13:09:04.403705 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 217103us
I20260709 13:09:03.744019 28013 rpcz_store.cc:276] 0709 13:09:02.456808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.468326 (+ 11518us) service_pool.cc:224] Handling call
0709 13:09:02.468726 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:02.502897 (+ 34171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:02.508332 (+  5435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:02.615049 (+106717us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.361126 (+746077us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.364579 (+  3453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.438119 (+ 73540us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.731444 (+293325us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b18003527e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:03.743228 (+ 11784us) raft_consensus.cc:1685] finished
0709 13:09:03.743256 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.743499 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15399,"raft.queue_time_us":110257,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4063,"spinlock_wait_cycles":65887616,"thread_start_us":313935,"threads_started":1,"wal-append.queue_time_us":643993}
I20260709 13:09:04.222873 28688 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.388181 28608 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.413802 27264 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.415498 27308 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:04.186385 28704 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.389192 28699 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.271147 28673 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.388437 28598 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.447505 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:04.449246 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:04.389403 28691 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.423547 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:04.445793 28006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 349) took 1291 ms. Trace:
I20260709 13:09:04.437033 28480 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.427199 28687 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.428714 28709 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.225572 28506 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.395473 28686 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.378185 28674 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.416070 28716 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:04.054476 27164 rpcz_store.cc:276] 0709 13:08:58.945945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.946220 (+   275us) service_pool.cc:224] Handling call
0709 13:09:03.773990 (+4827770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:59.380957 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:59.539332 (+158375us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:59.539383 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:08:59.539417 (+    34us) tablet.cc:662] Decoding operations
0709 13:08:59.539896 (+   479us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:59.540001 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:59.540027 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:59.540371 (+   344us) tablet.cc:701] Row locks acquired
0709 13:08:59.540413 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:08:59.540592 (+   179us) write_op.cc:270] Start()
0709 13:08:59.540744 (+   152us) write_op.cc:276] Timestamp: P: 1783602539540530 usec, L: 0
0709 13:08:59.540784 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:08:59.541577 (+   793us) log.cc:844] Serialized 539 byte log entry
0709 13:08:59.745168 (+203591us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd7fb270ac 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b
0709 13:09:00.765811 (+1020643us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b540002ae20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82baf343 00007fbd82bb2d75 00007fbd82bb2d09 00007fbd82bb2c99 00007fbd82bb2c61 00007fbd82bb1f5d 000000000038f354 000000000038f199 00007fbd7fb44475 00007fbd7fb467c1
0709 13:09:00.772150 (+  6339us) op_driver.cc:464] REPLICATION: finished
0709 13:09:01.818276 (+1046126us) write_op.cc:301] APPLY: starting
0709 13:09:01.830982 (+ 12706us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:01.831176 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:01.831232 (+    56us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:01.831697 (+   465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:01.832017 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:01.832092 (+    75us) write_op.cc:312] APPLY: finished
0709 13:09:01.832371 (+   279us) log.cc:844] Serialized 23 byte log entry
0709 13:09:02.721227 (+888856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:02.721337 (+   110us) write_op.cc:454] Released schema lock
0709 13:09:02.721406 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:02.721844 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:02.721876 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":999038,"apply.run_cpu_time_us":48567,"apply.run_wall_time_us":921789,"num_ops":1,"prepare.queue_time_us":100060,"prepare.run_cpu_time_us":28404,"prepare.run_wall_time_us":450356,"raft.queue_time_us":3610407,"raft.run_cpu_time_us":160294,"raft.run_wall_time_us":2865645,"replication_time_us":1231156,"spinlock_wait_cycles":74245888,"thread_start_us":2084769,"threads_started":5,"wal-append.queue_time_us":1436925,"wal-append.run_cpu_time_us":25428,"wal-append.run_wall_time_us":1554438}]]}
I20260709 13:09:04.391315 28569 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.441373 27306 leader_election.cc:400] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5.
I20260709 13:09:04.463296 28487 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:04.486464 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48811.6us
I20260709 13:09:04.415630 28631 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.464223 28540 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.430310 28722 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:04.499764 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 313335us
I20260709 13:09:04.500142 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 226) took 1170 ms. Trace:
I20260709 13:09:04.420348 28526 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:04.424041 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 256746us
I20260709 13:09:04.053714 27266 rpcz_store.cc:276] 0709 13:09:01.313560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.323316 (+  9756us) service_pool.cc:224] Handling call
0709 13:09:01.323646 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.344662 (+ 21016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.344703 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.345296 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.562813 (+1217517us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:02.565878 (+  3065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.576386 (+ 10508us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:03.745251 (+1168865us) raft_consensus.cc:1685] finished
0709 13:09:03.745283 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:03.745429 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18128,"raft.queue_time_us":21748,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":3452,"thread_start_us":1166043,"threads_started":1,"wal-append.queue_time_us":1423046}
I20260709 13:09:04.458582 28006 rpcz_store.cc:276] 0709 13:09:03.154381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.159750 (+  5369us) service_pool.cc:224] Handling call
0709 13:09:04.374567 (+1214817us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:04.374798 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.414591 (+ 39793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.417746 (+  3155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:04.420959 (+  3213us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:04.429386 (+  8427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.433583 (+  4197us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.444024 (+ 10441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19674,"raft.queue_time_us":33041,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":12060,"spinlock_wait_cycles":6266752}
I20260709 13:09:04.433882 28552 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:04.465672 27383 leader_election.cc:400] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:04.469326 28673 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.419848 28710 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.435036 28689 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.470218 28686 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:09:04.457665 28699 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.468636 28508 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.483278 28665 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.483526 28704 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.451210 28688 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:04.464666 28480 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.478307 28674 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.410082 28719 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.517649 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.488183 27264 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.500762 28011 rpcz_store.cc:276] 0709 13:09:03.329936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.330120 (+   184us) service_pool.cc:224] Handling call
0709 13:09:03.330567 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.658855 (+328288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.658890 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.658931 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.658961 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.499845 (+840884us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54004d3d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:04.499905 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.500068 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754540416}
I20260709 13:09:04.508364 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:04.542754 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.463352 28691 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.511587 27383 leader_election.cc:403] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:09:04.547962 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82427.1us
I20260709 13:09:04.464243 28598 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.486809 28571 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.498845 28716 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.509853 28487 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:04.511099 28687 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:04.512166 28526 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:04.523875 28508 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.527666 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:04.550045 28625 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.531038 28516 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.553498 28506 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:04.551432 28704 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:04.534660 28552 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.530892 28665 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.552217 28571 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.556162 28719 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.538995 28630 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.541734 28556 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.546862 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.532779 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.566376 28508 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:04.567102 28701 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.550312 28634 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.530573 28699 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.518671 28673 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.543654 28713 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.554085 28716 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.534883 28688 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.548813 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:04.559554 28487 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:04.626909 28543 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:04.627665 28543 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.628165 28543 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:04.628584 28688 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.583487 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:04.568873 28687 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:04.594949 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 64) took 1425 ms (client timeout 1764 ms). Trace:
I20260709 13:09:04.564787 28706 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.577766 28625 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.582480 28704 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:04.640482 28704 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:04.606485 28728 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:04.592404 28552 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.571864 28667 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:04.610121 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61409.2us
W20260709 13:09:04.614766 27981 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.129:44339 timed out after 1.764s (SENT) [suppressed 1 similar messages]
I20260709 13:09:04.647146 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 819) took 1187 ms. Trace:
I20260709 13:09:04.654665 27262 rpcz_store.cc:276] 0709 13:09:03.459761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.492248 (+ 32487us) service_pool.cc:224] Handling call
0709 13:09:03.492549 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.492792 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:03.492816 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.493717 (+   901us) log.cc:844] Serialized 26 byte log entry
0709 13:09:03.791025 (+297308us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:03.791064 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.791127 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.646883 (+855756us) raft_consensus.cc:1685] finished
0709 13:09:04.646904 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.647067 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":297017,"threads_started":1,"wal-append.queue_time_us":961672}
I20260709 13:09:04.630373 28015 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:04.592633 28516 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:04.592386 28718 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.601362 28696 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.638435 28687 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.639443 28625 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.626991 28487 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:04.658773 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 348) took 1549 ms. Trace:
W20260709 13:09:04.630213 27263 rpcz_store.cc:269] 0709 13:09:03.164810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.171786 (+  6976us) service_pool.cc:224] Handling call
0709 13:09:04.589723 (+1417937us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001b8fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:04.589925 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349738368}
I20260709 13:09:04.593905 28665 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.662473 28689 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.684434 28571 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.653189 28716 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.673473 28552 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:04.668205 28015 rpcz_store.cc:276] 0709 13:09:03.109955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.112567 (+  2612us) service_pool.cc:224] Handling call
0709 13:09:04.583332 (+1470765us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:04.658697 (+ 75365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324770688}
I20260709 13:09:04.682268 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.662951 28516 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.660326 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.699618 28711 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.699608 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.703953 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.700587 27409 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:04.660534 28508 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:03.142935 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:04.642977 28526 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:04.667088 28710 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.708467 27163 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 126) took 5160 ms. Trace:
I20260709 13:09:04.700282 28711 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.714139 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.728235 27414 raft_consensus.cc:2410] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:04.715639 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:04.698316 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:04.715934 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:04.708318 28638 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.000s
I20260709 13:09:04.731652 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.740545 27416 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:04.741350 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.741945 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.743444 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.744509 27260 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:04.735831 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:04.745464 27417 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:04.736267 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.705502 28673 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.748879 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.758760 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:04.705344 28010 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:04.760756 27268 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:04.707954 28598 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:04.708881 28691 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.775174 27415 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:04.739959 28635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.031s	sys 0.073s
I20260709 13:09:04.758217 28634 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.748454 28696 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:04.847587 28699 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:04.758785 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:04.794610 28635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.031s	sys 0.074s
I20260709 13:09:05.113185 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.142329 27161 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 209) took 4942 ms. Trace:
I20260709 13:09:05.143561 28666 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:05.206216 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.143647 28714 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.158212 27165 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:05.121511 28491 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:05.210590 28707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.017s	sys 0.027s
I20260709 13:09:05.164544 28569 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:05.153478 28012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 350) took 1991 ms (client timeout 2247 ms). Trace:
W20260709 13:09:05.220112 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.001s
W20260709 13:09:05.211695 27981 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.001s	sys 0.000s
W20260709 13:09:05.221436 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.002s
I20260709 13:09:05.139892 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.222342 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 700317us
I20260709 13:09:05.103670 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.223253 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.223264 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:05.211122 28707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.017s	sys 0.027s
I20260709 13:09:04.913543 28508 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:05.170588 28516 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.224730 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.137954 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:05.219957 27338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.005s	sys 0.052s
W20260709 13:09:05.234525 27338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.005s	sys 0.052s
I20260709 13:09:05.190668 28625 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.235193 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 76) took 1569 ms. Trace:
I20260709 13:09:05.235641 27338 rpcz_store.cc:276] 0709 13:09:03.665752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.666798 (+  1046us) service_pool.cc:224] Handling call
0709 13:09:03.667188 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.667421 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:04.158762 (+491341us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.234858 (+1076096us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.234911 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.234949 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.235008 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.235120 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":668640,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":83052,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13181,"thread_start_us":1439420,"threads_started":3,"wal-append.queue_time_us":478827}
I20260709 13:09:05.114807 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.211984 28522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.006s	sys 0.014s
I20260709 13:09:05.206663 27409 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:04.921984 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:05.226142 27234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.028s	sys 0.056s
W20260709 13:09:05.122006 27260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 63) took 3032 ms (client timeout 2509 ms). Trace:
W20260709 13:09:05.247483 27234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.028s	sys 0.057s
I20260709 13:09:05.144083 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.248245 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.932801 27415 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:05.238070 27417 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
W20260709 13:09:05.219806 28556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.001s
W20260709 13:09:05.221799 27981 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.002s	sys 0.001s
W20260709 13:09:05.249603 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 634837us
I20260709 13:09:05.249838 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.250146 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.218137 28721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.016s	sys 0.005s
W20260709 13:09:05.247521 27260 rpcz_store.cc:269] 0709 13:09:02.089155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.666436 (+577281us) service_pool.cc:224] Handling call
0709 13:09:05.121733 (+2455297us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b54003093d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:05.121903 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4776328576}
W20260709 13:09:05.253926 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.019s	sys 0.012s
I20260709 13:09:05.254796 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.118692 28627 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.119506 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.160228 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.259824 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.006s	sys 0.020s
I20260709 13:09:05.104576 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:05.333027 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.128149 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 820) took 1667 ms. Trace:
W20260709 13:09:05.018747 28740 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 13:09:05.071094 28674 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.000s
I20260709 13:09:05.271514 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.353072 27413 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:09:05.123323 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.335824 27264 rpcz_store.cc:276] 0709 13:09:03.460393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.534749 (+ 74356us) service_pool.cc:224] Handling call
0709 13:09:03.535065 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.544574 (+1009509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.127828 (+583254us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b540024b8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:05.128063 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2020563328}
I20260709 13:09:05.104655 28665 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.269413 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:05.265255 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.019s	sys 0.012s
I20260709 13:09:05.266692 27416 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:05.248306 28553 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.010s
W20260709 13:09:05.328588 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.008s	sys 0.026s
W20260709 13:09:04.981002 28608 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:09:04.720268 27163 rpcz_store.cc:276] 0709 13:08:59.548438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.565455 (+ 17017us) service_pool.cc:224] Handling call
0709 13:08:59.998110 (+432655us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:04.708393 (+4710283us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:00.120389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:00.121162 (+   773us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:00.121208 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:09:00.121235 (+    27us) tablet.cc:662] Decoding operations
0709 13:09:00.121703 (+   468us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:00.121769 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:00.121816 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:00.122050 (+   234us) tablet.cc:701] Row locks acquired
0709 13:09:00.122076 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:09:00.122289 (+   213us) write_op.cc:270] Start()
0709 13:09:00.122457 (+   168us) write_op.cc:276] Timestamp: P: 1783602540122230 usec, L: 0
0709 13:09:00.122487 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:09:00.184113 (+ 61626us) log.cc:844] Serialized 539 byte log entry
0709 13:09:01.572197 (+1388084us) op_driver.cc:464] REPLICATION: finished
0709 13:09:02.711203 (+1139006us) write_op.cc:301] APPLY: starting
0709 13:09:02.713247 (+  2044us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:02.726051 (+ 12804us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:02.773165 (+ 47114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:02.873163 (+ 99998us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:02.962701 (+ 89538us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:02.986013 (+ 23312us) write_op.cc:312] APPLY: finished
0709 13:09:03.106615 (+120602us) log.cc:844] Serialized 23 byte log entry
0709 13:09:03.106868 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.141071 (+ 34203us) write_op.cc:454] Released schema lock
0709 13:09:03.148267 (+  7196us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:03.195862 (+ 47595us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.215625 (+ 19763us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":681126,"reported_tablets":1,"spinlock_wait_cycles":477909888,"child_traces":[["op",{"apply.queue_time_us":1101650,"apply.run_cpu_time_us":3688,"apply.run_wall_time_us":457832,"num_ops":1,"prepare.queue_time_us":401,"prepare.run_cpu_time_us":3966,"prepare.run_wall_time_us":74603,"replication_time_us":1423589,"thread_start_us":993245,"threads_started":1}]]}
I20260709 13:09:05.317464 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.342463 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:05.246766 28515 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.009s	sys 0.020s
W20260709 13:09:05.247970 28522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.007s	sys 0.014s
I20260709 13:09:05.346168 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.146621 28599 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.350579 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:05.254024 28008 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.002s	sys 0.008s
I20260709 13:09:05.264753 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.381774 27260 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
W20260709 13:09:05.387490 28725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.000s	sys 0.025s
I20260709 13:09:05.356433 28006 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
W20260709 13:09:05.263895 28721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.016s	sys 0.007s
W20260709 13:09:05.261523 28556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.002s	sys 0.001s
I20260709 13:09:05.105058 28716 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.531111 27340 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:05.531559 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:05.532445 27341 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
W20260709 13:09:05.508104 28008 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.003s	sys 0.008s
W20260709 13:09:05.509878 28725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.000s	sys 0.032s
I20260709 13:09:05.125520 28670 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.108124 28711 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:05.396703 27268 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:05.433044 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:05.387830 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 938605us
W20260709 13:09:05.261168 28633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.010s	sys 0.021s
I20260709 13:09:05.440259 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:05.387665 28553 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.001s	sys 0.010s
I20260709 13:09:05.328284 28724 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:05.346233 28689 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:05.220937 28012 rpcz_store.cc:269] 0709 13:09:03.161873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.164388 (+  2515us) service_pool.cc:224] Handling call
0709 13:09:05.153242 (+1988854us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:05.153399 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431311104}
I20260709 13:09:05.271718 28709 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:05.459417 28011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.021s	sys 0.011s
I20260709 13:09:04.866312 28578 raft_consensus.cc:359] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:05.454200 27416 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:05.498693 27261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.022s	sys 0.053s
I20260709 13:09:05.074209 28704 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:04.925043 28634 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:05.441179 28740 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:05.074519 28543 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:05.435477 28515 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.012s	sys 0.020s
I20260709 13:09:05.027123 28480 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:05.381408 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:05.382323 28639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.022s	sys 0.025s
I20260709 13:09:05.145259 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.355012 28699 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:05.205420 28696 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:05.205855 27161 rpcz_store.cc:276] 0709 13:09:00.199537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.199685 (+   148us) service_pool.cc:224] Handling call
0709 13:09:05.142271 (+4942586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:00.299389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:00.404346 (+104957us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:00.404393 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:09:00.404419 (+    26us) tablet.cc:662] Decoding operations
0709 13:09:00.405218 (+   799us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:00.405289 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:00.405331 (+    42us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:00.405881 (+   550us) tablet.cc:701] Row locks acquired
0709 13:09:00.405911 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:09:00.406083 (+   172us) write_op.cc:270] Start()
0709 13:09:00.406243 (+   160us) write_op.cc:276] Timestamp: P: 1783602540406028 usec, L: 0
0709 13:09:00.406273 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:09:00.407091 (+   818us) log.cc:844] Serialized 1713 byte log entry
0709 13:09:02.632251 (+2225160us) op_driver.cc:464] REPLICATION: finished
0709 13:09:02.722252 (+ 90001us) write_op.cc:301] APPLY: starting
0709 13:09:02.722327 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:02.722490 (+   163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:02.742507 (+ 20017us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:03.152879 (+410372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:03.191963 (+ 39084us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:09:03.214615 (+ 22652us) write_op.cc:312] APPLY: finished
0709 13:09:03.269502 (+ 54887us) log.cc:844] Serialized 41 byte log entry
0709 13:09:03.299121 (+ 29619us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.361765 (+ 62644us) write_op.cc:454] Released schema lock
0709 13:09:03.363910 (+  2145us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:03.476331 (+112421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:03.480280 (+  3949us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1252190,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":58570,"apply.run_cpu_time_us":12587,"apply.run_wall_time_us":739301,"num_ops":4,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":4338,"prepare.run_wall_time_us":153560,"replication_time_us":2182204,"thread_start_us":475699,"threads_started":1}]]}
I20260709 13:09:05.508510 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:05.122704 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.090161 28487 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:04.984189 28722 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:05.465081 28729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.021s	sys 0.043s
I20260709 13:09:05.519829 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:05.521987 28014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.015s	sys 0.070s
W20260709 13:09:05.515974 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 412050us
I20260709 13:09:05.381165 28674 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:05.531563 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:05.441596 28608 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:05.505414 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.507028 28635 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:05.565903 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.511992 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:05.390607 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:05.443239 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:05.514516 27410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 823) took 1709 ms (client timeout 2211 ms). Trace:
W20260709 13:09:05.769042 28011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.026s	sys 0.017s
I20260709 13:09:05.780972 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:05.781560 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 356) took 1185 ms. Trace:
W20260709 13:09:05.750036 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.604401 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:05.754602 27165 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.063s	sys 0.069s
W20260709 13:09:05.769229 27261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.024s	sys 0.062s
I20260709 13:09:05.771112 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:05.772032 28014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.015s	sys 0.073s
W20260709 13:09:05.772290 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 263852us
I20260709 13:09:05.772065 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.785190 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.785562 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 70) took 1722 ms. Trace:
I20260709 13:09:05.617024 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:05.568816 27264 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:05.786332 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:05.786564 27165 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.063s	sys 0.070s
I20260709 13:09:05.776873 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:05.777431 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:05.787911 27342 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:05.781940 28011 rpcz_store.cc:276] 0709 13:09:04.596247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.663017 (+ 66770us) service_pool.cc:224] Handling call
0709 13:09:04.663371 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.663578 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.663608 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.664113 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.781235 (+1117122us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:05.781275 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.781342 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.781389 (+    47us) raft_consensus.cc:1685] finished
0709 13:09:05.781402 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.781506 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1116748,"threads_started":1,"wal-append.queue_time_us":1013415}
I20260709 13:09:05.515305 28743 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:05.536445 28707 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.568197 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:05.785991 27261 rpcz_store.cc:276] 0709 13:09:04.063451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.173363 (+109912us) service_pool.cc:224] Handling call
0709 13:09:04.173682 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.173871 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:04.417914 (+244043us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.785170 (+1367256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.785226 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.785285 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.785365 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.785481 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":247722,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":1556226,"threads_started":2}
W20260709 13:09:05.778496 28633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.019s	sys 0.034s
I20260709 13:09:05.791348 27268 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:05.779230 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:05.769831 28729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.284s	user 0.021s	sys 0.054s
I20260709 13:09:05.809082 27338 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:05.542186 28599 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:05.675300 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.790272 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:05.567119 28697 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.677309 28745 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:09:05.618249 28741 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.783347 27380 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.019s	sys 0.046s
I20260709 13:09:05.801198 27415 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:05.834075 27263 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:05.800722 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.176214 27414 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:05.808686 27343 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:05.787935 28639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.031s	sys 0.027s
I20260709 13:09:05.801862 27340 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:05.780454 28724 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:06.195410 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.196864 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:05.786453 28689 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:05.785856 28699 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:05.784780 28718 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:05.791579 28010 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:06.205001 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.212277 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:05.799742 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.224447 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.188056 28007 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:05.784612 28670 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:05.833357 28578 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:09:05.900838 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.308241 27338 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:05.835395 27339 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:05.789803 28752 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:09:06.213984 27380 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.547s	user 0.019s	sys 0.059s
I20260709 13:09:06.193755 28639 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:05.800123 28742 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:06.313576 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.65573e+06us
I20260709 13:09:06.200150 28724 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.314692 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.322394 27413 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:06.323307 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.316071 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.318073 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.789117 28598 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:06.327298 28722 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.215277 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.196215 28599 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.331812 27409 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:06.333189 28599 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.333285 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.334671 27409 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:06.335022 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.336283 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.336335 28704 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:05.807763 28635 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.337323 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.338910 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.339375 28635 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.340150 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.340771 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:06.341039 28608 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.335289 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:05.992290 28633 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:05.809777 28701 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:06.343400 28696 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:06.041504 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 652528us
W20260709 13:09:06.344991 28767 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:09:06.346222 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:06.347152 28543 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:06.347371 28704 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:06.347954 28704 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:06.349004 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:06.348891 28704 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.350474 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.351704 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:06.071017 27411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 820) took 2146 ms (client timeout 1946 ms). Trace:
W20260709 13:09:05.991071 27267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 66) took 1882 ms (client timeout 1951 ms). Trace:
I20260709 13:09:05.872246 28707 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.356592 28707 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.357586 28707 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:06.358091 28707 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:06.358551 28707 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.199692 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.361805 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.352800 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.363438 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.364017 27338 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:05.943807 28691 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:06.297508 28686 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:05.784622 28709 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:06.353240 27267 rpcz_store.cc:269] 0709 13:09:04.059453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.144362 (+ 84909us) service_pool.cc:224] Handling call
0709 13:09:05.145114 (+1000752us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:05.942088 (+796974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6693120}
I20260709 13:09:06.298810 28754 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:06.334611 28724 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:06.580179 28724 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:05.923797 28743 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.581066 28480 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:06.525055 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.367352 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:06.298575 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 950264us
I20260709 13:09:06.263681 28711 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:06.531464 27412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.049s	sys 0.048s
I20260709 13:09:06.312471 28718 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.533759 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:05.781137 27410 rpcz_store.cc:269] 0709 13:09:03.796447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.804813 (+  8366us) service_pool.cc:224] Handling call
0709 13:09:05.123114 (+1318301us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:05.505290 (+382176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836352}
I20260709 13:09:06.537870 27340 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
W20260709 13:09:06.535578 28725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.007s	sys 0.066s
I20260709 13:09:06.322072 28742 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:06.352337 27411 rpcz_store.cc:269] 0709 13:09:03.795419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.804866 (+  9447us) service_pool.cc:224] Handling call
0709 13:09:05.122513 (+1317647us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:05.941930 (+819417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5636352}
I20260709 13:09:06.591369 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:06.598366 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.537494 28686 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:06.599380 28014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.016s	sys 0.066s
W20260709 13:09:06.750120 28014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.016s	sys 0.070s
W20260709 13:09:06.616178 27412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.049s	sys 0.055s
I20260709 13:09:06.311671 28670 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.568766 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.642570 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:06.369541 27380 connection.cc:256] RPC call timeout handler was delayed by -1.512530593000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 13:09:06.760298 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.002s	sys 0.015s
W20260709 13:09:06.762249 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.002s	sys 0.015s
I20260709 13:09:06.645041 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.525794 28691 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:06.317600 28697 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.471297 28598 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.692654 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1598) took 1152 ms. Trace:
I20260709 13:09:06.334987 28741 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:06.655954 28725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.007s	sys 0.073s
I20260709 13:09:06.639330 28718 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.618551 28711 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:06.582203 28013 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.036s	sys 0.046s
I20260709 13:09:06.598479 28515 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.737911 27417 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:06.518982 28701 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:06.638360 27337 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:06.751029 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 352) took 2613 ms. Trace:
W20260709 13:09:06.762081 27380 connection.cc:256] RPC call timeout handler was delayed by -1.512530593000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:09:06.536481 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1440) took 1002 ms. Trace:
W20260709 13:09:06.881932 27380 connection.cc:256] RPC call timeout handler was delayed by -1.5035305930000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:09:06.882568 27380 connection.cc:256] RPC call timeout handler was delayed by -1.5035305930000504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 13:09:06.883076 27380 connection.cc:256] RPC call timeout handler was delayed by -1.4954305930000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
I20260709 13:09:06.885802 27265 rpcz_store.cc:276] 0709 13:09:05.541113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.605967 (+ 64854us) service_pool.cc:224] Handling call
0709 13:09:05.673801 (+ 67834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.582601 (+908800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.582641 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.582691 (+    50us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:06.582721 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.692291 (+109570us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54001b80d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:06.692360 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.692565 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089516800}
W20260709 13:09:06.874365 28013 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.052s	sys 0.064s
I20260709 13:09:06.892992 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.897342 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:06.898590 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.902074 27340 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:06.570566 28578 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:06.748754 28687 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.738220 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:06.915396 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:06.888264 28515 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.888453 28711 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.920861 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:06.939467 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.144s	user 0.014s	sys 0.003s
I20260709 13:09:06.762099 28571 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:06.924330 27340 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:06.347934 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:06.940145 27341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.004s	sys 0.014s
I20260709 13:09:06.891187 28506 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.896885 28487 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:06.951678 27341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.004s	sys 0.014s
I20260709 13:09:06.903424 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.077208 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:07.078492 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.024s	sys 0.040s
W20260709 13:09:06.939802 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.014s	sys 0.003s
W20260709 13:09:07.079149 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.024s	sys 0.040s
W20260709 13:09:07.073546 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 1.28382e+06us
W20260709 13:09:06.760123 27234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.005s	sys 0.013s
I20260709 13:09:07.081351 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:07.076395 27262 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.268s	user 0.007s	sys 0.054s
W20260709 13:09:07.074985 27259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.005s	sys 0.010s
W20260709 13:09:07.081404 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 732439us
W20260709 13:09:07.082476 27259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.010s
I20260709 13:09:06.958694 27267 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:07.075738 27260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.004s	sys 0.044s
W20260709 13:09:07.077801 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.019s	sys 0.044s
W20260709 13:09:07.083894 27260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.004s	sys 0.044s
W20260709 13:09:07.084091 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.020s	sys 0.044s
W20260709 13:09:07.081573 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.30049e+06us
I20260709 13:09:07.087112 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:06.898094 27336 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
W20260709 13:09:07.082052 27234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.005s	sys 0.013s
I20260709 13:09:07.089484 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1452) took 1417 ms. Trace:
I20260709 13:09:06.966109 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.090075 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:07.090685 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.885593 27334 rpcz_store.cc:276] 0709 13:09:05.529472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.534963 (+  5491us) service_pool.cc:224] Handling call
0709 13:09:06.531511 (+996548us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:06.977066 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:06.957440 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1446) took 1421 ms. Trace:
I20260709 13:09:07.093560 27341 rpcz_store.cc:276] 0709 13:09:05.535669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.535938 (+   269us) service_pool.cc:224] Handling call
0709 13:09:05.776980 (+241042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.777184 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:05.794380 (+ 17196us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.957112 (+1162732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.957158 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:06.957195 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.957253 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.957377 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23153,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2668,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4303,"spinlock_wait_cycles":985344,"thread_start_us":1162376,"threads_started":1,"wal-append.queue_time_us":1241543}
I20260709 13:09:07.090098 27336 rpcz_store.cc:276] 0709 13:09:05.672135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.710052 (+ 37917us) service_pool.cc:224] Handling call
0709 13:09:06.602746 (+892694us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:07.089121 (+486375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10402176}
I20260709 13:09:07.096832 27265 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:09:06.953238 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 67831.6us
I20260709 13:09:07.100848 27336 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:09:07.104223 27308 connection.cc:256] RPC call timeout handler was delayed by -1.3002260649999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:09:07.078326 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1593) took 1597 ms (client timeout 1822 ms). Trace:
W20260709 13:09:07.105630 27262 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.297s	user 0.007s	sys 0.054s
W20260709 13:09:07.105536 27266 rpcz_store.cc:269] 0709 13:09:05.480384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.728011 (+1247627us) service_pool.cc:224] Handling call
0709 13:09:07.078063 (+350052us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:07.102591 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.035s	sys 0.025s
W20260709 13:09:07.107477 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.036s	sys 0.025s
W20260709 13:09:07.107530 27415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.047s	sys 0.083s
W20260709 13:09:07.108412 27415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.047s	sys 0.084s
I20260709 13:09:07.108304 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:07.109344 27409 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.110340 27411 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:06.978765 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:07.111819 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.009s	sys 0.016s
I20260709 13:09:06.972898 28515 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:07.112433 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.010s	sys 0.016s
I20260709 13:09:06.875677 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:07.112962 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 933192us
I20260709 13:09:07.113577 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:07.114691 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 377596us
I20260709 13:09:07.111914 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:06.903157 28008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 351) took 2843 ms. Trace:
I20260709 13:09:06.966662 28506 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:06.681396 28639 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.028838 28699 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.968568 28670 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.936075 28701 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.187860 28701 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:06.927471 28687 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.199060 28670 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:07.199733 28553 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.000s	sys 0.005s
W20260709 13:09:07.200325 28553 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.000s	sys 0.005s
I20260709 13:09:07.200155 28670 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:06.903285 28674 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.974649 28686 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.216482 27340 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:07.217653 28775 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.199296 28008 rpcz_store.cc:276] 0709 13:09:04.059943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.283348 (+223405us) service_pool.cc:224] Handling call
0709 13:09:04.409894 (+126546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.441038 (+ 31144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.441804 (+   766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.484934 (+ 43130us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.578748 (+1093814us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:05.619204 (+ 40456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.652562 (+ 33358us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:06.747631 (+1095069us) raft_consensus.cc:1685] finished
0709 13:09:06.759944 (+ 12313us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.897794 (+137850us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4620,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6701,"thread_start_us":1013661,"threads_started":1,"wal-append.queue_time_us":1167568}
I20260709 13:09:07.220191 28741 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:07.221909 28785 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:09:07.222242 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 828) took 1655 ms. Trace:
I20260709 13:09:07.185607 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:07.223961 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1592) took 1760 ms. Trace:
I20260709 13:09:07.224673 27410 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.224625 27259 rpcz_store.cc:276] 0709 13:09:05.463993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.350100 (+886107us) service_pool.cc:224] Handling call
0709 13:09:06.350573 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.351061 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.351109 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.351815 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.083400 (+731585us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.083495 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.083666 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.223467 (+139801us) raft_consensus.cc:1685] finished
0709 13:09:07.223512 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.223812 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9135,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":730746,"threads_started":1,"wal-append.queue_time_us":766923}
I20260709 13:09:07.119345 28776 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:09:07.228178 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.229460 27259 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.230543 28670 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.231267 28687 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:06.987572 28711 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.238612 28674 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:07.239475 28674 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:07.240806 28711 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:07.198900 28506 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.241173 28674 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:06.970196 28709 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:06.750798 28742 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:06.934024 28743 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:07.246493 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43689.5us
W20260709 13:09:06.921876 28769 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:09:07.045746 28778 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:07.304116 28778 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.304868 28778 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.116742 27416 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:07.119040 28777 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:07.308882 28777 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:07.309372 28777 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:06.960709 28009 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:07.107503 27408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.002s
W20260709 13:09:07.312726 27408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.003s	sys 0.005s
I20260709 13:09:07.312358 28718 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.314224 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 841) took 1507 ms. Trace:
I20260709 13:09:07.101763 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.102252 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:07.108403 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 911553us
I20260709 13:09:07.167374 27413 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:07.191430 28704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.002s	sys 0.009s
W20260709 13:09:07.327807 28704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.002s	sys 0.009s
W20260709 13:09:07.328611 27339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1445) took 1797 ms (client timeout 2293 ms). Trace:
I20260709 13:09:07.191718 28691 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.199120 28578 ts_tablet_manager.cc:1434] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 2.783s	user 0.026s	sys 0.032s
W20260709 13:09:07.207844 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 123410us
I20260709 13:09:07.245234 27267 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
W20260709 13:09:07.329190 27339 rpcz_store.cc:269] 0709 13:09:05.531091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.531231 (+   140us) service_pool.cc:224] Handling call
0709 13:09:07.328091 (+1796860us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54003309d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.328360 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100329472}
W20260709 13:09:07.189455 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 101238us
I20260709 13:09:07.098664 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.222890 27412 rpcz_store.cc:276] 0709 13:09:05.566219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.618752 (+ 52533us) service_pool.cc:224] Handling call
0709 13:09:05.674351 (+ 55599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.674749 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:06.751330 (+1076581us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.221430 (+470100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.221559 (+   129us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.221686 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.221817 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.221991 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1356396,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":232,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":343,"thread_start_us":1481691,"threads_started":2,"wal-append.queue_time_us":429345}
W20260709 13:09:07.336382 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 235061us
I20260709 13:09:07.282258 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:07.288761 27409 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:07.280719 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:07.292338 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1559) took 1087 ms. Trace:
I20260709 13:09:07.340232 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1553) took 1561 ms. Trace:
I20260709 13:09:07.347724 27335 rpcz_store.cc:276] 0709 13:09:05.779138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.792447 (+ 13309us) service_pool.cc:224] Handling call
0709 13:09:07.338582 (+1546135us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:07.339010 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.339493 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.339534 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.339615 (+    81us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.339670 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.339755 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.339958 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90314496}
I20260709 13:09:07.350306 28008 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.350553 27266 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:07.351872 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1577) took 1014 ms. Trace:
W20260709 13:09:07.299685 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 948990us
I20260709 13:09:07.355860 27335 rpcz_store.cc:276] 0709 13:09:06.337527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.350501 (+1012974us) service_pool.cc:224] Handling call
0709 13:09:07.351080 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.351453 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.351490 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.351576 (+    86us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.351624 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.351695 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.351809 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.357299 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 74) took 1173 ms. Trace:
I20260709 13:09:07.358716 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 75) took 1174 ms. Trace:
I20260709 13:09:07.317155 28634 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.360550 27265 rpcz_store.cc:276] 0709 13:09:06.183830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.098252 (+914422us) service_pool.cc:224] Handling call
0709 13:09:07.357211 (+258959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.347724 27338 rpcz_store.cc:276] 0709 13:09:06.200379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.094433 (+894054us) service_pool.cc:224] Handling call
0709 13:09:07.094906 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.287136 (+192230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.287216 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.287280 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.287326 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.287419 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.288100 (+   681us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98185,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":426,"thread_start_us":182910,"threads_started":1}
I20260709 13:09:07.375077 28711 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:07.375634 28701 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:07.378522 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 96548.2us
W20260709 13:09:07.346904 28578 ts_tablet_manager.cc:1467] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Tablet startup took 2927ms
I20260709 13:09:07.377310 28718 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.382789 28779 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:07.383488 28779 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:07.385114 28779 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.386198 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:07.387874 28807 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:09:07.389675 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.389986 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 43499.9us
I20260709 13:09:07.391224 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.393535 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 73) took 1210 ms. Trace:
I20260709 13:09:07.394086 27265 rpcz_store.cc:276] 0709 13:09:06.183137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.392381 (+1209244us) service_pool.cc:224] Handling call
0709 13:09:07.392841 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.393139 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.393167 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.393238 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.393268 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.393323 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.393442 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.365857 28515 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:07.371745 27267 rpcz_store.cc:276] 0709 13:09:06.184413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.640717 (+456304us) service_pool.cc:224] Handling call
0709 13:09:07.358587 (+717870us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.414474 27267 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:07.415237 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 79) took 1189 ms. Trace:
I20260709 13:09:07.415691 27267 rpcz_store.cc:276] 0709 13:09:06.226218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.413518 (+1187300us) service_pool.cc:224] Handling call
0709 13:09:07.414014 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.414881 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.415157 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:07.417078 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.382476 28578 ts_tablet_manager.cc:1469] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Trace:
0709 13:08:59.012199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.020103 (+  7904us) service_pool.cc:224] Handling call
0709 13:08:59.365727 (+345624us) ts_tablet_manager.cc:934] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
0709 13:09:00.008539 (+642812us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:00.354161 (+345622us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:00.360286 (+  6125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:00.721334 (+361048us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:00.721782 (+   448us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:00.722181 (+   399us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:00.722257 (+    76us) inbound_call.cc:177] Queueing success response
0709 13:09:01.268547 (+546290us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:09:04.418202 (+3149655us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:09:04.455495 (+ 37293us) tablet_replica.cc:261] Starting instrumentation
0709 13:09:04.521526 (+ 66031us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":4369,"mutex_wait_us":4849,"raft.queue_time_us":129263,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":207,"tablet-copy.queue_time_us":283763,"tablet-download-pool.queue_time_us":227,"tablet-download-pool.run_cpu_time_us":1923,"tablet-download-pool.run_wall_time_us":254994,"thread_start_us":353056,"threads_started":2}
W20260709 13:09:07.374594 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76516.8us
I20260709 13:09:07.410251 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:07.418924 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.436664 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 59391.8us
I20260709 13:09:07.437870 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:07.440944 28756 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.441392 28711 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.441691 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.444242 28639 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.444931 28639 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.445355 28639 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.448635 28598 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.451252 28701 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.456632 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1570) took 1136 ms. Trace:
I20260709 13:09:07.457142 27341 rpcz_store.cc:276] 0709 13:09:06.320415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.098791 (+778376us) service_pool.cc:224] Handling call
0709 13:09:07.137097 (+ 38306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.280034 (+142937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.280090 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.280822 (+   732us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.291457 (+ 10635us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.291487 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.291548 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.456384 (+164836us) raft_consensus.cc:1685] finished
0709 13:09:07.456409 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.456540 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6692,"raft.queue_time_us":63766,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":174,"thread_start_us":114963,"threads_started":2,"wal-append.queue_time_us":149181}
I20260709 13:09:07.459618 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:07.460222 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1595) took 1941 ms (client timeout 2040 ms). Trace:
W20260709 13:09:07.460673 27263 rpcz_store.cc:269] 0709 13:09:05.519385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.519576 (+   191us) service_pool.cc:224] Handling call
0709 13:09:07.459782 (+1940206us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b540011e9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.460011 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98986240}
I20260709 13:09:07.462028 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.462733 27263 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.463376 27267 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.464671 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.466017 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.466454 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1594) took 1954 ms. Trace:
I20260709 13:09:07.466729 27267 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:07.458648 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.403074 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1560) took 1095 ms. Trace:
I20260709 13:09:07.314826 27408 rpcz_store.cc:276] 0709 13:09:05.806905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.361673 (+554768us) service_pool.cc:224] Handling call
0709 13:09:06.362217 (+   544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.362786 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.362836 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.577578 (+214742us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.313457 (+735879us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.313599 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.313777 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:07.313851 (+    74us) raft_consensus.cc:1685] finished
0709 13:09:07.313875 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.314118 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9245,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":159402,"thread_start_us":735199,"threads_started":1,"wal-append.queue_time_us":466381}
I20260709 13:09:07.443037 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.469830 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:07.471040 27412 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:07.475490 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1600) took 1828 ms. Trace:
I20260709 13:09:07.402218 28515 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.475626 28796 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:07.475692 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 373579us
I20260709 13:09:07.415486 28806 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.468039 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1584) took 1128 ms. Trace:
I20260709 13:09:07.514423 27338 rpcz_store.cc:276] 0709 13:09:06.339452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.379366 (+1039914us) service_pool.cc:224] Handling call
0709 13:09:07.426921 (+ 47555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.467551 (+ 40630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.467601 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.467679 (+    78us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:07.467725 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.467799 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.467942 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185536}
I20260709 13:09:07.473321 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:07.468281 28707 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.036s	user 0.013s	sys 0.003s
I20260709 13:09:07.470963 28697 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.520586 27259 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:07.469528 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:07.528409 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69964.8us
I20260709 13:09:07.432758 28779 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.510619 28515 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.533654 27410 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:07.534351 27416 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.537580 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1576) took 1200 ms. Trace:
I20260709 13:09:07.583316 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 845) took 1367 ms. Trace:
I20260709 13:09:07.542603 28008 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:06.879573 28014 rpcz_store.cc:276] 0709 13:09:04.137669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.402625 (+264956us) service_pool.cc:224] Handling call
0709 13:09:04.414899 (+ 12274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.415114 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:05.788678 (+1373564us) log.cc:844] Serialized 14 byte log entry
0709 13:09:06.750578 (+961900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.750630 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:06.750678 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:06.750769 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:06.750916 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2224604,"prepare.run_cpu_time_us":4334,"prepare.run_wall_time_us":49387,"thread_start_us":2314076,"threads_started":2}
I20260709 13:09:07.466854 27260 rpcz_store.cc:276] 0709 13:09:05.511720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.511851 (+   131us) service_pool.cc:224] Handling call
0709 13:09:05.512158 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.809314 (+297156us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.084663 (+1275349us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.464838 (+380175us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b18003348a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:09:07.465019 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.465083 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.465179 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.466199 (+  1020us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540011e4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:07.466239 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.466385 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36545,"prepare.queue_time_us":1358504,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":2180,"raft.queue_time_us":284622,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":224,"spinlock_wait_cycles":691857536,"thread_start_us":956150,"threads_started":2,"wal-append.queue_time_us":207321}
I20260709 13:09:07.468396 28817 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.521600 28742 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.471903 28718 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 13:09:07.574004 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 839) took 1784 ms. Trace:
I20260709 13:09:07.562582 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1587) took 1222 ms. Trace:
I20260709 13:09:07.586163 27263 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:07.558386 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1604) took 1776 ms. Trace:
I20260709 13:09:07.581565 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1438) took 2052 ms. Trace:
I20260709 13:09:07.578876 28011 raft_consensus.cc:1217] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:07.508317 27262 rpcz_store.cc:276] 0709 13:09:05.646818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.785290 (+138472us) service_pool.cc:224] Handling call
0709 13:09:05.785560 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.785747 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.106359 (+1320612us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.474920 (+368561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.475035 (+   115us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.475109 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.475223 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.475404 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194736,"prepare.queue_time_us":1332986,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3191,"raft.queue_time_us":195005,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":1470954,"threads_started":2,"wal-append.queue_time_us":285191}
W20260709 13:09:07.562567 28814 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:09:07.566953 28006 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:07.604106 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.596256 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 153367us
I20260709 13:09:07.600538 27268 rpcz_store.cc:276] 0709 13:09:05.781575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.039678 (+258103us) service_pool.cc:224] Handling call
0709 13:09:06.040006 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.337800 (+297794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.337830 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:06.337875 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:06.337909 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.557824 (+1219915us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540031e054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:07.557924 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.558176 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684432640}
I20260709 13:09:07.567854 28782 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:07.560581 28007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 345) took 4599 ms (client timeout 2238 ms). Trace:
I20260709 13:09:07.590906 27409 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.578469 28012 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:07.565562 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1605) took 1394 ms. Trace:
I20260709 13:09:07.599951 27340 rpcz_store.cc:276] 0709 13:09:06.340210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.976721 (+636511us) service_pool.cc:224] Handling call
0709 13:09:07.562246 (+585525us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540025b7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.562486 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253649792}
I20260709 13:09:07.580612 28010 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:07.601589 27343 rpcz_store.cc:276] 0709 13:09:05.528884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.531658 (+  2774us) service_pool.cc:224] Handling call
0709 13:09:05.531910 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.188530 (+656620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.581119 (+1392589us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540024fed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:07.581382 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635848960}
I20260709 13:09:07.564471 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.568804 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.620180 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.625108 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.589398 27415 rpcz_store.cc:276] 0709 13:09:06.216173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.364085 (+147912us) service_pool.cc:224] Handling call
0709 13:09:06.366794 (+  2709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.367090 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.108994 (+741904us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.300896 (+191902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.314515 (+ 13619us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.314665 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.314755 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.583115 (+268360us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b54000f1c50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.583252 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":664337,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":2946,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":839,"spinlock_wait_cycles":5485952,"thread_start_us":764187,"threads_started":2,"wal-append.queue_time_us":253736}
I20260709 13:09:07.627918 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.597568 27414 rpcz_store.cc:276] 0709 13:09:05.789752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.342218 (+552466us) service_pool.cc:224] Handling call
0709 13:09:06.342512 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.599991 (+257479us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.236058 (+636067us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.245351 (+  9293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.245480 (+   129us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.245609 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.573595 (+327986us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540035b954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:07.573643 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.573804 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":431579,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":724,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":187,"spinlock_wait_cycles":591334144,"thread_start_us":451308,"threads_started":2,"wal-append.queue_time_us":9136}
I20260709 13:09:07.572479 28689 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.551111 28778 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.572865 28639 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:07.631938 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 199178us
W20260709 13:09:07.617501 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 82553.5us
I20260709 13:09:07.636449 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1580) took 1298 ms. Trace:
I20260709 13:09:07.617374 28782 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.647607 27263 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.646617 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1583) took 1307 ms. Trace:
I20260709 13:09:07.569612 28707 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.638000 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.649627 27262 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.637825 28711 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.651422 27260 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:07.653885 28724 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:07.656255 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1569) took 1352 ms. Trace:
I20260709 13:09:07.617058 28777 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.663461 27417 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.657716 27264 raft_consensus.cc:2368] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:07.656744 28011 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:07.665123 28777 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.660177 28711 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.666087 28711 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.617666 28007 rpcz_store.cc:269] 0709 13:09:02.960837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.961915 (+  1078us) service_pool.cc:224] Handling call
0709 13:09:03.741763 (+779848us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0ce9c 00007fbd7fb0ca5b 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:07.560036 (+3818273us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54005deb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.560347 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4061305472}
W20260709 13:09:07.638497 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104460us
I20260709 13:09:07.506992 27334 rpcz_store.cc:276] 0709 13:09:06.200732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.094775 (+894043us) service_pool.cc:224] Handling call
0709 13:09:07.095442 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.274932 (+179490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.274977 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.282721 (+  7744us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.286914 (+  4193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.292396 (+  5482us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.295977 (+  3581us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104896,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":299,"thread_start_us":178756,"threads_started":1}
I20260709 13:09:07.671319 28754 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.671399 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.672052 28754 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.672608 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.673529 27341 raft_consensus.cc:2368] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:07.653959 27259 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:07.663882 28667 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.663304 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.648502 28782 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.667761 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.649215 27335 rpcz_store.cc:276] 0709 13:09:06.339206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.361334 (+1022128us) service_pool.cc:224] Handling call
0709 13:09:07.411148 (+ 49814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.521168 (+110020us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:07.521528 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.646154 (+124626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.646227 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:07.646283 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.646374 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.646531 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1292,"prepare.queue_time_us":6394,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":11253,"thread_start_us":113036,"threads_started":1}
I20260709 13:09:07.689815 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.675551 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.696503 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.698736 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46852.3us
I20260709 13:09:07.672123 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.701879 27340 raft_consensus.cc:2393] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:07.704547 27231 connection.cc:256] RPC call timeout handler was delayed by -2.3057006509999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:09:07.705947 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.706235 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:07.706701 28820 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:07.702773 28707 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.704794 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.589320 27336 rpcz_store.cc:276] 0709 13:09:06.337269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.154641 (+817372us) service_pool.cc:224] Handling call
0709 13:09:07.155257 (+   616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.155769 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:07.315469 (+159700us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.535278 (+219809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.535556 (+   278us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.535969 (+   413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.536583 (+   614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.537311 (+   728us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3922,"prepare.queue_time_us":276383,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":46,"raft.queue_time_us":4363,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":746,"thread_start_us":346786,"threads_started":2,"wal-append.queue_time_us":300924}
I20260709 13:09:07.716387 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.717440 28724 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.717576 28754 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:07.695925 28806 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.718643 28806 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.620748 27266 rpcz_store.cc:276] 0709 13:09:06.171481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.106744 (+935263us) service_pool.cc:224] Handling call
0709 13:09:07.342984 (+236240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.357690 (+ 14706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.565293 (+207603us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001f7cd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.565470 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431338368}
I20260709 13:09:07.723896 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.719364 27342 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:07.671489 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.726786 28806 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.727054 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.727962 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 261) took 2324 ms. Trace:
I20260709 13:09:07.730891 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.733150 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.674883 27337 rpcz_store.cc:276] 0709 13:09:06.303741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.091801 (+788060us) service_pool.cc:224] Handling call
0709 13:09:07.564219 (+472418us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:07.656133 (+ 91914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15482112}
I20260709 13:09:07.738848 28778 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.740165 28014 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:07.740702 27264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 77) took 1555 ms (client timeout 1764 ms). Trace:
I20260709 13:09:07.741338 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:07.741139 27264 rpcz_store.cc:269] 0709 13:09:06.185507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.591046 (+405539us) service_pool.cc:224] Handling call
0709 13:09:07.740402 (+1149356us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54001b8fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.740640 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039356160}
I20260709 13:09:07.742081 28014 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:07.746016 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.729526 28718 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.728791 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.727058 28742 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.753028 27416 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:07.754624 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:07.756126 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.744495 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.749521 28718 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.752985 28007 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:07.768703 27978 leader_election.cc:400] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:07.769133 27978 leader_election.cc:403] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.747785 28667 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.771224 28754 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:07.771642 28667 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.728410 28013 rpcz_store.cc:276] 0709 13:09:05.334831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.355244 (+ 20413us) service_pool.cc:224] Handling call
0709 13:09:05.478417 (+123173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.514898 (+ 36481us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:06.906663 (+1391765us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.422142 (+515479us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b1800323560. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:09:07.445281 (+ 23139us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b1800323560. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:07.657614 (+212333us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.657781 (+   167us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:07.657909 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.658328 (+   419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.659011 (+   683us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4482,"prepare.queue_time_us":1362113,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":19396,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":35924,"spinlock_wait_cycles":22115584,"thread_start_us":1559356,"threads_started":2,"wal-append.queue_time_us":793536}
I20260709 13:09:07.772753 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.766271 28639 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:07.776510 28707 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:07.776962 28707 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.777321 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.777532 28709 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:07.778236 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:07.774151 28718 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.779223 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:07.779994 27342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1562) took 1578 ms (client timeout 1759 ms). Trace:
I20260709 13:09:07.780717 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.782856 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.796005 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:07.783648 28689 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.798312 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.798851 28699 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.799045 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.800410 28724 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:07.800495 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.780408 27342 rpcz_store.cc:269] 0709 13:09:06.201347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.367023 (+165676us) service_pool.cc:224] Handling call
0709 13:09:07.779816 (+1412793us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540021dc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:07.779921 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506261376}
W20260709 13:09:07.802917 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50028.8us
I20260709 13:09:07.806099 27409 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:07.806794 28817 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:07.807403 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.799062 27263 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.810384 28014 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:07.815824 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:07.797364 27981 leader_election.cc:336] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Timed out: RequestConsensusVote RPC to 127.25.139.129:44339 timed out after 1.764s (SENT)
I20260709 13:09:07.777351 28707 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.773708 28013 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:07.795935 28754 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:07.796188 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.835777 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:07.838564 28008 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:07.815982 28699 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.807417 28817 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:07.843063 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 247264us
I20260709 13:09:07.818449 28724 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:07.841418 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.847199 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 76) took 1662 ms. Trace:
I20260709 13:09:07.847294 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.849725 28638 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:07.849987 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.850203 28638 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.850682 28638 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:07.853063 27231 connection.cc:256] RPC call timeout handler was delayed by -2.0636006509998879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:09:07.853613 27231 connection.cc:256] RPC call timeout handler was delayed by -1.6874306929998966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:09:07.854019 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2734306929999093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22930000000000003s for a response
I20260709 13:09:07.857657 28697 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:07.858476 28697 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.861497 28697 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.862078 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.862468 27262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:34936
I20260709 13:09:07.839726 28806 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.863622 27262 raft_consensus.cc:606] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:07.863709 28806 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:07.864542 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.864967 28806 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.865816 28634 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:07.867448 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60175.8us
I20260709 13:09:07.875872 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1603) took 2117 ms. Trace:
I20260709 13:09:07.876343 27261 rpcz_store.cc:276] 0709 13:09:05.758829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:05.803379 (+ 44550us) service_pool.cc:224] Handling call
0709 13:09:05.803706 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:06.915964 (+1112258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:07.299472 (+383508us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.623579 (+324107us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.629873 (+  6294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.633915 (+  4042us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:07.651784 (+ 17869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.766949 (+115165us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b180028c6c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:07.834195 (+ 67246us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180028c6c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd86b0558f 00007fbd7fb44571 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd
0709 13:09:07.855939 (+ 21744us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b180028c6c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:07.875024 (+ 19085us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180028c6c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419
0709 13:09:07.875499 (+   475us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540008af54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:07.875544 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.875707 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94023,"prepare.queue_time_us":287599,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":83,"raft.queue_time_us":12325,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":5665,"spinlock_wait_cycles":2589484032,"thread_start_us":444533,"threads_started":2,"wal-append.queue_time_us":314787}
I20260709 13:09:07.840467 28711 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.882789 28711 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:07.886248 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:07.887048 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.887490 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.887691 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.868391 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.888089 27262 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:07.889014 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:07.889845 28006 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:07.890057 27262 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:07.890522 28553 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.888330 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:07.848199 27265 rpcz_store.cc:276] 0709 13:09:06.184969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.401100 (+1216131us) service_pool.cc:224] Handling call
0709 13:09:07.473324 (+ 72224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.479730 (+  6406us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:07.480127 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.846793 (+366666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.846857 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:07.846912 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.846987 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.847116 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212034,"prepare.queue_time_us":26375,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":8224,"thread_start_us":152182,"threads_started":1,"wal-append.queue_time_us":215926}
I20260709 13:09:07.895268 27413 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:07.861287 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:07.888151 27263 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:07.890902 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:07.898731 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67565.9us
I20260709 13:09:07.878456 28782 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:07.901804 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 120174us
I20260709 13:09:07.904407 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.904460 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:07.905813 27261 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:07.907560 27260 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.908373 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:07.909665 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48466.1us
I20260709 13:09:07.908710 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:07.903019 28506 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:07.901270 28553 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:07.916740 28506 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.923552 28506 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:07.923332 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:07.924208 28015 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.925567 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.926798 28782 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.912487 28689 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:09:07.927011 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.929381 28754 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:07.932862 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.930740 28778 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:07.917251 28553 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.935138 28553 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.937355 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:07.938102 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.939488 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.940178 28634 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.940260 27259 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:07.940850 28634 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:07.921612 28699 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:07.947414 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 90375.8us
I20260709 13:09:07.948868 28015 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:07.941033 28718 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.953908 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:07.955760 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.951967 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:07.959872 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.962366 28795 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:07.962761 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:07.943079 28746 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:07.964336 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:07.965974 27343 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:07.966233 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.966900 27337 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:07.954707 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.942039 28515 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.968179 27278 tablet_copy_service.cc:342] P 203d83f7fac847e0beee51aa18513b25: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-4b44d9e3827f45eabce8235344e58d0f received from {username='slave'} at 127.0.0.1:48160
I20260709 13:09:07.972061 27278 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-4b44d9e3827f45eabce8235344e58d0f on tablet 4b44d9e3827f45eabce8235344e58d0f with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:07.972841 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.975052 27338 raft_consensus.cc:2368] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:07.950804 28724 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.951697 28506 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.980845 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.647300 27339 rpcz_store.cc:276] 0709 13:09:06.338440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.373961 (+1035521us) service_pool.cc:224] Handling call
0709 13:09:07.428490 (+ 54529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:07.452894 (+ 24404us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:07.453204 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.636061 (+182857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:07.636110 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:07.636189 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.636263 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:07.636380 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1861,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":3512,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13263,"thread_start_us":178612,"threads_started":1}
I20260709 13:09:07.962903 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48150 (request call id 7) took 2411 ms. Trace:
I20260709 13:09:07.983984 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:07.979976 28515 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:07.985415 28795 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:07.986919 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 153265us
I20260709 13:09:07.987748 28795 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:07.987485 28707 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:07.981055 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.992915 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:07.994997 28828 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:09:07.995152 27342 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:07.953024 28817 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:07.996315 28697 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:07.996629 28506 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:07.997391 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67835.5us
I20260709 13:09:07.999435 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:07.999889 27340 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:08.000893 28697 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.002007 28553 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.002197 28831 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.002947 28756 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:08.009225 28756 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:08.010272 28756 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.006904 28718 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:08.011420 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.011487 28756 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:07.991657 28689 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.011303 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.013005 28689 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.013244 27336 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:08.014747 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.017177 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.017814 27336 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:08.020318 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.020750 28553 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:08.022024 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.029335 28667 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:08.020895 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:07.989627 27267 rpcz_store.cc:276] 0709 13:09:05.543737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.802986 (+2259249us) service_pool.cc:224] Handling call
0709 13:09:07.955430 (+152444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:08.026217 28697 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:07.984803 28746 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:07.973950 28782 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.007759 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.007511 28627 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:08.032022 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44374.3us
W20260709 13:09:08.031857 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 79966.7us
I20260709 13:09:08.031647 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:08.039371 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.014317 28689 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.043967 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.033744 28782 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.048360 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.050180 27165 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 230) took 7656 ms. Trace:
I20260709 13:09:08.050976 27413 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:08.051084 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.051846 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.054893 27340 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:08.053138 27308 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:08.055878 28515 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.056640 27334 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:08.057847 28697 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.058274 28697 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:08.058733 28697 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:07.969125 28634 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.053447 28796 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.041846 28746 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.063557 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.064278 27339 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:08.065459 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.066376 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.066951 27264 raft_consensus.cc:2376] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2. Re-sending same reply.
I20260709 13:09:08.067345 28795 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.054492 28782 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.068949 28754 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:08.068946 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.063252 28746 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:08.047247 28829 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:09:08.076933 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 115734us
I20260709 13:09:08.081435 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.082192 27261 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:08.089352 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.101274 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:08.101688 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.102245 27417 raft_consensus.cc:2368] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3.
I20260709 13:09:08.102542 27260 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:08.103199 27266 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:08.103555 27264 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:08.103652 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:08.104354 27340 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:08.104548 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.079875 27413 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
W20260709 13:09:08.111580 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 104115us
I20260709 13:09:08.116479 27414 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.099119 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.124680 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:08.125507 28830 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.176s	user 0.003s	sys 0.000s
I20260709 13:09:08.050663 27165 rpcz_store.cc:276] 0709 13:09:00.389208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.389480 (+   272us) service_pool.cc:224] Handling call
0709 13:09:00.720663 (+331183us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:08.045545 (+7324882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:06.581969 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:06.966978 (+385009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:06.967014 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:09:06.967031 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:07.025265 (+ 58234us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:07.026693 (+  1428us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:07.027281 (+   588us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:09:07.037998 (+ 10717us) tablet.cc:701] Row locks acquired
0709 13:09:07.038021 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:09:07.040001 (+  1980us) write_op.cc:270] Start()
0709 13:09:07.040718 (+   717us) write_op.cc:276] Timestamp: P: 1783602547039695 usec, L: 0
0709 13:09:07.040745 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:09:07.043497 (+  2752us) log.cc:844] Serialized 544 byte log entry
0709 13:09:07.613011 (+569514us) spinlock_profiling.cc:243] Waited 61.6 ms on lock 0x7b540002ae20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82ba86b8 00007fbd82ba82fa 00007fbd82c2c965 00007fbd82c2ce09 00007fbd86667581 00007fbd86666d58 00007fbd8666b9f1 00007fbd8666b9a9 00007fbd8666b939 00007fbd8666b901
0709 13:09:07.662764 (+ 49753us) op_driver.cc:464] REPLICATION: finished
0709 13:09:07.772613 (+109849us) write_op.cc:301] APPLY: starting
0709 13:09:07.772740 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:07.772881 (+   141us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:07.772925 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:07.773246 (+   321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:07.773667 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:09:07.773723 (+    56us) write_op.cc:312] APPLY: finished
0709 13:09:07.842716 (+ 68993us) log.cc:844] Serialized 23 byte log entry
0709 13:09:07.875100 (+ 32384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.875279 (+   179us) write_op.cc:454] Released schema lock
0709 13:09:07.875335 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:07.875876 (+   541us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:07.875902 (+    26us) write_op.cc:454] Released schema lock
0709 13:09:07.936633 (+ 60731us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2e32a 00007fbd82bb3f14 00007fbd82bb3ec3 00007fbd82bb3e38 00007fbd82bb3df3 00007fbd82bb30dc 00007fbd82bdce16 00007fbd82bc4cbb 00007fbd82baf39d 00007fbd82bb2d75
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":44059904,"child_traces":[["op",{"apply.queue_time_us":102180,"apply.run_cpu_time_us":3062,"apply.run_wall_time_us":103275,"num_ops":1,"prepare.queue_time_us":1371293,"prepare.run_cpu_time_us":28960,"prepare.run_wall_time_us":1037983,"raft.queue_time_us":177828,"raft.run_cpu_time_us":42492,"raft.run_wall_time_us":467988,"replication_time_us":608038,"spinlock_wait_cycles":489326592,"thread_start_us":875591,"threads_started":4,"wal-append.queue_time_us":172976}]]}
I20260709 13:09:08.126539 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.129730 27413 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:09:08.114730 28506 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:09:08.139492 27416 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:08.136181 28777 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:08.139451 28724 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.176714 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:08.150331 28795 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.170630 28699 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.183061 27413 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:08.183928 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 100783us
I20260709 13:09:08.173452 28777 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:08.176604 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:08.182686 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 151124us
I20260709 13:09:08.194416 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.179538 28838 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:09:08.195540 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:08.196015 28833 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.256s	user 0.004s	sys 0.000s
I20260709 13:09:08.196368 27408 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.184721 28707 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:08.198253 27308 leader_election.cc:400] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3.
I20260709 13:09:08.198565 27308 leader_election.cc:403] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.198056 28506 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.139593 28796 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:09:08.204281 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:08.191762 28711 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:08.229897 27413 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:08.198763 28817 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:08.231664 27410 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.230615 28711 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:08.249470 27414 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:08.240829 28553 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.261426 28841 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:09:08.261782 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.254372 28777 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.262559 28841 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:08.253758 28667 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:08.263495 28667 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.263923 28667 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.264197 27380 leader_election.cc:400] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:08.264561 27380 leader_election.cc:403] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:08.266599 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.268162 28777 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:08.269049 28839 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:08.269471 28639 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.262992 28841 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.271279 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.274943 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.279747 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.281814 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.282071 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.284601 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.287027 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.287550 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.276536 28711 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.290772 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.291664 27336 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:08.292475 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.271626 28795 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:08.275213 28638 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.298623 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:08.302620 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 98405.5us
I20260709 13:09:08.309067 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.312028 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.314745 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:08.315013 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:08.315343 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.315796 27415 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:08.316279 28844 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:08.316815 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.317248 28742 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:08.317435 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.317744 28742 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:08.317945 28851 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:08.318320 28742 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.318524 28849 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.319080 28849 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:08.319530 28849 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.270839 28841 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.331099 27262 raft_consensus.cc:2368] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3.
I20260709 13:09:08.324112 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.325234 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.310482 27338 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
W20260709 13:09:08.324363 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 136592us
I20260709 13:09:08.341876 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.344458 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.345059 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.344666 28806 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.347289 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:08.360548 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.304992 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:08.361807 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.364039 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.354954 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.365167 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.365520 28858 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.365990 28858 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:08.366267 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.367463 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.368041 27259 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:08.368937 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.370015 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.372601 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.366413 28858 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.363541 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.327347 27336 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
W20260709 13:09:08.379951 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 62628.7us
W20260709 13:09:08.381049 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.371013 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.387650 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.387447 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:08.391120 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50072.7us
I20260709 13:09:08.393611 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:08.283583 28699 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:08.395006 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 98913.5us
I20260709 13:09:08.400213 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:08.397087 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84045.3us
I20260709 13:09:08.401829 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.402778 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.403833 27266 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:08.405917 28707 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.406342 28707 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:08.406723 28707 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:08.407481 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.408098 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 59877a2f8723407f9fd30c7505cc2e29: Illegal state: Replica 203d83f7fac847e0beee51aa18513b25 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:08.409304 28638 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:08.411202 28553 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3.
I20260709 13:09:08.413380 28859 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.413942 28859 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.415664 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.418237 28553 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:08.376240 28806 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:08.419188 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:08.419247 28553 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.420004 27262 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.420382 28553 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.420276 28806 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.423465 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:08.388067 28841 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.375862 27334 raft_consensus.cc:2376] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3. Re-sending same reply.
I20260709 13:09:08.441622 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:08.442914 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.450845 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:08.452280 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:08.454304 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.396715 28860 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:08.456292 28847 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.460482 27262 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:08.464294 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 147378us
I20260709 13:09:08.472213 28697 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.473713 27268 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:08.474563 28697 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:08.432474 28754 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:08.475888 28838 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.485378 27417 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:09:08.495689 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 47770.8us
I20260709 13:09:08.488466 28007 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:08.498961 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 43869.8us
I20260709 13:09:08.496536 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.470928 28854 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:08.506175 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53466.6us
I20260709 13:09:08.508092 27260 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:08.512099 27416 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.482692 28754 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.496311 28689 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:08.533636 28845 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:08.533986 27262 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:08.534855 28845 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:08.535225 28845 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.536164 28845 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.537339 28845 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.538650 27342 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:08.530525 28848 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.539832 28848 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:08.540191 28848 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.491134 28838 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:08.555054 27416 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:08.491641 27410 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:08.533854 28689 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.530617 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.531437 27417 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.543017 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.549492 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:08.524763 28754 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:08.497944 28847 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.532516 28742 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.566501 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.567865 28746 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:08.568341 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71933.8us
I20260709 13:09:08.553009 28860 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:09:08.500785 27408 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:08.571992 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60208.1us
I20260709 13:09:08.577301 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.581771 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.564218 28838 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.566964 28667 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.593926 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.570039 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:08.503836 28849 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.565416 28836 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:08.613590 27415 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:08.565912 28831 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:08.623347 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.634677 27412 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:08.635191 27416 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:08.618777 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:08.570928 28709 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:08.593422 28850 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.565641 28707 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.593276 28746 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:08.643400 27263 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:08.593896 28724 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.649232 27416 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:09:08.633538 28782 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.003s
I20260709 13:09:08.641130 28506 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.652377 28746 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.652879 28709 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.659655 28847 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.662498 28859 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:08.664516 28707 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:08.665210 28711 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.621445 28836 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:08.633157 27411 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:08.670713 27412 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:08.638823 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:08.637562 28673 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:09:08.677783 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:08.642689 28850 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:08.655723 28874 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:08.682124 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.657521 28782 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.683943 28667 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:08.656320 28699 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.693208 28712 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:09:08.694478 28712 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:08.694844 28712 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:08.697049 27340 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:08.697497 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:08.701045 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:08.701228 28848 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.685493 28850 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.652624 28796 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:09:08.696290 28709 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:08.695672 28712 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:08.802445 28854 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:08.803229 28832 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:08.803660 28832 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:08.804003 28832 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.808247 28864 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:09:08.797221 28857 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.809413 28777 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:08.810119 28777 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:08.811545 28777 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:08.813437 28777 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.816331 28627 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:08.729468 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 147783us
I20260709 13:09:08.690945 28699 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:08.704365 27409 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:08.702476 28779 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.728299 28506 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:08.808555 28848 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:08.687795 28778 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:09:08.779538 28872 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:09:08.828598 28712 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.829038 28627 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:08.829780 28876 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:09:08.682124 28689 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:08.803023 28854 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:08.739668 28667 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
W20260709 13:09:08.843502 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 139238us
I20260709 13:09:08.826789 28699 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:08.851316 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:08.882189 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:08.883733 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.884862 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.888808 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:08.950024 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 59570.9us
I20260709 13:09:08.958205 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:08.862718 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46819.6us
I20260709 13:09:08.948706 28884 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:08.979621 28884 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:08.980135 28884 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:08.983299 28856 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:08.984382 28882 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
W20260709 13:09:08.985526 28880 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:09:08.987018 28883 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:09:08.889729 28506 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:08.878417 28742 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:09.046595 28845 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:08.975996 28885 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:09.056608 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 167861us
I20260709 13:09:09.058297 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.031004 28718 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:09.075660 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.051120 28709 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:09.074277 28845 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:09.081565 28709 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:09.082849 28709 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.059376 28746 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.099994 28746 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.050951 28849 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.102077 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:08.851016 28836 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.120455 28013 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:09.057628 28885 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.132256 28885 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.121135 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:09.121268 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.133910 28849 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.136742 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:09.137045 28754 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.003s
I20260709 13:09:09.123183 28746 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:09.137647 28754 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.138979 28007 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:09.157742 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.165452 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:09.158239 28838 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260709 13:09:09.157200 28849 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:09.055910 28884 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.171309 27268 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:09.178265 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:09.167989 28858 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.012s
I20260709 13:09:09.169023 28718 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:09.189790 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 231707us
I20260709 13:09:09.172751 28553 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:09.175016 28849 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.178403 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:09.168736 28845 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:09.212459 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:09.215826 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.222728 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.224378 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:09.174170 28838 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.227993 28838 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.229077 27409 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.229249 27410 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.230165 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.230357 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:09.203442 28849 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.231554 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.231968 27411 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:09.232362 27415 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.233258 27411 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.234648 27411 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:09.220494 28013 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.235754 27412 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:09.238435 28667 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:09.238879 28667 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:09.239279 28777 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:09.239794 28506 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:09.240226 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 49649.7us
I20260709 13:09:09.241001 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.241017 28506 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:09.169618 28854 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.241552 28506 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:09.242167 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.243341 28854 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.242422 28506 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.243566 28863 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:09.243994 28854 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.244256 28506 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:09.244016 28863 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.244905 28863 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.245208 27265 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:09.188644 28718 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:09.169358 28832 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.250617 27309 leader_election.cc:400] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3.
W20260709 13:09:09.249662 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60076.2us
I20260709 13:09:09.194816 28847 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:09.193440 28553 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.257369 28777 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:09:09.263700 28884 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.265444 28673 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:09.252131 28718 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.270828 27339 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:09.239310 28667 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.188282 28858 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.257390 28553 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:09.295588 28894 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:09.270180 28638 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:09:09.296281 28841 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.853s	user 0.011s	sys 0.000s
I20260709 13:09:09.306160 27415 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.303231 28859 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:09.314054 28718 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.299461 27409 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.314692 28013 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:09.264150 28816 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:09.257174 28847 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:09.330514 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66554.6us
I20260709 13:09:09.268687 28890 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:09:09.342473 28879 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.367s	user 0.011s	sys 0.003s
W20260709 13:09:09.369727 27380 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.938s (SENT)
I20260709 13:09:09.370254 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:09.354135 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.370857 28870 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:09.371343 28870 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:09.371654 28888 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:09.371887 27265 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:09.360560 28856 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:09.372354 28870 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.373199 28856 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:09.375290 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.376655 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 854) took 1296 ms. Trace:
I20260709 13:09:09.377074 27267 rpcz_store.cc:276] 0709 13:09:08.080275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.281249 (+200974us) service_pool.cc:224] Handling call
0709 13:09:08.301968 (+ 20719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.375534 (+ 73566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.377538 (+  2004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.482034 (+104496us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.645821 (+163787us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:08.646534 (+   713us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.684296 (+ 37762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.684415 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.341774 (+657359us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:09.376347 (+ 34573us) raft_consensus.cc:1685] finished
0709 13:09:09.376446 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.376595 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34657,"prepare.queue_time_us":204,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":37929,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7702,"spinlock_wait_cycles":31312768,"thread_start_us":112256,"threads_started":1,"wal-append.queue_time_us":328831}
W20260709 13:09:09.380779 27380 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.955s (SENT)
I20260709 13:09:09.381295 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:09.383584 28709 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.389227 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:09.390086 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:09.391153 28006 raft_consensus.cc:2368] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
I20260709 13:09:09.391443 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.392387 27410 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:09.392761 27306 leader_election.cc:400] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
I20260709 13:09:09.393175 27306 leader_election.cc:403] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:09.365520 28795 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:09.406082 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.333273 28847 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.414489 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.335927 28718 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:09.415230 27416 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:09.418191 28011 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:09.422025 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.401432 28795 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:09.431555 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 110165us
I20260709 13:09:09.410995 28845 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.302521 28886 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20260709 13:09:09.411569 28870 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:09.446887 27231 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.826s (SENT)
W20260709 13:09:09.433331 28850 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:09:09.401943 28841 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:09.459344 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.464154 27417 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:09.441627 27334 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:09:09.460579 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1455) took 1199 ms. Trace:
W20260709 13:09:09.466149 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 160755us
I20260709 13:09:09.466575 27340 rpcz_store.cc:276] 0709 13:09:08.260849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.260974 (+   125us) service_pool.cc:224] Handling call
0709 13:09:08.261340 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.697627 (+436287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.460332 (+762705us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540013f454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:09.460521 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001510144}
I20260709 13:09:09.442262 28806 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:09.452821 28012 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:09.434561 28902 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:09.482750 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.461524 28878 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:09:09.487653 27417 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:09.466514 27334 pending_rounds.cc:85] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:09:09.452118 28718 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:09.492614 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.495462 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:09.496613 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.497608 27417 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:09.456312 28849 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.501332 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:09.472795 28903 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.489069 27411 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:09.455955 28850 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.515681 27265 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:09.520706 28891 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:09:09.525208 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.525341 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.498811 28832 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:09.490115 28806 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.507093 28888 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.512429 28866 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:09.495038 28902 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.530310 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.531287 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.547989 27262 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.543674 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:09.544927 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:09.554250 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.556470 27412 raft_consensus.cc:2410] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:09:09.557312 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.558609 27335 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.523640 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.557407 28836 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.507696 28697 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:09.524276 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.507709 28795 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.625790 28908 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:09:09.626477 28795 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.530408 28892 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.561645 28866 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:09.632975 28875 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:09.633939 28904 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:09.536669 28709 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.635238 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.540876 28884 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.636950 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.636376 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:09.494827 27334 pending_rounds.cc:107] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:09:09.533432 28858 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:09.531469 28782 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.528749 28707 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:09.560992 28724 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.882s	user 0.009s	sys 0.004s
I20260709 13:09:09.675482 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.593721 28515 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.558208 27409 raft_consensus.cc:606] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.541566 28841 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.704152 27343 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.647686 28639 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.543329 28856 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.683523 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:09.700013 27334 raft_consensus.cc:2889] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:09.734086 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.734109 27265 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:09.530019 28903 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.713274 27409 raft_consensus.cc:614] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:09.737998 27343 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.717918 28890 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.711946 28724 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:09.741540 27417 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
W20260709 13:09:09.738678 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 184530us
I20260709 13:09:09.698459 28875 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.747661 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.704413 28884 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.758610 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:09.728780 28639 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.755954 27336 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.721490 28707 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.732355 28841 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.781109 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.783847 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.785933 28856 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:09.786168 28707 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:09.786346 28806 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.786787 28913 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.787236 28842 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:09.787300 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.788148 28841 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:09.768620 28697 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:09.766782 28849 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.790575 28850 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.791795 28902 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:09.795806 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.797430 27265 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:09.797643 28639 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:09.752758 28890 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.763273 28866 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.801036 28903 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:09.814437 28909 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:09:09.802325 28553 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:09.803542 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.804425 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.781780 28015 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:09.806519 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:09.773911 28910 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:09.807570 28832 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:09.889775 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 83357.3us
I20260709 13:09:09.890601 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:09.809276 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:09.809767 27343 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.785949 28875 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:09.801795 27262 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:09.812352 28915 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:09.808341 28842 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:09.813220 28845 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
W20260709 13:09:09.919895 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.915000 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:09.916412 28864 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:09.916991 27417 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:09.917362 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:09.878257 28010 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.918956 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:09.920782 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.924203 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:09.876077 28639 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.925601 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.945691 27343 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.925657 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.928321 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:09.948293 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.962009 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47096.3us
I20260709 13:09:09.964306 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.964444 28921 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:09.965152 28921 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:09.965183 27343 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:09.965929 28921 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:09.966655 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:09.969008 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:09.921003 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:09.922411 28841 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.978593 27337 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:09.911659 28832 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:09.994081 28917 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.013828 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:09.990782 28913 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:10.023608 27267 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:10.013165 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.032979 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:10.010586 28699 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.100s	user 0.011s	sys 0.001s
I20260709 13:09:09.987737 28875 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:09:10.056970 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 119803us
I20260709 13:09:10.023661 28913 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:10.058272 28863 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 13:09:10.059195 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:10.060459 28885 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.000s
I20260709 13:09:10.070365 27343 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.072940 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.079203 27413 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.086380 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1447) took 1533 ms. Trace:
I20260709 13:09:10.086741 27413 rpcz_store.cc:276] 0709 13:09:08.553115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.638109 (+ 84994us) service_pool.cc:224] Handling call
0709 13:09:10.056599 (+1418490us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:10.078904 (+ 22305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.086138 (+  7234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.086330 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5502336}
I20260709 13:09:10.018258 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 371) took 1445 ms. Trace:
I20260709 13:09:10.089509 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.092669 27337 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.094228 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:10.095362 28845 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:09.977527 28639 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:10.009783 28841 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.110323 28746 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:10.083946 28884 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.114058 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:10.114542 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.115669 27337 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.061427 28842 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.117035 28900 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:10.114065 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.087779 28850 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.093832 28849 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.096266 28923 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.117137 28916 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:10.117408 28707 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:10.123418 28923 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.127525 28923 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.127976 28841 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.128701 28923 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.129267 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.130403 28639 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.128733 28900 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.132128 28900 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.117221 28842 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.107909 28845 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.133548 28845 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.134821 28845 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.063052 28699 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.139264 28699 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.141341 27337 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.114382 28896 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:10.142474 28667 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.856s	user 0.006s	sys 0.005s
I20260709 13:09:10.142326 28896 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.144598 28896 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.091574 28010 rpcz_store.cc:276] 0709 13:09:08.549479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.557033 (+  7554us) service_pool.cc:224] Handling call
0709 13:09:09.362737 (+805704us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:09.363020 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.814166 (+451146us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b54004d33a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82ba8dc0 00007fbd82c331c0 00007fbd82c34231 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c
0709 13:09:09.959689 (+145523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.994949 (+ 35260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105002624}
W20260709 13:09:10.149405 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.635s (SENT) [suppressed 42 similar messages]
I20260709 13:09:10.151490 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.120426 28913 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.162034 28915 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.146478 28890 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.142984 28667 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.090003 28863 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.152153 28849 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.178689 28742 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.092407 28885 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.179338 28742 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.179955 27338 raft_consensus.cc:2393] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.180624 28742 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.181975 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:10.182225 28742 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.182543 27338 raft_consensus.cc:2376] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3. Re-sending same reply.
I20260709 13:09:10.176071 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.183969 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.178418 27336 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.185667 28921 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.187829 27261 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.184020 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:10.174588 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.186901 28896 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.191898 28709 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.192426 28709 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.194401 28709 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.194854 28863 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.179364 28849 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.199694 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.200372 27338 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:10.201258 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.202459 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:10.195806 28885 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.203756 28896 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.204126 28896 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:10.204968 28896 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.206269 28896 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.208102 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.208956 27259 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:10.212246 28901 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.723s	user 0.011s	sys 0.000s
I20260709 13:09:10.213732 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 85) took 1015 ms. Trace:
I20260709 13:09:10.125283 28850 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.214242 27408 rpcz_store.cc:276] 0709 13:09:09.198658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.204830 (+  6172us) service_pool.cc:224] Handling call
0709 13:09:09.241418 (+ 36588us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.242340 (+   922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.242375 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.242905 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.336264 (+ 93359us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:09.396751 (+ 60487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.404878 (+  8127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.162752 (+757874us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:10.213265 (+ 50513us) raft_consensus.cc:1685] finished
0709 13:09:10.213300 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.213649 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":540,"raft.queue_time_us":1572,"spinlock_wait_cycles":10427136,"thread_start_us":59149,"threads_started":1,"wal-append.queue_time_us":200169}
I20260709 13:09:10.221966 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.224390 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.224969 27338 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:10.216038 28906 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.226909 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.227871 28906 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.228785 28906 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:10.229665 28925 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.312s	user 0.008s	sys 0.004s
I20260709 13:09:10.229892 28906 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.234899 27260 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:10.237893 27260 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:10.219578 28639 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.241495 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53800us
I20260709 13:09:10.242321 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.243973 28709 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.232456 28863 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.240985 28832 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.244719 28854 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.244197 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:10.246989 28639 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.248095 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.249248 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.249557 28639 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.249711 28854 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.250468 28854 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.250607 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:10.251502 28854 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:10.252344 28795 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 13:09:10.252658 28921 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.249559 28863 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.256258 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.256714 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.259929 27339 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:10.260907 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.261093 27261 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:10.261739 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.264223 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.262153 27261 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:10.244719 28847 consensus_meta.cc:287] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.005s
I20260709 13:09:10.269580 27342 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:10.283082 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.301867 27338 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:10.304396 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.276067 27339 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:10.308072 27260 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:10.263214 28908 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.311362 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.313876 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.265439 28863 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.275555 28639 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:09:10.316442 28014 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 2: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:10.272886 28832 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.318464 27267 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.318890 27267 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.318269 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:10.319854 27267 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.320891 27267 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:10.321034 28924 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:09:10.321549 27339 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.324151 28850 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:10.325515 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.327605 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.271202 28806 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:10.328259 27261 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.339628 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.342684 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.344023 27259 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:10.345548 27415 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.349190 27341 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.298650 28847 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.334863 28667 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.363955 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:10.376933 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:10.275532 28709 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.392685 27343 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:10.404341 27417 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:10.416229 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 109639us
I20260709 13:09:10.433151 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:10.345664 28806 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.439739 27261 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:10.404785 28908 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:09:10.446935 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.450862 27417 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:10.454025 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:10.454845 28838 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.455227 28838 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.455559 28838 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.456266 28896 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.456712 28896 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:10.457532 28896 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.458591 27260 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.458781 28896 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:10.459678 28934 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:10.461870 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.461633 28938 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:10.462517 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.463358 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.445544 28900 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:10.485424 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:10.464118 28938 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.462352 28838 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.489317 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 92) took 2001 ms. Trace:
I20260709 13:09:10.489598 28806 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.489835 27334 rpcz_store.cc:276] 0709 13:09:08.488419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.489137 (+   718us) service_pool.cc:224] Handling call
0709 13:09:08.489530 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.754134 (+1264604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.489054 (+734920us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b540025c1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:10.489254 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088991616}
I20260709 13:09:10.488080 28938 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:10.500386 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:10.501168 28938 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.502288 28940 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:10.502596 28938 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.502792 28940 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:10.503320 28940 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.506045 28742 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.507145 28742 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:10.507722 28639 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.508113 28742 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.508534 28742 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.508234 28639 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.509311 28742 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.511430 28667 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.513650 28742 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.518467 28777 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.518977 28777 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.510378 28639 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.532456 28754 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.533089 28941 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:10.537758 27267 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:10.539994 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:10.581499 28866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.002s	sys 0.005s
I20260709 13:09:10.582442 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:10.583190 27264 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:10.541628 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 89) took 1141 ms. Trace:
I20260709 13:09:10.583626 27412 rpcz_store.cc:276] 0709 13:09:09.400511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.400685 (+   174us) service_pool.cc:224] Handling call
0709 13:09:10.541344 (+1140659us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54003c1754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:10.541536 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320239872}
I20260709 13:09:10.584002 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:10.584568 27264 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:10.543007 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:10.585671 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.586659 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:10.552696 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.555831 28937 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:10.559127 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.559738 27263 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:10.588927 27263 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.561007 28689 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:10.560842 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.577576 28941 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.562793 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.538599 28777 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.512961 28667 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:10.564139 27340 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.579586 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:10.545627 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.595644 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.577718 28639 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.597779 27261 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.598129 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33594 (request call id 3) took 1222 ms. Trace:
I20260709 13:09:10.597890 28639 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.599671 28777 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.600432 28639 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.592636 27263 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.594763 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.590278 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:10.591746 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:10.561872 28847 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.593467 27267 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.594791 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1628) took 1037 ms. Trace:
I20260709 13:09:10.607416 27340 rpcz_store.cc:276] 0709 13:09:09.560774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.563658 (+1002884us) service_pool.cc:224] Handling call
0709 13:09:10.563958 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.594538 (+ 30580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.594730 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:10.596004 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.608162 27263 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.596787 28941 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.606484 27262 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:10.614467 27264 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.598596 27409 rpcz_store.cc:276] 0709 13:09:09.376239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.389064 (+ 12825us) service_pool.cc:224] Handling call
0709 13:09:10.597921 (+1208857us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54003c1754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2b853 00007fbd87bf960a 00007fbd8117f7d4 00007fbd8117f762 00007fbd8117f691 00007fbd8117f60c 00007fbd8117e8c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:10.598034 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386907904}
I20260709 13:09:10.590571 28689 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.616860 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.615559 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:10.633797 28941 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.635701 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.636343 27340 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:10.637475 28941 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.619493 28888 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.619974 28854 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:10.642763 28888 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:10.643668 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:10.644145 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:10.644630 27409 raft_consensus.cc:606] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:10.646844 28888 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:10.647341 28888 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:10.647753 28888 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.642923 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 244) took 1524 ms. Trace:
I20260709 13:09:10.651914 28015 rpcz_store.cc:276] 0709 13:09:09.118293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.120864 (+  2571us) service_pool.cc:224] Handling call
0709 13:09:10.623031 (+1502167us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b540060f754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:10.623159 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436927360}
I20260709 13:09:10.625972 28718 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:10.661778 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1620) took 1115 ms. Trace:
I20260709 13:09:10.662343 27341 rpcz_store.cc:276] 0709 13:09:09.546038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.265700 (+719662us) service_pool.cc:224] Handling call
0709 13:09:10.271223 (+  5523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.349743 (+ 78520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.661456 (+311713us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54002d9e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:10.661697 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175524224}
I20260709 13:09:10.665581 27263 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:10.666026 27263 pending_rounds.cc:85] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:09:10.666256 27263 pending_rounds.cc:107] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:10.672569 27263 raft_consensus.cc:2889] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.673637 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 871) took 1151 ms. Trace:
I20260709 13:09:10.676973 28754 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:10.677599 28754 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.680667 28754 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:10.620280 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 881) took 1028 ms. Trace:
I20260709 13:09:10.618160 28847 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.670812 28888 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:10.687059 27265 rpcz_store.cc:276] 0709 13:09:09.592172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.735115 (+142943us) service_pool.cc:224] Handling call
0709 13:09:09.752018 (+ 16903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.814815 (+ 62797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.620037 (+805222us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5400313dd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:10.620220 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103672576}
I20260709 13:09:10.603768 28709 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:10.622167 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:10.688313 28709 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.689064 28013 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:10.689538 28742 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:10.625406 28925 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
I20260709 13:09:10.690279 28742 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.690721 28709 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.624686 27380 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:10.631611 28667 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.603696 28902 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.687638 27340 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.689610 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 249) took 1369 ms. Trace:
I20260709 13:09:10.626334 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:10.625943 28012 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:10.686174 28805 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:10.673982 27263 rpcz_store.cc:276] 0709 13:09:09.521809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.521957 (+   148us) service_pool.cc:224] Handling call
0709 13:09:10.559397 (+1037440us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:10.559607 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.673349 (+113742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.673574 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5274368}
I20260709 13:09:10.742066 27339 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:10.750658 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 126125us
W20260709 13:09:10.696043 28859 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:10.747566 28013 rpcz_store.cc:276] 0709 13:09:09.320403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.332871 (+ 12468us) service_pool.cc:224] Handling call
0709 13:09:10.621981 (+1289110us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:10.689544 (+ 67563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6774656}
I20260709 13:09:10.750324 28847 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.762758 28847 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:10.749564 28946 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.168s	user 0.000s	sys 0.006s
I20260709 13:09:10.767064 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.767970 27343 raft_consensus.cc:1217] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:09:10.768497 27343 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:10.769516 28742 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.769856 27343 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:10.750558 28805 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:10.770891 28805 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.774044 28805 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:10.746541 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 120290us
I20260709 13:09:10.777693 28639 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:10.777571 28847 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.753502 28007 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 1 LEARNER]: Advancing to term 2
I20260709 13:09:10.779119 28902 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:10.780400 28902 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:10.780731 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.780812 28902 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.755028 27338 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.755748 27337 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.758395 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:10.760715 28948 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:09:10.651916 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:10.771320 27334 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.772927 28888 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.666323 27341 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.775120 27343 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
W20260709 13:09:10.775303 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.778366 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.778337 28639 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:10.782575 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.782331 28902 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.755439 28709 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:10.783880 28667 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.784839 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.786665 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:10.743918 28950 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.161s	user 0.000s	sys 0.003s
W20260709 13:09:10.787408 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.691337 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:10.789857 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:10.791973 27337 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:10.774554 28689 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.824201 27338 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:09:10.897526 27338 pending_rounds.cc:85] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 1
I20260709 13:09:10.897711 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1485) took 1010 ms. Trace:
I20260709 13:09:10.897953 27338 pending_rounds.cc:107] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:10.898280 27338 raft_consensus.cc:2889] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:10.898161 27341 rpcz_store.cc:276] 0709 13:09:09.887473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.665804 (+778331us) service_pool.cc:224] Handling call
0709 13:09:10.666110 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.897460 (+231350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.897654 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:10.891772 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.899811 27268 raft_consensus.cc:2410] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:10.846596 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:10.901053 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 122762us
W20260709 13:09:10.904841 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.905503 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:10.906055 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.779083 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1630) took 1072 ms. Trace:
W20260709 13:09:10.911369 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 106417us
I20260709 13:09:10.914508 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 870) took 1395 ms. Trace:
I20260709 13:09:10.915400 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.915300 27268 rpcz_store.cc:276] 0709 13:09:09.519578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.519892 (+   314us) service_pool.cc:224] Handling call
0709 13:09:10.789700 (+1269808us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:10.914437 (+124737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11068800}
I20260709 13:09:10.918347 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.921851 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.924041 28014 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:10.792356 28937 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.823033 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 275) took 1266 ms. Trace:
I20260709 13:09:10.907232 28718 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:10.933082 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.833874 28938 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:10.934609 28849 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:10.935387 28639 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:10.971088 28639 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:10.972129 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1623) took 1425 ms. Trace:
I20260709 13:09:10.972662 27339 rpcz_store.cc:276] 0709 13:09:09.548414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.322537 (+774123us) service_pool.cc:224] Handling call
0709 13:09:10.741811 (+419274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.750950 (+  9139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.971844 (+220894us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b540025bcd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:10.972050 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963465984}
I20260709 13:09:10.936486 28902 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:10.975354 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.927345 28888 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:10.979949 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.980794 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.981241 28838 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.981591 27411 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:10.982728 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:10.920351 28908 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:10.925495 28782 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:10.988240 28782 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:10.989213 28782 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:10.990571 28944 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:09:10.911113 28777 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:10.991456 28777 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:10.993692 28777 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:10.932209 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.995453 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.996093 28008 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:10.997287 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.000751 28947 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
I20260709 13:09:11.002189 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:10.913688 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:10.937014 28850 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:10.937391 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 154904us
I20260709 13:09:10.937757 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.938181 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:10.939062 28673 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:10.940327 28553 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:10.943496 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.931756 28900 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:10.963501 28689 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:10.834486 28009 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:11.038300 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:11.040088 27268 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:11.041391 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:11.041909 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:11.042279 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:11.043370 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:11.044315 27408 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:11.045228 28673 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:11.045691 28673 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:11.046085 28673 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.020839 28709 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:11.050236 28709 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.052241 27415 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.053308 28709 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:10.933413 28012 rpcz_store.cc:276] 0709 13:09:09.545334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.551471 (+  6137us) service_pool.cc:224] Handling call
0709 13:09:10.625723 (+1074252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.755233 (+129510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.788119 (+ 32886us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540060f750. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:10.811592 (+ 23473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300180736}
W20260709 13:09:11.059240 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.010694 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 84447us
I20260709 13:09:10.910208 27340 rpcz_store.cc:276] 0709 13:09:09.707104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.638813 (+931709us) service_pool.cc:224] Handling call
0709 13:09:10.639084 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.745196 (+106112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.778817 (+ 33621us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b540025add4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:10.779020 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111231872}
W20260709 13:09:11.013947 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.018841 27338 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:11.018836 27417 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:10.924674 27409 raft_consensus.cc:606] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:11.026952 27342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1612) took 1483 ms (client timeout 1635 ms). Trace:
I20260709 13:09:10.931962 28806 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:11.063334 27342 rpcz_store.cc:269] 0709 13:09:09.543324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.543446 (+   122us) service_pool.cc:224] Handling call
0709 13:09:11.026777 (+1483331us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54001fcf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:11.026891 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621486976}
I20260709 13:09:10.789072 28940 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.079831 27410 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:11.079954 28007 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:09:11.080636 28709 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.081125 28940 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:11.081789 28949 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:09:11.081270 28709 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:11.055042 28912 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.363s	user 0.003s	sys 0.013s
W20260709 13:09:11.096231 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.098657 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:11.105168 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:10.969300 28937 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.055292 28900 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:11.087406 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 271) took 1744 ms. Trace:
W20260709 13:09:11.123448 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.131350 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.098093 28667 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.039228 28938 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.112946 28777 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:11.113581 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1627) took 1557 ms. Trace:
I20260709 13:09:11.136345 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.139869 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1618) took 1594 ms. Trace:
W20260709 13:09:11.169651 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 232968us
I20260709 13:09:11.134775 28866 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.134984 28859 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.165763 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.189970 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:11.141476 28778 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:11.192229 27413 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:09:11.139299 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:11.197785 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.191612 28940 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.211200 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 90) took 1775 ms. Trace:
I20260709 13:09:11.214130 27416 rpcz_store.cc:276] 0709 13:09:09.435730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.435852 (+   122us) service_pool.cc:224] Handling call
0709 13:09:09.450602 (+ 14750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.456250 (+  5648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.456297 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.456907 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.506889 (+ 49982us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:09.506932 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.506998 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.054468 (+1547470us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:11.197843 (+143375us) raft_consensus.cc:1685] finished
0709 13:09:11.197877 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.211115 (+ 13238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7296,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":13789312,"thread_start_us":49575,"threads_started":1,"wal-append.queue_time_us":133354}
W20260709 13:09:11.203007 28949 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:11.144366 28667 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.206683 28888 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.210451 28940 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.207583 28718 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:11.226042 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 296115us
I20260709 13:09:11.130879 28007 rpcz_store.cc:276] 0709 13:09:09.336373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.396971 (+ 60598us) service_pool.cc:224] Handling call
0709 13:09:10.750038 (+1353067us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:10.753358 (+  3320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.080572 (+327214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.080855 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9995520}
I20260709 13:09:11.209703 28778 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:11.208046 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:11.217180 28859 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.220844 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:11.224300 28888 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.225875 27408 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:11.278131 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 64955.2us
I20260709 13:09:11.154757 27334 rpcz_store.cc:276] 0709 13:09:09.556570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.492883 (+936313us) service_pool.cc:224] Handling call
0709 13:09:10.749003 (+256120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.910720 (+161717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.063629 (+152909us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54002887d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:11.106900 (+ 43271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581221120}
I20260709 13:09:11.219656 28900 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.296727 28709 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:11.272060 28778 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.281666 28012 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.281631 28718 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.154951 27335 rpcz_store.cc:276] 0709 13:09:09.545564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.704675 (+159111us) service_pool.cc:224] Handling call
0709 13:09:09.716400 (+ 11725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.716610 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.716641 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.516786 (+800145us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b2c0000e678. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:09:10.517250 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.791909 (+274659us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:11.125758 (+333849us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.127029 (+  1271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.127137 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.127215 (+    78us) raft_consensus.cc:1685] finished
0709 13:09:11.139614 (+ 12399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.139794 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233,"raft.queue_time_us":8816,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4672,"spinlock_wait_cycles":3376512,"thread_start_us":558007,"threads_started":2,"wal-append.queue_time_us":270734}
I20260709 13:09:11.313330 28742 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:11.313803 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 260648us
I20260709 13:09:11.314725 28938 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.287132 28888 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.273904 28961 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:09:11.333371 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 135666us
W20260709 13:09:11.312724 28955 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:09:11.341338 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.314769 28940 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:11.362329 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.350044 28961 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:11.351112 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.312412 28959 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:09:11.361361 28937 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.372924 28667 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.373117 27165 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.376415 28959 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:11.377214 28959 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.378146 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:11.379554 28964 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:11.342239 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 114024us
I20260709 13:09:11.376526 28961 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.382622 27165 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:11.281402 28859 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.384829 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.390192 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 253936us
W20260709 13:09:11.391276 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.391428 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.391054 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.395756 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.342579 28777 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:11.380659 28673 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.384449 28961 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:11.387445 28953 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:11.405126 27165 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to <none>, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:11.387212 28960 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:11.425799 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 84564.5us
I20260709 13:09:11.426038 27268 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.428797 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.429975 27165 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.432066 27165 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.454206 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:11.435227 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:11.461536 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.437716 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46730.8us
I20260709 13:09:11.450044 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:11.420153 28847 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.421150 28959 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:11.499416 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45303us
I20260709 13:09:11.424078 28976 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.421396 28971 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.426643 28953 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:11.504668 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.501008 28946 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:11.505795 27415 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:11.505846 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.498792 27165 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.475067 27261 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:11.504684 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:11.519594 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.501184 28948 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:11.524758 27165 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:11.501421 28970 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:11.503844 28943 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.475311 28779 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:09:11.434353 28973 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:09:11.521049 28953 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.533697 27165 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 3 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:11.434407 28960 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.522989 28667 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:11.543301 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 114570us
I20260709 13:09:11.545292 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.529896 28639 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:11.534200 28976 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.545404 27165 catalog_manager.cc:5697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:11.543525 28742 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.580277 28960 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.582239 28938 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:11.591146 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.007s	sys 0.005s
W20260709 13:09:11.598062 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.005s
I20260709 13:09:11.557184 28639 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.542804 28940 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:11.538652 28970 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.568619 28972 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:11.604864 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 952962us
W20260709 13:09:11.583086 28975 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:11.584188 28859 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.527395 28777 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:11.609527 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.604755 28667 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.570713 28709 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 13:09:11.617475 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.629640 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.569481 28943 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:09:11.583352 28779 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:11.623869 28953 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.619093 28742 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.605365 28639 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:11.604569 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84927.3us
I20260709 13:09:11.638794 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.635313 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 90117us
W20260709 13:09:11.614111 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 78117.7us
I20260709 13:09:11.628916 28673 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.572482 28961 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.629141 28859 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:11.631225 28962 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.648775 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.642488 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60709.2us
I20260709 13:09:11.636147 28836 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.668572 27412 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.641736 28742 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:11.671090 28689 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.007s
I20260709 13:09:11.671665 28742 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:11.671952 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.672665 27336 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:11.673724 28953 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.653216 28938 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.674378 28938 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:11.636214 28992 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.655987 27410 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:11.655916 28866 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.639647 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:11.699108 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50437.8us
W20260709 13:09:11.699617 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60807.3us
I20260709 13:09:11.616261 28972 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.700249 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.638113 28940 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:09:11.707628 28993 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.708808 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.711725 27412 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.713460 27412 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:11.651573 28012 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:11.717303 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.718190 27342 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:11.701442 28992 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.720762 28992 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.691948 28742 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.715651 27412 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.723106 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:11.726819 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.726926 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:11.727680 27337 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:11.725505 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.729579 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.729790 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.729887 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:11.733981 27412 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.715013 28961 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.738898 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:11.747751 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 81190.7us
I20260709 13:09:11.684441 28859 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.761475 27343 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:11.761871 27341 raft_consensus.cc:2368] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:11.767210 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.769771 27341 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.722824 28777 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:11.770851 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:11.701680 28900 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:09:11.702666 28888 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.733187 28689 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:11.675583 28938 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.692694 28962 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:11.781844 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.778344 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69769.5us
I20260709 13:09:11.783938 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.785560 28742 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.715286 28778 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.786736 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:11.787272 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:11.787845 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:11.788269 28778 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.788394 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:11.781370 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.792982 28859 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.800331 28639 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.801714 28667 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.802526 28639 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:11.802608 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:11.803615 28970 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.804134 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:11.804579 28972 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.804746 28777 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:11.805444 28993 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.808065 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:11.812732 27337 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:11.819000 29003 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:11.814860 27414 raft_consensus.cc:2368] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:11.814220 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.815210 27412 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:11.823496 28993 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:11.824618 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 56418.8us
W20260709 13:09:11.826424 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 123686us
I20260709 13:09:11.827893 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:11.832208 28962 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:11.816726 28673 raft_consensus.cc:2764] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:11.833747 28639 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.816373 28953 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.834033 29008 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:11.834753 28866 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.813938 28999 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:11.836324 28981 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.328s	user 0.003s	sys 0.000s
I20260709 13:09:11.837117 29012 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:11.837180 27342 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:11.837639 29012 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:11.838037 28982 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.270s	user 0.000s	sys 0.003s
I20260709 13:09:11.824110 28993 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:11.839489 27260 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:11.834440 28953 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:11.840143 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.834131 27336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1496) took 1775 ms (client timeout 1832 ms). Trace:
W20260709 13:09:11.840710 27336 rpcz_store.cc:269] 0709 13:09:10.059110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.784553 (+725443us) service_pool.cc:224] Handling call
0709 13:09:11.833957 (+1049404us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b540014c3d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:11.834076 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1783643008}
I20260709 13:09:11.836335 28999 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.838537 29012 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.843469 28993 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.826169 28777 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.844736 27340 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:11.871932 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:11.878054 27412 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.846276 28888 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.848685 27980 leader_election.cc:400] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:11.891798 27980 leader_election.cc:403] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:11.891686 29013 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.892450 29013 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.892830 29013 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.791486 28689 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.894666 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:11.895231 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65391.1us
I20260709 13:09:11.926852 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:11.928155 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.928769 27412 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:11.843690 28953 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.893013 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:11.928207 28777 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:11.933596 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:11.934180 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.847800 28999 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:11.894810 28866 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:11.930752 28971 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:11.932117 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 103615us
I20260709 13:09:11.930249 28996 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.844805 28639 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:11.929145 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74502.4us
I20260709 13:09:11.944774 29010 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:11.947050 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:11.949221 29011 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.949749 29011 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:11.936903 28777 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:11.951722 28777 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:11.932080 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:11.952898 27334 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:11.954115 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:11.947274 28689 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:11.963425 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.959359 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:11.959676 28892 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.960278 28937 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:11.965266 28937 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:11.966403 28639 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:11.966182 28937 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.950630 29011 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:11.967453 28937 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.961547 29014 raft_consensus.cc:993] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:09:11.970695 29014 raft_consensus.cc:1081] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Signalling peer b0e4232110db400d8f43fe2170c24c95 to start an election
I20260709 13:09:11.956143 28805 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:11.964387 28892 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:11.974258 27410 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:11.974328 28892 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:11.976073 28892 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.977250 28971 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.973110 27415 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:09:11.982206 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:11.982290 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:11.982743 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:11.983409 27412 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:11.997728 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:11.973079 28805 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.999707 27267 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.003661 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.004280 27412 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:12.004884 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.005050 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:12.006269 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.006327 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.002521 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.007513 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:12.008505 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.008949 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.009754 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:12.011512 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57060us
I20260709 13:09:11.984360 27409 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.012120 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:11.984427 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.009126 27259 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.012791 27416 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:11.969615 28993 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.013324 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.020387 27262 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:12.012691 27266 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.014256 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.014747 27268 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:12.021921 27261 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.014787 27267 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.015837 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.014838 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:11.992291 28866 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.031589 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:12.033627 27264 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.016970 28754 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.018805 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.019305 27411 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.025405 27412 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:12.026217 29020 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.999706 29010 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:12.043620 29010 consensus_queue.cc:1243] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:09:12.043318 29020 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.044265 28866 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.044668 28866 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.045403 28015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:55754
I20260709 13:09:12.045544 28866 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.046252 28015 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:12.046710 28015 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.047848 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:12.049109 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:12.012056 28805 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.037746 27261 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:12.014220 28888 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.042013 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.050844 28639 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:12.046870 28866 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.051311 28639 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.051779 28639 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.052645 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:12.050310 28888 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.061451 28985 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.061939 28985 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:12.062256 27410 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.067241 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:12.023579 27408 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.068120 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:12.070137 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:12.070446 27380 leader_election.cc:400] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:12.070803 27380 leader_election.cc:403] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:12.039657 28842 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.071563 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.074270 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.041589 28754 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.077049 28742 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.075721 29016 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.078063 28742 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.069108 28943 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.081007 28015 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.072974 29010 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.079399 29003 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.087498 29003 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.087036 28953 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.087881 29003 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.088517 28011 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.084200 28007 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.090386 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.090728 29014 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:12.091001 27335 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.091219 29014 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.091689 29014 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.089787 29013 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.095355 27414 raft_consensus.cc:2368] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:12.096625 28971 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.097366 27263 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.077010 28842 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.099758 28842 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.100387 28993 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.100890 27335 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:12.081991 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.078470 28742 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.107287 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.107589 29006 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.107944 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:12.108197 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.108089 29006 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.110028 29020 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.110387 29006 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.107309 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.110738 28985 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:12.111644 27262 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.112200 28985 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.089514 28013 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:12.092748 28854 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.108115 27417 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:12.113698 28015 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.118471 28953 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:12.125286 28709 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:09:12.126380 28958 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.126986 28958 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.105180 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.129801 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.101207 28006 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.110651 29020 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:09:12.114131 28971 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.140992 28971 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.129607 28993 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:12.139676 28805 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.140101 28754 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.134647 28012 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:12.129436 28854 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.115413 28999 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:12.112524 28976 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:09:12.138873 28639 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.149926 28008 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.116472 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:12.141989 28993 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.155354 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.150712 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.156071 27340 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:12.156388 27415 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.156793 27415 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.158401 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.159063 27339 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.160943 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.161547 27341 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.162472 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.163690 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.163801 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.164626 27342 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:12.164808 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.165793 27342 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:12.166347 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.169122 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.171617 27339 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.146179 29024 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.148054 29020 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.150309 29022 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.157531 27415 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.167325 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.184221 27415 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.184792 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.181766 27335 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:12.151114 28999 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:12.189244 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.189357 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.192487 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.142007 28971 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.193609 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.195145 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.148458 28842 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:12.179627 28866 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.194929 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.187882 28972 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.204325 27267 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.204968 27416 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.164664 29014 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.128230 28958 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.182893 28754 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.206416 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.188607 29010 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:12.179945 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73686.7us
I20260709 13:09:12.191548 28999 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.188529 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.198851 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.200590 28953 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.190659 29022 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.227147 29022 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.207010 28972 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.244554 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.213442 29010 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.188920 29020 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.212317 28961 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:09:12.220919 28754 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:12.228626 28976 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.241768 28972 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.220350 28838 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:09:12.248318 28996 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:12.251953 29010 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.264247 27416 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.214749 28970 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:12.183230 28974 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:09:12.270093 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.245904 28953 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.276813 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.277523 29028 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.278311 29014 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:12.278149 28754 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.270767 28958 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.287638 28850 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:12.271327 28805 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.298601 27341 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:12.299715 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.262854 29024 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.291540 28986 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:09:12.284512 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.293957 28742 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.295590 28993 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.298065 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 388) took 1097 ms. Trace:
I20260709 13:09:12.298671 27342 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.272054 28987 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.262511 28976 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.302182 27306 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.283762 29028 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.306674 29020 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.304411 28011 rpcz_store.cc:276] 0709 13:09:11.200905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.201056 (+   151us) service_pool.cc:224] Handling call
0709 13:09:11.822010 (+620954us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:11.822230 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.088937 (+266707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.297844 (+208907us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54006608d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:12.298013 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614526464}
I20260709 13:09:12.289669 28639 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.312005 28974 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:12.312492 29025 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:09:12.299782 28996 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.314618 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.324855 27341 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.313380 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.322268 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.317129 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.289562 28777 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.329627 27415 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:12.331348 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.333806 27341 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:12.334563 27342 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:12.318727 29016 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3.
I20260709 13:09:12.315913 29028 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.338357 27416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:12.338934 27416 raft_consensus.cc:606] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:12.339241 27416 raft_consensus.cc:614] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:12.321571 28746 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:12.326735 28974 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:12.330879 28908 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.328821 28996 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.348124 27415 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:12.342531 28806 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.345155 27259 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.342006 28746 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:12.370985 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.371934 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.376245 27416 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:12.381979 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.382625 28953 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.384182 28996 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.355484 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:12.385375 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:12.386159 28953 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:12.386848 28953 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:12.387887 28777 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.388013 28953 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.388985 27342 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.389875 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.390370 28805 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.390869 28805 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.391299 28805 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.391538 27408 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.393146 27408 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.382124 28742 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.395922 28908 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:12.396180 28742 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.397680 28976 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.398391 29003 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.376770 28974 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.400957 29003 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.344858 29024 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.399009 28742 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.404915 28888 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.405759 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.407925 28742 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:12.408248 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.408806 28746 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.409539 28854 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.375383 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:12.413233 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.421627 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.425877 29003 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.426652 29003 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.429318 27341 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.429529 29003 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.410070 28970 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:12.436717 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.437368 27340 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
W20260709 13:09:12.438377 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 226263us
I20260709 13:09:12.441185 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:12.442198 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:12.420661 28866 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.443697 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.445338 27341 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.444170 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.435299 28742 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.449649 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:12.454005 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.455930 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.456003 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.446897 28971 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.441272 28746 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:12.447736 29003 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.469959 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.456408 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.470999 27339 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.459517 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.471521 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:12.472033 27261 raft_consensus.cc:2368] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:12.472754 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.473387 27261 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:12.474383 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.460434 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.461609 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:12.440312 28970 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.437110 28999 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.464227 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.465168 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.465668 28972 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.467449 28993 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.468093 28842 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:12.477083 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.491773 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.500880 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.448499 28866 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.470486 29003 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.506675 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.506839 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.510108 27261 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:12.512279 28888 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.512791 28888 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.515749 27336 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:12.516939 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.517730 27267 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:12.495528 28842 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.522162 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.521661 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.529776 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.530447 27264 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:12.530903 27261 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.531384 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.531988 27264 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:12.503958 28993 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.485658 28805 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.513639 29010 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.541255 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.527100 28842 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.548408 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.549394 27264 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:12.525300 28009 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.576409 28888 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.541919 28958 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:12.579792 28958 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.580075 28972 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.572399 28673 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.581964 28673 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.582481 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.580251 28958 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.586854 28993 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.592406 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.591930 29003 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.594856 29008 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.523052 28971 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:12.526667 29020 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:12.603976 27266 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:12.608199 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.552495 29024 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:12.617564 29037 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:12.620277 29010 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.623137 28958 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.627028 27266 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.627929 28805 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.629264 28999 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.631651 28866 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.632208 28958 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.636876 29028 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.601547 29026 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.641638 27412 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:12.607097 28013 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:12.644891 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.605654 28639 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.615492 29024 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.654278 27266 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.647083 28742 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.656498 28742 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.661801 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.639672 29026 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.662380 27266 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:12.595383 29008 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.665079 28673 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:12.668522 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.678282 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 506940us
I20260709 13:09:12.660710 29024 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.681466 27266 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:12.682274 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.675340 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:12.683104 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.692142 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.650365 28639 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.697609 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.698998 27266 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.700382 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.701332 27266 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:12.702554 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.704455 27266 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.706635 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.694104 29028 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.711225 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.711620 29010 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.713061 27233 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.690855 28970 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.716110 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.715421 27416 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:12.703706 28866 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.705271 28971 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.692225 29046 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.694043 28993 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:12.715590 29010 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:12.730774 28993 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:12.731225 28993 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.731261 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.732210 27408 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:12.725690 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.733207 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.733436 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.733867 27408 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.734732 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.727334 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.736621 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.714023 28972 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:12.735050 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:12.738049 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.739641 27416 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:12.740574 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:12.719383 29039 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.741138 27416 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.740453 29010 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.741757 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.736337 28866 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.747843 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.743578 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.732312 28993 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.749541 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.752324 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.756278 27267 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.750288 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.756894 27262 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.753706 28970 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:12.758664 28970 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:12.759106 28970 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.759359 29029 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:12.759771 29029 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:12.759124 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.742985 28673 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:12.756559 28639 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.764611 28866 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.766201 28993 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.755964 29028 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.767024 29028 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.769207 29028 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.760670 29029 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.771324 29029 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:12.772176 27265 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:12.772513 27416 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:12.773669 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:12.773978 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.774284 27266 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.775477 29008 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:12.775926 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.780527 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:12.740947 27410 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.781353 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:12.789701 27267 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:12.753321 27408 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:12.781013 29012 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.788417 28972 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:12.780712 28842 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.801640 27267 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:12.803079 27262 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:12.813043 27266 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:12.805125 29039 raft_consensus.cc:2764] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:12.819193 28938 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:12.821161 27264 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:12.824621 29013 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:12.827683 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:12.828418 28006 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:12.831331 27266 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:12.803952 28972 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.833762 28972 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.835839 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:12.836519 27415 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:12.837513 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:12.837805 27415 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.838140 28842 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.839429 28937 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:12.839999 28937 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.840924 28937 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:12.845528 29033 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.402s	user 0.003s	sys 0.000s
I20260709 13:09:12.848075 27980 leader_election.cc:400] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:12.848532 27980 leader_election.cc:403] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:09:12.828662 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.852519 27981 leader_election.cc:400] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:12.853919 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:12.854308 29040 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:12.854773 29040 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.848513 27262 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:12.789224 29024 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.862905 27336 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:12.855073 28888 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:12.870978 27268 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:12.855432 27413 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 1. Current term is 3. Ops: []
I20260709 13:09:12.871475 27268 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:12.872241 27268 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.879119 27266 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:12.854642 28970 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.880986 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:12.856981 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:12.864727 29002 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.865540 28888 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:12.894757 27334 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.882135 28953 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:12.909162 29006 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.920553 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.923493 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.901572 29002 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.916967 29006 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.927692 28993 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.936872 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 902) took 1527 ms. Trace:
I20260709 13:09:12.939793 27260 rpcz_store.cc:276] 0709 13:09:11.409925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.410037 (+   112us) service_pool.cc:224] Handling call
0709 13:09:11.450963 (+ 40926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.839832 (+388869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.936618 (+1096786us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001b85d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:12.936807 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892842240}
I20260709 13:09:12.927042 27409 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:09:12.944000 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.912689 29040 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:12.939481 28842 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:12.971912 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105117us
I20260709 13:09:12.959707 29010 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.974671 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:12.983726 29010 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:12.987927 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:12.943615 28993 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:12.990528 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 111105us
I20260709 13:09:12.972916 29040 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:12.934594 28888 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:12.975903 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 79037us
I20260709 13:09:12.973981 28842 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:12.976660 28972 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:12.992570 28970 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:12.992102 28996 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.008692 29064 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:13.001533 28754 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:12.993320 28937 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:12.992344 29024 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:13.004164 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 105915us
I20260709 13:09:13.019570 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1670) took 1018 ms. Trace:
I20260709 13:09:13.007483 29013 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:13.020944 29013 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.020049 27259 rpcz_store.cc:276] 0709 13:09:12.001268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.018547 (+ 17279us) service_pool.cc:224] Handling call
0709 13:09:13.019407 (+1000860us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540024c2d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.019513 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692718848}
I20260709 13:09:13.017764 29010 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.029410 29013 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.032790 29002 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.014391 28972 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.035945 29065 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:09:13.038110 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.023106 28996 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:13.042821 29066 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.048070 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1464) took 1066 ms. Trace:
I20260709 13:09:13.048545 27413 rpcz_store.cc:276] 0709 13:09:11.981577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.981689 (+   112us) service_pool.cc:224] Handling call
0709 13:09:12.855255 (+873566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.871669 (+ 16414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.047862 (+176193us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400086950. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.048010 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2008363776}
I20260709 13:09:13.049255 27411 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:13.049496 28842 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:13.050876 28993 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:13.051503 29006 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.043184 28996 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.053790 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:13.016781 28937 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.055631 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:13.055141 28006 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:13.058048 28890 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3.
I20260709 13:09:13.066226 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.067137 29009 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.067729 29009 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:13.068789 29009 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.075860 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1646) took 1349 ms. Trace:
I20260709 13:09:13.076313 27338 rpcz_store.cc:276] 0709 13:09:11.726721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.732823 (+  6102us) service_pool.cc:224] Handling call
0709 13:09:12.194983 (+462160us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:13.075689 (+880706us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540024fed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.075794 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467975680}
I20260709 13:09:13.077405 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:13.077924 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.078593 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.079916 28937 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:13.077943 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1664) took 1080 ms. Trace:
I20260709 13:09:13.081671 27265 rpcz_store.cc:276] 0709 13:09:11.997972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.010703 (+ 12731us) service_pool.cc:224] Handling call
0709 13:09:12.747687 (+736984us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:13.077778 (+330091us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540034f154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.077890 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47712896}
I20260709 13:09:13.082429 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 257) took 1042 ms. Trace:
I20260709 13:09:13.083907 27263 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:13.084316 27263 pending_rounds.cc:85] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 1
I20260709 13:09:13.084568 27263 pending_rounds.cc:107] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:13.084820 27263 raft_consensus.cc:2889] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.086081 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.086643 27260 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.082883 28007 rpcz_store.cc:276] 0709 13:09:12.039667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.040986 (+  1319us) service_pool.cc:224] Handling call
0709 13:09:12.044985 (+  3999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.090395 (+ 45410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.082165 (+991770us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b54004d3d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:13.082365 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70446464}
I20260709 13:09:13.091125 27341 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:13.092711 29032 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.695s	user 0.003s	sys 0.001s
I20260709 13:09:13.107133 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:13.078766 27334 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
W20260709 13:09:13.151750 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44721.5us
I20260709 13:09:13.152940 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:13.102916 28673 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:09:13.158509 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:13.092170 29071 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:09:13.109297 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:13.178151 29029 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.161873 28689 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.162420 28746 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.172756 28999 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.171583 29023 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.171413 29024 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:13.171193 28012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 394) took 1383 ms (client timeout 1701 ms). Trace:
I20260709 13:09:13.206537 28849 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:13.207720 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.151846 28782 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:09:13.223037 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.190056 28689 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.205363 29023 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.193671 28746 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:13.229123 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:13.193409 28999 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.227435 28689 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.234721 28718 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:13.274466 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:13.276011 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:13.277992 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.226275 29020 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.282366 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.279734 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.283257 27337 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:13.232740 29003 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.007s
I20260709 13:09:13.228799 28746 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.278625 27341 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:13.286958 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:13.284323 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.205200 29024 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.226722 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:13.281258 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.282063 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.310114 27338 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.310285 27340 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:13.235208 28849 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:09:13.280277 28782 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.289451 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.280957 28902 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.300509 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.304353 28013 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:13.305035 29006 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:13.331218 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.321180 27336 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:13.306325 27341 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:13.268787 28999 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.296612 29023 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.323419 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.333645 27339 raft_consensus.cc:2376] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3. Re-sending same reply.
W20260709 13:09:13.203867 28012 rpcz_store.cc:269] 0709 13:09:11.787843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.788151 (+   308us) service_pool.cc:224] Handling call
0709 13:09:13.154802 (+1366651us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400750154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.169687 (+ 14885us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791603456}
I20260709 13:09:13.327647 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.337481 27414 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:13.287458 28972 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.329521 27337 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:13.342581 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.345803 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.345992 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.346426 27339 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.347033 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.350769 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.351918 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.280665 28863 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:09:13.354230 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.354841 27336 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.329443 27338 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:13.356340 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.351941 27337 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:13.322497 28902 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.320828 28782 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.360751 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.288808 29020 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.357874 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:13.325781 29003 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.010s	sys 0.007s
I20260709 13:09:13.392107 27335 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:13.369834 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:13.371785 27337 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.324136 28006 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:13.373487 27266 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:09:13.396456 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.395648 27341 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.357842 29006 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:13.398753 29006 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.371038 28902 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.371779 28937 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.375986 28782 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.392802 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.407949 27416 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:13.410684 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.411751 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.427824 27339 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:13.370258 28746 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.402074 27408 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:13.391781 28718 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:09:13.419608 29009 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.443567 27341 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:13.432436 29003 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.451548 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.478826 27336 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:13.417348 28937 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.442709 29023 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.443184 29039 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.444666 29009 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.526366 27408 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.479206 29003 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.479568 28996 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:13.536796 29069 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:09:13.537338 29009 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.563220 28937 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.564905 29090 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:13.565680 29004 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.566126 29004 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:13.569468 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:13.570313 27413 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:13.570734 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.572587 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.573158 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.573362 27408 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.574477 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.575495 29099 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.576057 29099 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:13.577469 29080 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:09:13.545056 28754 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:13.579041 28754 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.580585 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 927) took 1325 ms. Trace:
I20260709 13:09:13.580659 29099 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.581178 27409 rpcz_store.cc:276] 0709 13:09:12.254879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.340711 (+ 85832us) service_pool.cc:224] Handling call
0709 13:09:12.348159 (+  7448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.943099 (+594940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.580313 (+637214us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540027d154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:13.580526 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303029632}
I20260709 13:09:13.582167 27265 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:13.582633 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.583083 28902 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.583946 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.584601 27262 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:13.574750 28782 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.585510 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.583323 27409 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:13.581279 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.580823 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:13.591472 27260 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.588220 27340 raft_consensus.cc:2368] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3.
I20260709 13:09:13.550550 29003 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.587426 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.583390 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.602587 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:13.597947 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.598377 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 152010us
I20260709 13:09:13.538885 28961 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:09:13.550457 29093 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.604337 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:13.588179 29078 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:09:13.603883 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:13.618602 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.619529 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:13.612461 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:13.558813 29024 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:13.626168 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.586174 28754 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.628340 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.615661 27408 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:13.541759 29039 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.556363 28996 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.659323 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:13.608989 29085 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.624393 28777 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:13.605963 28689 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.665548 29039 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.661803 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.632413 29020 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.666952 29026 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.702268 28943 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:13.705750 27408 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:13.707445 29020 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:13.707628 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45924.4us
I20260709 13:09:13.708220 29020 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:13.708945 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:13.709975 28902 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.710028 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:13.711292 29089 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:13.713972 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:13.715727 29087 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:09:13.567005 29004 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.719748 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.722260 27260 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:13.715728 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 920) took 1201 ms. Trace:
I20260709 13:09:13.755766 27267 rpcz_store.cc:276] 0709 13:09:12.514817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.803576 (+288759us) service_pool.cc:224] Handling call
0709 13:09:13.088055 (+284479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.088413 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.088446 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.092628 (+  4182us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.170298 (+ 77670us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:13.170338 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.170410 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.211288 (+ 40878us) raft_consensus.cc:1685] finished
0709 13:09:13.211318 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.715496 (+504178us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540034f150. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.715667 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":520596736,"thread_start_us":77272,"threads_started":1,"wal-append.queue_time_us":114567}
I20260709 13:09:13.669601 28777 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:13.777144 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:13.670729 29096 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.717476 28746 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.720371 27408 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:13.714008 29090 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:13.805107 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 212344us
I20260709 13:09:13.769681 28777 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.762740 29034 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:13.817195 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 213383us
I20260709 13:09:13.784418 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:13.845822 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 243307us
W20260709 13:09:13.857779 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:13.830932 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111398us
I20260709 13:09:13.804435 29020 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:13.861550 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.814543 29093 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:13.847651 29026 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:13.894448 29103 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:13.895080 29103 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:13.896188 29103 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.879706 28782 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:13.901605 29106 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:09:13.902820 29111 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:13.902915 27334 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:13.903339 29111 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:13.867446 29039 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:09:13.904270 29111 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.864748 27259 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.847829 29090 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:13.924723 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 63263.7us
I20260709 13:09:13.925593 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.817917 28902 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:09:13.867761 29085 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:13.948406 27412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 932) took 1692 ms (client timeout 2241 ms). Trace:
I20260709 13:09:13.816359 29096 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:13.948839 27412 rpcz_store.cc:269] 0709 13:09:12.256464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.316871 (+ 60407us) service_pool.cc:224] Handling call
0709 13:09:13.948233 (+1631362us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54003c2b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:13.948354 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715989760}
I20260709 13:09:13.950026 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:13.950050 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:13.950788 27412 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:13.952049 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:13.953438 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:13.953810 27412 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:13.933758 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:13.960345 29002 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:13.961238 29002 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:13.961696 29002 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.962105 29002 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:13.939668 29111 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:13.927764 28782 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:13.966840 29107 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:13.942272 29026 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:13.973224 27412 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:13.975533 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:13.981261 29026 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:13.983891 27415 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:13.989353 29003 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.982322 29026 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.994189 29009 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.996441 29009 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:13.555915 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:13.991412 29101 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:09:13.973291 29090 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:13.968194 28996 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.007576 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:14.016247 27412 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.005066 29085 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:13.974753 29107 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.031463 29093 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:14.038365 29107 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:14.039788 29104 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:09:14.028321 29106 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:14.042122 28006 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:14.044286 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1482) took 1314 ms. Trace:
I20260709 13:09:14.044747 27416 rpcz_store.cc:276] 0709 13:09:12.729415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.773368 (+ 43953us) service_pool.cc:224] Handling call
0709 13:09:12.773691 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.410319 (+636628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.044062 (+633743us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b54003a4b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:14.044228 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447464192}
I20260709 13:09:14.046706 27412 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:14.047060 27268 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.045138 29002 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:14.047591 28999 consensus_meta.cc:287] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 13:09:14.048013 28999 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.049258 29002 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.049428 27343 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:14.027791 29115 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.050400 29115 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.052876 29115 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.054487 28777 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:14.058701 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51300.9us
W20260709 13:09:14.064342 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 107866us
I20260709 13:09:14.071610 29119 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:14.072319 29119 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.074949 29119 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.075505 29119 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:14.076076 29119 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.080385 29119 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.061872 28777 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.099439 27339 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.099910 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.100572 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.101723 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.117632 27268 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:09:14.119433 27268 pending_rounds.cc:85] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
I20260709 13:09:14.119601 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.120463 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:14.121138 27339 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.121577 27268 pending_rounds.cc:107] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:09:14.123996 29034 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:14.122824 27268 raft_consensus.cc:2889] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:14.125145 29094 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:14.125866 29094 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:14.127030 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 130) took 1256 ms. Trace:
I20260709 13:09:14.126961 29094 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.063712 29106 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:14.130846 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.129663 27339 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:14.135764 29094 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:14.136310 27342 raft_consensus.cc:2393] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:14.131381 27268 rpcz_store.cc:276] 0709 13:09:12.870462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.870604 (+   142us) service_pool.cc:224] Handling call
0709 13:09:12.870864 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.046699 (+1175835us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b58004d03d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82b8d0aa 00007fbd82c0f447 00007fbd82c27fe7 00007fbd82c297de 00007fbd82c33b49 00007fbd82c34416 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4
0709 13:09:14.126521 (+ 79822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.126962 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321217280}
I20260709 13:09:14.114984 28007 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:14.068437 29096 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:14.145160 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85375.7us
I20260709 13:09:14.107371 28782 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:14.063597 29027 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:09:14.152290 27308 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:14.156821 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:14.136687 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.144968 28943 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:14.145602 29003 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:14.136582 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.180678 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:14.183226 27339 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:14.150990 29002 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:09:14.178331 29106 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.216073 28900 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:14.155757 28782 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.217628 28900 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:14.199384 29012 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:14.195245 27334 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:14.235718 29132 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:14.245968 29132 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.247008 29023 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.254518 29023 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:14.229233 28999 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.231475 29012 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:14.280730 29121 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:09:14.287868 27342 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:09:14.285528 29125 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 13:09:14.306797 29010 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.325594 29085 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:14.420535 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.422896 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 269509us
W20260709 13:09:14.473547 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 165290us
I20260709 13:09:14.273362 28900 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.532155 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.534739 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.504658 29130 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.538514 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:14.539880 27416 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:14.542989 29111 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:09:14.427500 29010 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.444729 29085 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.521562 29026 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.597026 28746 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.502529 29012 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.587266 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:14.589758 28999 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:14.612578 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 217111us
I20260709 13:09:14.591877 29137 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:14.588037 29130 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:14.614625 27411 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:14.694856 29138 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:09:14.699352 29127 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:09:14.704445 29010 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.705206 29010 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.671049 28953 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.706260 28953 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.707922 29142 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.708695 29142 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.709290 28953 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:14.685333 29137 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.713320 29137 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.722043 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:14.724532 29008 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:14.724946 29008 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.725283 29008 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.612211 29026 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.730453 29026 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.612340 28746 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.666754 28999 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.733492 28999 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.733361 29008 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.734130 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.735332 29008 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:14.737089 27259 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.001s
I20260709 13:09:14.737543 27259 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:14.737766 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:14.739027 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.688694 29131 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:09:14.737895 28689 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.744972 29085 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.745648 29085 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.746181 29085 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.748926 29130 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.749621 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:14.750463 27415 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:14.705375 29094 consensus_meta.cc:287] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.006s
W20260709 13:09:14.773186 27340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1528) took 1446 ms (client timeout 1912 ms). Trace:
W20260709 13:09:14.773694 27340 rpcz_store.cc:269] 0709 13:09:13.329988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.346814 (+ 16826us) service_pool.cc:224] Handling call
0709 13:09:14.772967 (+1426153us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b540025add4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:14.773107 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549119744}
I20260709 13:09:14.705853 29010 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.776103 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 944) took 1046 ms. Trace:
I20260709 13:09:14.776628 27259 rpcz_store.cc:276] 0709 13:09:13.729947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.753482 (+ 23535us) service_pool.cc:224] Handling call
0709 13:09:14.765473 (+1011991us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:14.781772 29124 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:09:14.782265 28888 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.783581 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.783772 29142 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:14.784408 28746 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.785012 27417 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:14.793529 27415 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
W20260709 13:09:14.800352 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.801111 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.802155 27417 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:14.805238 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:14.744997 29040 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.825690 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.827143 28999 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:14.828223 28999 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.828715 28999 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.830646 28999 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.831337 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:14.832615 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.832995 27334 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:14.833659 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.834004 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.834928 27337 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:14.831377 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.844468 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:14.804360 28849 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.804361 29099 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.846331 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:14.822450 28782 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.822052 28689 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.801762 29020 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:09:14.841619 29010 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.848618 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:14.859403 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.848011 29130 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:14.838819 29040 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.859218 28689 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.852883 29085 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.866216 28782 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:14.873821 29147 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.874058 29152 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.874408 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:14.852269 28849 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.881628 29010 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:14.859480 29146 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.868067 28900 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:14.905258 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 67303.2us
I20260709 13:09:14.854672 29099 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.907529 29010 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.884549 28782 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.884449 29130 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:14.898170 29085 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.919991 27338 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:14.918576 28782 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:14.916206 29153 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.897065 29147 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.933007 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:14.933660 27263 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:14.936354 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:14.937101 27261 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:14.937378 28900 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.938042 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:14.937915 28900 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.938832 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:14.921928 29085 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.921830 29151 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.939941 28900 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.940199 29151 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.940606 29159 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.939942 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:14.942785 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:14.943341 27265 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:14.898912 29152 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.947382 27261 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 2: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:14.949220 28689 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:14.949415 29149 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:09:14.949656 29151 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.951133 29147 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.951664 29147 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.952096 29147 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.954488 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:14.932435 29150 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.941334 29085 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.935184 29040 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.911194 29146 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.928887 29158 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.958698 29160 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.941067 29159 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.968083 29099 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.968854 29010 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:14.969282 29130 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.971381 29152 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.953657 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:14.934284 29153 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:14.974608 28849 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:14.979781 29023 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.001s
I20260709 13:09:14.962842 29040 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:14.978564 27411 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:14.953122 27408 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:14.974740 29132 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.990995 29023 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.988683 27259 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.001730 29081 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.004613 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:15.001830 27263 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:15.005854 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:15.008983 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:14.999773 29103 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.012542 29164 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.012830 29147 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.013230 29164 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:14.959717 29150 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.006497 29151 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.021288 29145 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:15.022675 29163 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:15.005575 29115 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:14.972574 29158 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.006624 29066 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:14.993130 29040 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.008266 28777 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.025748 29153 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:14.990280 29160 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.019857 29103 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.042991 29066 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.043095 29115 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.035918 29151 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.133260 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.014972 29081 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:15.142058 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 136269us
I20260709 13:09:15.144621 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:15.139205 29158 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.153297 28842 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.153319 29163 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:15.154178 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.133812 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.136471 29146 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.126652 29159 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.160467 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:15.161502 28842 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:15.163605 29151 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.163416 29158 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.166277 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:15.168424 29066 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.154079 29163 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.174427 28842 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:15.178035 27231 leader_election.cc:400] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3.
I20260709 13:09:15.178335 27231 leader_election.cc:403] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:15.179625 29023 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:15.173559 29084 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.175028 28842 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.177488 29066 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.182899 29158 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.262914 29081 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.248028 29066 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.173537 29160 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.262729 29146 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.188126 29164 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.236959 29040 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.236447 29084 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:15.305882 29081 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.291930 28689 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.306483 29081 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.291105 28961 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.307855 28961 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.308825 29081 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.310231 28961 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.311554 29150 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.307060 28689 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.314365 28689 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.315112 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.311444 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.316020 29163 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.291265 29158 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:15.497967 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.383771 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.498749 28953 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:15.498121 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.589452 28012 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:15.384811 28689 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.415666 29084 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:15.586333 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 241860us
I20260709 13:09:15.592779 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:15.622192 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.000s	sys 0.026s
W20260709 13:09:15.411967 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.441876 27308 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 2.108s (SENT) [suppressed 3 similar messages]
W20260709 13:09:15.622622 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.000s	sys 0.026s
I20260709 13:09:15.498518 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.588950 28953 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.344174 29153 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.384135 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.642648 29153 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:15.640936 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48216us
I20260709 13:09:15.643687 29146 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.643738 29153 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.645282 29153 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.645622 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.627705 28863 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:15.646615 28863 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:15.385169 29066 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.647234 29163 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.638019 29161 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:15.591019 28689 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.648368 29161 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.414719 29115 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.647678 29163 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.384946 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.649991 28007 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:15.665310 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:15.667927 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 1.79415e+06us
I20260709 13:09:15.651970 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:15.647723 28863 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.670547 29163 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.671237 27265 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:15.382123 28782 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.679301 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:15.680071 27260 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:15.681182 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:15.682554 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:15.675205 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:15.687723 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:15.675199 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 233319us
I20260709 13:09:15.588106 29158 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.692718 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 936) took 2116 ms. Trace:
I20260709 13:09:15.693069 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.694211 29081 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.695569 28972 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:15.695060 29081 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.695972 28972 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.696383 28972 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:15.698962 27340 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:15.709530 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.710285 27334 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:15.693106 27266 rpcz_store.cc:276] 0709 13:09:13.576109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.580003 (+  3894us) service_pool.cc:224] Handling call
0709 13:09:13.580376 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:13.667869 (+ 87493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:13.667910 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:13.691306 (+ 23396us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.926334 (+235028us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b1800309e80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:13.963654 (+ 37320us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:13.963692 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.692384 (+1728692us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b54001b85d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:15.692444 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.692499 (+    55us) raft_consensus.cc:1685] finished
0709 13:09:15.692510 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.692639 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33847,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":217197312,"thread_start_us":37144,"threads_started":1,"wal-append.queue_time_us":398260,"wal-append.run_cpu_time_us":1950,"wal-append.run_wall_time_us":1067221}
I20260709 13:09:15.712659 28961 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.712944 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:15.713462 28961 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.715773 28782 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.716120 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 967) took 1181 ms. Trace:
I20260709 13:09:15.716509 27410 rpcz_store.cc:276] 0709 13:09:14.535998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.537680 (+  1682us) service_pool.cc:224] Handling call
0709 13:09:15.715363 (+1177683us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:15.715543 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.715739 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.715771 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.715815 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.715856 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.715921 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.716059 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4543872}
I20260709 13:09:15.717795 28961 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.718221 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.719662 28863 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.717168 28777 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.720553 28777 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.722715 28777 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.698120 29081 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.676656 29099 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:09:15.740307 29081 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:15.743732 28689 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.764844 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.765688 27338 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:15.767904 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.756084 29081 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.775645 29163 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.780987 29066 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.781287 27260 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:15.774829 29081 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.781440 29066 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:15.792196 27259 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.783s	user 0.013s	sys 0.000s
I20260709 13:09:15.780998 29112 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:15.804628 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:15.814777 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 901769us
I20260709 13:09:15.816025 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 970) took 1229 ms. Trace:
I20260709 13:09:15.820640 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1689) took 1721 ms. Trace:
W20260709 13:09:15.822315 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 147212us
I20260709 13:09:15.822460 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 966) took 1287 ms. Trace:
I20260709 13:09:15.823132 29009 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:15.823645 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 975) took 1090 ms. Trace:
I20260709 13:09:15.824052 29096 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.828296 28940 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:15.870038 27416 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:15.828913 28937 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:15.830487 27165 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 210) took 5492 ms. Trace:
W20260709 13:09:15.874204 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 103090us
I20260709 13:09:15.830895 27415 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:15.831319 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.831794 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.834690 29082 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:15.791198 29066 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:15.842218 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.801921 27259 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
W20260709 13:09:15.878757 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.860097 27335 rpcz_store.cc:276] 0709 13:09:14.099211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.099438 (+   227us) service_pool.cc:224] Handling call
0709 13:09:15.819822 (+1720384us) spinlock_profiling.cc:243] Waited 966 us on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:15.820084 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.820263 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:15.820293 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.820342 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:15.820377 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.820445 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.820570 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222464}
I20260709 13:09:15.793541 28953 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.860033 27414 rpcz_store.cc:276] 0709 13:09:14.586435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.586611 (+   176us) service_pool.cc:224] Handling call
0709 13:09:14.779277 (+192666us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:14.779502 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.779751 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:14.926996 (+147245us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.815529 (+888533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.815618 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:15.815679 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.815770 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.815945 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":888205,"prepare.queue_time_us":63084,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":513,"raft.queue_time_us":889493,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":2567552,"thread_start_us":122146,"threads_started":1}
I20260709 13:09:15.865911 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:15.881667 29012 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:15.882117 29012 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:15.882467 29012 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:15.892194 27383 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:15.894601 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.868673 29163 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.897758 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.897856 28943 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:15.900447 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:15.911074 27417 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:15.881726 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:15.872283 27165 rpcz_store.cc:276] 0709 13:09:10.338301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.338528 (+   227us) service_pool.cc:224] Handling call
0709 13:09:15.830405 (+5491877us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:11.962614 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:11.984627 (+ 22013us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:11.984719 (+    92us) write_op.cc:435] Acquired schema lock
0709 13:09:11.984762 (+    43us) tablet.cc:662] Decoding operations
0709 13:09:12.107522 (+122760us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:12.107630 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:12.107663 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:12.108598 (+   935us) tablet.cc:701] Row locks acquired
0709 13:09:12.108660 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:09:12.108832 (+   172us) write_op.cc:270] Start()
0709 13:09:12.109004 (+   172us) write_op.cc:276] Timestamp: P: 1783602552108768 usec, L: 0
0709 13:09:12.109048 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:09:12.109720 (+   672us) log.cc:844] Serialized 3669 byte log entry
0709 13:09:12.545066 (+435346us) op_driver.cc:464] REPLICATION: finished
0709 13:09:12.706261 (+161195us) write_op.cc:301] APPLY: starting
0709 13:09:12.712286 (+  6025us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:12.739618 (+ 27332us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:12.743056 (+  3438us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:12.748785 (+  5729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:12.749017 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:09:12.749063 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:12.749324 (+   261us) log.cc:844] Serialized 71 byte log entry
0709 13:09:12.749494 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:12.749615 (+   121us) write_op.cc:454] Released schema lock
0709 13:09:12.749673 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:12.787980 (+ 38307us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:12.788788 (+   808us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4915,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":139450,"apply.run_cpu_time_us":3209,"apply.run_wall_time_us":58573,"num_ops":9,"prepare.queue_time_us":187640,"prepare.run_cpu_time_us":24993,"prepare.run_wall_time_us":195372,"raft.queue_time_us":167959,"raft.run_cpu_time_us":16632,"raft.run_wall_time_us":131507,"replication_time_us":418799,"thread_start_us":299416,"threads_started":4,"wal-append.queue_time_us":76877,"wal-append.run_cpu_time_us":18562,"wal-append.run_wall_time_us":1571118}]]}
I20260709 13:09:15.869304 29009 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:15.911309 27414 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:15.869736 28888 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:09:15.902622 27416 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:15.891255 29151 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 2. Current term is 3.
I20260709 13:09:15.869879 29096 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.920240 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.916595 29027 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.905920 29181 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.886952 29081 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.863370 27408 rpcz_store.cc:276] 0709 13:09:14.733671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.733824 (+   153us) service_pool.cc:224] Handling call
0709 13:09:15.823469 (+1089645us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54003a4154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:15.823585 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502049664}
W20260709 13:09:15.891566 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 87074.7us
I20260709 13:09:15.879531 28937 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.875751 28940 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.932780 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.933457 27414 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:15.910609 29180 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:15.941344 28972 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.943427 29180 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:15.945207 28972 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.945688 29180 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:15.947328 28937 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:15.949260 28940 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.934855 27415 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
W20260709 13:09:15.945264 29173 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.561s	user 0.002s	sys 0.003s
I20260709 13:09:15.945814 27266 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7.
I20260709 13:09:15.915877 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:15.922366 28010 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:15.942878 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.917055 28961 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:09:15.953147 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:15.921561 29099 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:09:15.953657 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78504.2us
I20260709 13:09:15.963761 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:15.981328 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:15.981644 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:15.981384 27335 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 1.
I20260709 13:09:15.984725 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:15.986260 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:15.987498 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.988379 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:15.987605 27414 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:15.989823 27415 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:15.983883 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 124641us
I20260709 13:09:15.992340 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.990782 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:15.954716 28689 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.996464 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.997198 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:15.954053 29109 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:15.987340 28940 raft_consensus.cc:2764] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:15.983518 28888 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:15.990756 28937 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:16.006340 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.006739 27415 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:15.995036 28806 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:16.008036 27417 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:15.956002 27410 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:15.996034 29027 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.015602 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.010689 29109 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.005795 28953 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.010689 28806 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:16.011689 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.022390 27981 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:15.987205 29009 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:15.994633 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.025511 27414 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:16.023399 28806 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.015738 28937 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.027259 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.006392 28689 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.027801 29103 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:15.863791 27409 rpcz_store.cc:276] 0709 13:09:14.534689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.537607 (+  2918us) service_pool.cc:224] Handling call
0709 13:09:15.164586 (+626979us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:15.164815 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.165050 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:15.177861 (+ 12811us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.822022 (+644161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.822097 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:15.822158 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.822250 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.822390 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171258,"prepare.queue_time_us":8570,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":172214,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":7290752,"thread_start_us":423965,"threads_started":1,"wal-append.queue_time_us":465795}
I20260709 13:09:16.044240 29081 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.021063 29109 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.048224 29012 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.026345 29181 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:16.051518 28953 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.052088 28953 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.052544 28953 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.070163 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:16.050895 29012 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:16.067984 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 148411us
I20260709 13:09:16.046988 29109 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:16.023039 29027 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.081372 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.089278 29027 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:16.087596 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 65621.1us
I20260709 13:09:16.090553 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.092284 29159 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.092352 29198 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.092834 29159 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:16.091924 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.094036 28689 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.093847 29159 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.042977 29066 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.094604 29181 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.094863 29159 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.099087 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.100907 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.102471 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.103958 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.105693 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.108117 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:16.108707 27335 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.096251 29066 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.112679 27408 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:16.114207 29172 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.728s	user 0.009s	sys 0.007s
I20260709 13:09:16.116986 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 128) took 2047 ms. Trace:
I20260709 13:09:16.118218 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.097548 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.097198 28937 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.098418 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.119517 28006 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:16.121309 28806 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.117362 27412 rpcz_store.cc:276] 0709 13:09:14.069465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.070658 (+  1193us) service_pool.cc:224] Handling call
0709 13:09:15.695708 (+1625050us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:15.695903 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:15.696091 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:15.796747 (+100656us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.116398 (+319651us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180016e820. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a
0709 13:09:16.116677 (+   279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:16.116725 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.116765 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:16.116829 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:16.116933 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":171067,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":152189440,"thread_start_us":189942,"threads_started":2,"wal-append.queue_time_us":173012}
I20260709 13:09:16.124133 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:16.124701 27340 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.124791 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.126454 27335 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:16.126570 28010 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:16.127539 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:16.128361 28996 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:16.128860 28996 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:16.129712 28996 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.134215 27260 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:09:16.130848 27340 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
I20260709 13:09:16.135846 27260 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:16.137115 28842 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.138094 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:16.139281 29052 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:16.139657 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.139813 29052 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:16.140810 29052 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.142110 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.142889 27265 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:16.143700 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.144492 27262 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.097330 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.146829 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.147692 28806 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 2 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.148373 29084 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.151542 29084 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.151912 29084 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.153491 29096 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.149165 29004 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.155473 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:16.156083 28012 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:09:16.166401 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.167649 29024 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.168635 28943 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:16.168615 29161 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.169229 28943 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.170282 28943 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.174917 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.167662 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:16.148320 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 67047.6us
I20260709 13:09:16.179593 29096 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.179714 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.180269 29096 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.179769 28689 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:16.183784 27262 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.138688 28953 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.185954 28009 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:09:16.191535 27411 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:09:16.196780 28953 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.198495 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.200519 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:16.201047 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.201903 29187 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.232s	user 0.000s	sys 0.003s
I20260709 13:09:16.202751 29161 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:16.203258 29186 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.234s	user 0.000s	sys 0.003s
I20260709 13:09:16.203336 29161 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:16.204291 29161 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.207768 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.208454 27263 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:16.210851 29185 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:16.211304 29185 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:16.212141 29185 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.213335 29185 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:16.215075 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1680) took 2915 ms (client timeout 1970 ms). Trace:
W20260709 13:09:16.215492 27343 rpcz_store.cc:269] 0709 13:09:13.300085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.300234 (+   149us) service_pool.cc:224] Handling call
0709 13:09:16.214754 (+2914520us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400229554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:16.214945 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670606080}
I20260709 13:09:16.219866 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.225929 29096 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.226465 29096 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.226907 29096 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.227320 28943 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.228896 27260 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.228986 29096 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.229496 28012 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:16.230196 28010 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.222890 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.234176 28014 raft_consensus.cc:2368] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
I20260709 13:09:16.236944 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.237582 27268 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:09:16.238786 27233 connection.cc:256] RPC call timeout handler was delayed by -1.2261586159999069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:09:16.239180 29011 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:16.239713 29011 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.240316 27260 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:16.240650 27260 pending_rounds.cc:85] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 2
I20260709 13:09:16.240861 27260 pending_rounds.cc:107] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:16.241091 27260 raft_consensus.cc:2889] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.242776 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.243289 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.243881 27264 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:16.244204 27413 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:16.245398 27413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 943) took 2896 ms (client timeout 2108 ms). Trace:
I20260709 13:09:16.245910 27266 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:16.246006 29023 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:16.245764 27413 rpcz_store.cc:269] 0709 13:09:13.349236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:13.570918 (+221682us) service_pool.cc:224] Handling call
0709 13:09:16.245137 (+2674219us) spinlock_profiling.cc:243] Waited 2.67 s on lock 0x7b540013c4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:16.245281 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6141405568}
I20260709 13:09:16.246579 29023 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.247505 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.247960 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.248310 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.242637 29011 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.249902 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.250545 29023 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.250834 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.251741 27267 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:16.252871 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.253278 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.253664 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.226913 29084 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.254135 27409 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:16.254254 27266 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:16.231076 29024 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.255205 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.255568 29084 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.255762 27264 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 1.
I20260709 13:09:16.259496 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.261072 29132 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.261720 29132 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.264204 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.264356 29132 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.264991 27410 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:16.266496 28970 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.266706 29084 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.267066 28970 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.267694 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.268054 27335 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:16.268992 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.269207 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.269555 28970 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.269810 27341 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:16.270694 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.270751 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.271430 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.272086 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.270910 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.272909 27410 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:16.273059 29084 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.273449 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:16.277416 27268 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:16.273866 28718 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:16.293896 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.299032 28937 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.298775 28718 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.299589 28937 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.299995 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.300954 28718 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.272198 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.301594 28937 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:16.274531 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.302114 28937 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:16.302819 29011 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.303617 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.305050 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.306358 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.256611 29024 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:16.275579 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.310429 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.277591 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.277989 28970 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:16.278544 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:16.271713 28014 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:16.279572 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.344457 27410 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.347252 28007 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.348789 27334 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:16.349854 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.280874 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.351500 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.281044 29084 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.282359 29023 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.283486 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.284440 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.352394 27336 raft_consensus.cc:2410] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:16.338275 28842 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.353150 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.353379 29023 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.285326 28010 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.354370 27337 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:16.287513 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.355580 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.288597 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.289422 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.356161 27337 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:16.356681 27408 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:16.357306 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.290970 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.292011 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.358186 27338 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:16.358539 27343 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:16.359946 27343 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:16.360272 29067 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.292469 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.362125 27341 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 1.
I20260709 13:09:16.293576 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.297467 29016 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:16.310640 29151 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.307926 27233 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.353232 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.371021 27341 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:16.310734 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.241099 27161 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:16.317837 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.289888 27262 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:16.372256 27264 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:16.351999 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.373073 27339 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:16.351591 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.351999 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.374151 27417 raft_consensus.cc:2368] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:16.372932 27161 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:16.318269 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.333642 27261 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:16.337751 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.339423 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.351665 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:16.377465 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 98998.1us
I20260709 13:09:16.179888 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:16.380205 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 200384us
I20260709 13:09:16.381448 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.375650 27161 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 4 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.384524 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.386613 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.387434 27414 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:16.389110 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.390873 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.391870 27412 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 2: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:16.392478 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.272935 27409 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:16.393851 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.351049 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.415222 27334 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:16.383765 27161 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 2 to 3, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 3 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:16.383061 29084 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:16.417148 27161 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:16.418251 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.396493 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:16.419765 27335 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:16.400245 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:16.400511 28013 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:16.413552 28842 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.400718 29110 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:16.401369 29004 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:16.402711 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.383242 28970 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:16.425433 29110 consensus_queue.cc:1243] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:16.426031 29110 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:16.426397 29110 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.427626 27161 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.404021 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:16.405540 29024 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.407655 27337 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.388302 28972 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:16.408695 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 100845us
I20260709 13:09:16.432880 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.310808 29040 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.408901 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.429347 27161 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.435600 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.437471 27413 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:16.437721 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.447489 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.444221 27161 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.450258 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:16.451279 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 57513.7us
W20260709 13:09:16.427546 29208 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:09:16.450620 27161 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:16.452713 27268 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.448820 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.474850 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.459043 27306 leader_election.cc:400] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
I20260709 13:09:16.426247 28970 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.468933 27261 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:16.436980 29105 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.472751 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.475486 27306 leader_election.cc:403] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.431501 29084 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:16.431730 29024 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.471722 27161 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 2, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:16.446913 29197 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.437112 28972 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.483108 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.493633 27261 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:16.468133 28836 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.452847 29132 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.452359 29100 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.452683 29106 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:16.457825 28902 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.455242 29006 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.468097 28012 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 2 LEARNER]: Advancing to term 3
I20260709 13:09:16.520195 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.536847 27261 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:16.505435 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:16.504380 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 50582.6us
I20260709 13:09:16.452932 29151 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:09:16.494765 28972 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.538947 29151 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:16.539377 29151 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:16.540169 29151 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:16.541051 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.541357 29151 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.542194 28961 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.543431 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.544674 29193 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.545643 29096 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:16.545746 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:16.546255 29096 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.546662 29193 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.547063 29193 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.547622 29193 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.547277 29096 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.532234 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.534696 27981 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7.
I20260709 13:09:16.548940 27981 leader_election.cc:403] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.549010 27264 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:16.549335 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.526646 29132 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:16.467911 28742 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:09:16.458319 29016 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:16.458141 28842 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:09:16.547089 28014 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:16.482205 29040 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.550961 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:16.555505 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.485334 29159 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.542454 29024 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:16.587606 29209 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:09:16.587838 29024 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:16.589089 29201 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:09:16.592466 29016 consensus_queue.cc:1243] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:16.593178 29103 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:16.593582 29103 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.594172 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.562412 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:16.563588 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.564356 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.565294 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.565908 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:16.568917 28972 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.664088 27265 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.494727 28863 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.558324 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.524142 28999 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:09:16.578456 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106421us
I20260709 13:09:16.491325 29197 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.524482 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.559605 27410 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:16.548722 29096 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.594545 29103 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.599973 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:16.671238 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 71394.4us
I20260709 13:09:16.610402 29159 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.678424 29159 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.680862 29159 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.621097 29084 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.536651 29006 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.535323 29110 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.557727 28836 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:09:16.573020 29009 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:09:16.489907 29105 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.698933 29105 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.700330 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:16.557914 29180 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7.
I20260709 13:09:16.702236 29180 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:16.702847 29180 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:16.703469 29197 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.703890 29180 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.704763 29197 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.636438 28961 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.707655 29103 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.572803 29027 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.586539 29040 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:16.709745 29040 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.684574 29006 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:16.595276 28888 consensus_queue.cc:1175] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "203d83f7fac847e0beee51aa18513b25" responder_term: 3 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:09:16.662209 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111321us
I20260709 13:09:16.718375 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:16.662343 27267 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:16.661885 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 187080us
I20260709 13:09:16.663805 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.719674 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:16.719955 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56250us
I20260709 13:09:16.684312 28978 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.720760 29159 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:16.721172 29159 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.720887 28978 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.721309 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.721601 29159 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.722383 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:16.667965 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 109740us
I20260709 13:09:16.723464 28953 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.685250 29123 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.724128 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:16.724639 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.725476 28742 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.725638 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:16.726151 28742 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.726760 28742 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.667987 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.674437 27335 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:16.727854 29004 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.667312 28863 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.728484 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.686972 27262 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.669337 29024 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:16.728786 28863 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.668944 27259 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:16.558692 29132 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.662959 29137 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:16.728608 29004 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:16.488842 29023 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:16.719707 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.732897 27233 leader_election.cc:400] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:16.746199 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.746685 27233 leader_election.cc:403] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.747799 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:16.748756 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.735688 28014 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:16.751669 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83738us
I20260709 13:09:16.750619 28742 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.753763 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:16.754384 28742 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.754805 28742 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.756089 29110 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.758704 28961 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.762826 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:16.752920 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.764209 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.764907 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.767114 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:16.765170 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.769443 28842 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.723066 28978 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.770445 27412 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.770524 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.776216 27417 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:16.771639 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.760828 29052 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:16.782409 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.749738 29004 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.762935 28836 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.803392 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.790303 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.761060 28940 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.760669 28888 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.760957 29161 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:16.772066 29076 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.782622 28718 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:16.774742 28842 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.880875 28842 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.772259 28902 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:09:16.891952 28902 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:16.892335 28902 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:16.751058 29184 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:09:16.829211 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 57647.4us
I20260709 13:09:16.750957 28689 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:09:16.842133 27265 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:16.894318 29184 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:16.844935 28836 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.894672 29184 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:16.895002 28836 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.847366 29151 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:16.850850 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.835031 28012 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:16.773136 28943 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.856106 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.779222 29137 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:16.903640 28972 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:16.903961 29137 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.904536 29137 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.750928 29009 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:09:16.908771 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:16.911132 27409 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:09:16.917248 29193 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.773016 29027 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:16.855031 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.856899 28888 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.918735 27337 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:16.918864 28888 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.864161 29076 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:16.866436 28014 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:16.848717 28937 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:16.876961 29040 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.893106 28902 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.898097 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.898772 28943 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.899041 28742 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.775040 29091 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:16.900385 29184 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.901465 29132 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:16.902200 28842 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:16.903101 29151 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.927778 27981 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:16.932272 27416 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:16.828508 29004 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.933945 27412 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:16.931402 29076 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:16.895234 28999 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4.
I20260709 13:09:16.944512 27337 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:16.899801 29023 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:16.943331 28943 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:16.934172 27383 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:16.964112 29027 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.948807 28902 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.942564 29103 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:16.939615 29081 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:09:16.982914 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.983017 27262 pending_rounds.cc:85] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 1
I20260709 13:09:16.986009 27262 pending_rounds.cc:107] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:16.986297 27262 raft_consensus.cc:2889] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.986915 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:16.981928 27267 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:16.950199 28937 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:17.008407 27260 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:17.009505 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.010670 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.939885 29011 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:09:16.970479 29091 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:16.976372 29065 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:17.039758 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:17.041298 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.978750 29027 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:17.050355 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.980019 29103 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:16.966028 29151 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.053004 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:16.984504 28940 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:17.067822 27412 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:17.079089 27267 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:09:17.078572 29161 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.082610 29184 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.082348 29161 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.082191 28937 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.083062 29185 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:09:17.087206 29161 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.089710 29151 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.090349 28888 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.052493 29006 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.090696 27410 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:17.109262 27265 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:17.109628 27265 pending_rounds.cc:85] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 2
I20260709 13:09:17.109826 27265 pending_rounds.cc:107] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:17.110059 29006 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.095422 27259 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:09:17.095615 29193 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.096750 28742 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.098220 28842 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.100145 28961 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:17.079512 28940 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.104176 29040 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:16.983865 29159 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.066648 29103 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:17.080564 29065 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:17.083290 29132 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.094062 29197 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:17.110085 27265 raft_consensus.cc:2889] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.112730 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.106210 28863 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:17.035449 29009 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:09:17.039218 28836 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.109297 28888 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:17.234993 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 310506us
I20260709 13:09:17.166498 28940 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.255635 28888 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:17.277032 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 294938us
I20260709 13:09:17.082283 29091 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:17.171041 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 390019us
I20260709 13:09:17.275580 28842 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.287355 29105 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.252167 29052 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:09:17.307196 29105 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.307919 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:17.308490 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:17.318336 29076 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.317093 29067 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:17.287076 29040 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.279528 28742 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.336410 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:17.288461 29137 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.306424 28842 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.349315 28836 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.334254 29067 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:17.322918 28943 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.336308 29040 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.305341 29065 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.372634 29105 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:17.412211 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 127284us
W20260709 13:09:17.415829 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 137555us
I20260709 13:09:17.415840 27335 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:17.418105 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.421511 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.424093 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.346139 28742 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.351671 29004 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.428699 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:17.444125 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.469327 29009 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.490612 27262 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:17.439491 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.491114 27409 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.452615 28863 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.450148 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.426918 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.441560 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.480290 27417 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:17.527705 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 1.
I20260709 13:09:17.483574 28937 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.541525 29103 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:17.543385 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.543952 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.543551 27408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:17.544656 28943 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:17.538559 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.541356 28937 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.540285 29023 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:17.564458 29137 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.567600 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.568750 27261 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:17.572710 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.577569 29076 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.560560 29009 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.586448 29009 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:17.558800 29023 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:17.604835 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 118561us
I20260709 13:09:17.611135 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.613304 28937 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:17.613777 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:17.615622 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.616772 27335 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.616813 29132 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:17.617642 29132 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:17.639300 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:17.652578 27340 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.652719 27410 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:17.653462 27410 pending_rounds.cc:85] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 4
I20260709 13:09:17.653890 27410 pending_rounds.cc:107] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:17.654304 27410 raft_consensus.cc:2889] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:17.655987 29016 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.656927 29016 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.617018 29023 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.658974 28836 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:17.659591 29023 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.660368 29184 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:17.689097 28012 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:17.689649 27339 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.690011 27336 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.690122 29103 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:17.691227 29142 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:17.659603 28836 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.644801 28689 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.694621 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.728149 29040 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.730154 27335 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:09:17.669808 29222 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.247s	user 0.000s	sys 0.003s
I20260709 13:09:17.718539 28836 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.725510 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.740490 28940 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.744135 28940 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:17.746423 28902 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.761s	user 0.014s	sys 0.001s
I20260709 13:09:17.748703 27339 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:17.721539 27408 raft_consensus.cc:606] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:17.753598 27336 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:17.646392 29132 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.757067 28742 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.757628 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.757416 28689 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.758256 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.759805 29023 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:17.770390 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.771762 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.761051 27408 raft_consensus.cc:614] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:17.777510 27261 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:17.778129 27260 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:17.783367 27340 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:17.783512 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.789520 27335 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:17.794093 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48521.4us
I20260709 13:09:17.803077 27262 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:17.808693 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.807297 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.818849 27335 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:17.831902 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1003) took 1027 ms. Trace:
I20260709 13:09:17.832419 27413 rpcz_store.cc:276] 0709 13:09:16.764267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.764388 (+   121us) service_pool.cc:224] Handling call
0709 13:09:16.780168 (+ 15780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.780498 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.780526 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.780944 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:09:17.233255 (+452311us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:17.233314 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.233410 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.573449 (+340039us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:17.761338 (+187889us) raft_consensus.cc:1685] finished
0709 13:09:17.761368 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.791943 (+ 30575us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7124,"raft.queue_time_us":857,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":52529,"spinlock_wait_cycles":12915072,"thread_start_us":398743,"threads_started":1,"wal-append.queue_time_us":457115}
I20260709 13:09:17.835467 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.839068 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:17.840662 29253 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:09:17.840879 27414 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:17.842796 29248 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:09:17.845005 29254 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.206s	user 0.000s	sys 0.002s
I20260709 13:09:17.845726 27340 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:17.834818 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.846745 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.853479 27336 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:17.826200 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:17.860296 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.861142 27339 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:17.862723 27339 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:17.866765 27414 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:17.867858 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.864213 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.887688 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.887691 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:17.861140 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:17.899686 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:17.896198 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 162824us
I20260709 13:09:17.900799 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.896809 28902 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:17.906663 27335 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
W20260709 13:09:17.909508 29255 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:17.899814 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.897079 27341 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.891896 29023 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.928642 27413 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.929360 27335 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:17.931656 29027 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.009s
I20260709 13:09:17.931473 29185 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.932274 29027 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:17.932713 29091 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.933651 28937 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.933467 29091 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.934580 28937 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:17.958822 29250 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:09:17.958988 29142 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:17.960014 29142 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.961455 27337 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:17.961728 27343 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.969815 27341 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:17.959017 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.928663 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:17.962688 29142 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:17.982292 27334 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:17.973133 29023 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.983667 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.985296 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.985590 29112 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:17.985767 29023 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.986171 29112 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:17.969242 29011 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:17.987408 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.982326 29052 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:17.988391 29052 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:17.988854 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1020) took 1140 ms. Trace:
I20260709 13:09:17.989336 27417 rpcz_store.cc:276] 0709 13:09:16.848624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.854718 (+  6094us) service_pool.cc:224] Handling call
0709 13:09:17.988582 (+1133864us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400087d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:17.988756 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290003712}
I20260709 13:09:17.989395 29052 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.990869 29052 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.987351 29112 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:17.991534 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:17.992929 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.993633 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:17.987668 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:17.994745 29004 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:17.995944 27267 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:17.996120 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:17.998267 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:17.998543 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.986279 27341 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:09:18.022608 27341 pending_rounds.cc:85] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 1
I20260709 13:09:18.023039 27267 pending_rounds.cc:85] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 2
I20260709 13:09:18.028609 27341 pending_rounds.cc:107] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:09:18.029138 27341 raft_consensus.cc:2889] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.029168 27267 pending_rounds.cc:107] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:18.188093 27267 raft_consensus.cc:2889] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.185312 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:18.035449 28937 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.059262 29023 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:09:18.138142 27340 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:18.059381 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:18.123070 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50171us
I20260709 13:09:18.192492 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:18.193183 27343 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:18.192595 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 55137.9us
I20260709 13:09:18.194401 27339 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:18.195969 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.197661 27409 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:18.201953 29006 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:18.182184 29004 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.204460 29006 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:18.204793 29004 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.206352 29006 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.065282 29091 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.040633 29067 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.207836 29004 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.208596 29006 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:18.213245 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:18.213353 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.214684 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.215195 27266 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:18.215627 27261 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:18.214701 27264 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:18.216858 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.217713 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.217886 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.216907 28940 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.218638 27267 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:18.218971 28940 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.220289 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:18.220906 27263 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.221220 28940 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.222335 29103 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:18.222750 29103 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:18.223155 28937 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:18.224228 28937 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:18.223762 29103 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.223309 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:18.065342 29016 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.224604 28937 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:18.092558 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:18.242794 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.022348 28836 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.246527 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:18.253798 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.254273 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.246222 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.256521 29216 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:18.257239 29216 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.258728 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.258567 29091 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.261906 27336 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:18.261137 29103 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.255430 29016 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.273757 29023 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:18.284835 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61744.1us
I20260709 13:09:18.281512 28940 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:18.287072 28940 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.288550 29180 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.289076 29159 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.289683 28940 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.292344 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:18.293259 29159 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:18.295513 29216 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.298033 27263 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:18.278800 28953 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:09:18.284039 28937 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.307356 27417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:18.308248 27417 raft_consensus.cc:606] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:18.308446 28937 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.308669 27417 raft_consensus.cc:614] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.310233 27417 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:09:18.310562 27417 pending_rounds.cc:85] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 4
I20260709 13:09:18.310796 27417 pending_rounds.cc:107] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:09:18.312031 28836 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.284818 29016 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:18.313052 29016 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.316377 29067 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.314649 29006 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.325057 28842 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.327891 29016 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.330765 28940 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:18.345220 28940 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.332937 27417 raft_consensus.cc:2889] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.341215 29112 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:18.352356 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.354632 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:18.360015 27417 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:18.392866 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 58392.5us
I20260709 13:09:18.393971 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.388057 29016 raft_consensus.cc:2764] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:09:18.403517 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 126843us
W20260709 13:09:18.406450 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.408098 29283 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:18.387830 29103 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:18.400585 28842 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:18.427204 29119 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:18.427874 29119 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.430365 29103 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.432896 29103 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:18.413322 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0597591989999273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:09:18.414187 29006 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.441835 28940 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.443250 29027 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.444293 29280 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:18.445405 28689 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.445793 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.446576 28842 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:18.446946 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53124.5us
W20260709 13:09:18.449131 27415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1016) took 1667 ms (client timeout 1686 ms). Trace:
W20260709 13:09:18.474931 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 182694us
W20260709 13:09:18.479657 27415 rpcz_store.cc:269] 0709 13:09:16.782006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.782130 (+   124us) service_pool.cc:224] Handling call
0709 13:09:18.448775 (+1666645us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b54000adf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:18.448964 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851823360}
I20260709 13:09:18.411309 29283 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:18.478295 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69935.4us
I20260709 13:09:18.475399 28836 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.485726 29216 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:18.502416 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56819.4us
W20260709 13:09:18.506058 29252 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.709s	user 0.002s	sys 0.002s
W20260709 13:09:18.506700 28012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 286) took 1601 ms (client timeout 1632 ms). Trace:
I20260709 13:09:18.507417 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:18.507863 29276 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:18.511559 29283 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.524659 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.528911 29283 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.532941 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:18.540695 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 55367us
I20260709 13:09:18.542387 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:18.549579 29052 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:18.555644 29052 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.554309 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.554952 29216 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:18.563436 29216 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:18.557102 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.507128 28012 rpcz_store.cc:269] 0709 13:09:16.905587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.908413 (+  2826us) service_pool.cc:224] Handling call
0709 13:09:18.485204 (+1576791us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540045db54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:18.506618 (+ 21414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934459648}
I20260709 13:09:18.563482 29284 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.504518 28836 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.534346 28943 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.583760 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 109840us
W20260709 13:09:18.587227 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44973.4us
I20260709 13:09:18.585765 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.563987 29216 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:18.597498 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.598781 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:18.561161 28842 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:18.611778 28842 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:18.612203 28842 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:18.612574 28842 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.606266 29119 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.607622 28999 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:18.615000 27414 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:18.602898 28009 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:18.615756 28999 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:18.616091 28999 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:18.617014 28999 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.618640 28999 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.620188 29052 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.620775 27410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:18.621397 27410 raft_consensus.cc:606] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:18.621749 27410 raft_consensus.cc:614] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.621835 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.626478 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.628038 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.628401 27411 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:09:18.629094 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1534) took 1381 ms. Trace:
I20260709 13:09:18.629379 27411 rpcz_store.cc:276] 0709 13:09:17.247949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.993135 (+745186us) service_pool.cc:224] Handling call
0709 13:09:18.627879 (+634744us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:18.628092 (+   213us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:18.628835 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.629041 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100559616}
I20260709 13:09:18.625372 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:18.631336 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.635751 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.599324 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.596067 29284 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:18.641049 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:18.625656 29103 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:18.647075 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50875.2us
I20260709 13:09:18.647946 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.648715 27335 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:18.648387 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.636587 28007 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:18.647769 29103 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:18.650470 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52372.2us
I20260709 13:09:18.651552 28689 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:18.652501 28689 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.653052 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 158) took 1546 ms. Trace:
I20260709 13:09:18.653024 28689 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.653805 29284 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.595630 28943 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.656586 29103 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:18.680717 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.653543 27416 rpcz_store.cc:276] 0709 13:09:17.106570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.534921 (+428351us) service_pool.cc:224] Handling call
0709 13:09:18.336326 (+801405us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:18.342660 (+  6334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:18.382937 (+ 40277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:18.382979 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:18.391973 (+  8994us) log.cc:844] Serialized 26 byte log entry
0709 13:09:18.537883 (+145910us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:18.537937 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.538035 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:18.652727 (+114692us) raft_consensus.cc:1685] finished
0709 13:09:18.652748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:18.652967 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39736,"raft.queue_time_us":55077,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":22753,"spinlock_wait_cycles":30603648,"thread_start_us":115451,"threads_started":1,"wal-append.queue_time_us":236227}
I20260709 13:09:18.685797 28836 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:18.687343 29256 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.890s	user 0.000s	sys 0.002s
I20260709 13:09:18.687916 28689 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.666947 29280 raft_consensus.cc:2764] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:09:18.716650 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1705) took 1159 ms. Trace:
I20260709 13:09:18.705678 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.722548 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.717096 27337 rpcz_store.cc:276] 0709 13:09:17.546373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.546566 (+   193us) service_pool.cc:224] Handling call
0709 13:09:17.961157 (+414591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:17.961972 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:18.705897 (+743925us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54003304d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:18.706091 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941560576}
W20260709 13:09:18.723479 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82759.3us
I20260709 13:09:18.700924 29106 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.729103 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.729559 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.689589 29159 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:18.726029 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46628.8us
W20260709 13:09:18.731750 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56747us
I20260709 13:09:18.736404 27415 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:18.730806 29023 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:18.746366 29295 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:18.747100 29295 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.747886 29023 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.749368 29295 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.731812 29280 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.771507 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.735668 29292 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.778512 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.785068 27412 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:18.794602 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52284.7us
I20260709 13:09:18.792869 27383 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.798085 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.798873 27265 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:09:18.802795 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.785399 28836 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:18.794482 29067 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.818315 27383 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.821808 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:18.823663 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80798.7us
W20260709 13:09:18.832716 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.764160 29159 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.831652 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:18.814438 28937 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:18.838480 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.836777 28970 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.843943 29302 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:18.844189 28970 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.846357 28014 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:18.847400 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:18.837051 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:18.848438 27260 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.794324 29280 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:18.841179 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 255548us
I20260709 13:09:18.819923 29298 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:18.852123 27259 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:18.884038 29298 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.884801 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.886106 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.852280 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:18.853127 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.887943 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.888621 27268 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:18.888907 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.854296 27417 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:09:18.889585 27259 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:18.890100 29106 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:18.840325 28888 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:18.833350 29292 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.891459 28888 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.891894 28888 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:18.893337 29292 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.854754 29027 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:18.814278 28940 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:09:18.843964 28943 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:18.855362 27264 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:18.855719 29067 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.889600 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:18.895152 27161 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 209) took 8133 ms. Trace:
I20260709 13:09:18.862596 28842 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.900844 29067 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.901466 29067 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:18.902148 29067 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.903685 28010 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:09:18.856626 29291 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 13:09:18.856446 29119 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.856985 29280 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.848371 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.857257 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.846683 28937 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.857610 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.861574 27411 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:09:18.845463 29159 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.864013 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.911353 27262 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:18.865617 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.868033 28970 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.868685 29283 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.914562 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.870617 29216 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.870903 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.872205 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:18.872845 28689 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:18.875213 29112 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:18.895916 29027 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:18.824375 29295 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:09:18.881845 27413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:18.935791 27413 raft_consensus.cc:606] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:18.936182 27413 raft_consensus.cc:614] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:18.911270 27411 pending_rounds.cc:85] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 4
I20260709 13:09:18.936982 27412 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:18.936902 27411 pending_rounds.cc:107] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:09:18.937672 27411 raft_consensus.cc:2889] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.938012 27411 pending_rounds.cc:107] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:09:18.938342 27411 raft_consensus.cc:2889] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:18.897455 29298 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:18.877599 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 102787us
I20260709 13:09:18.940119 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.940203 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:18.914165 28937 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.946799 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.948046 29065 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.948200 29067 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.948621 29065 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:18.949919 29067 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:18.896232 27163 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.951486 28689 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:18.918311 29006 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:18.932186 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.882524 27260 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:18.936869 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.916352 27266 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:18.897791 29294 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:18.922024 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45346.7us
I20260709 13:09:18.900382 27161 rpcz_store.cc:276] 0709 13:09:10.761856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.763355 (+  1499us) service_pool.cc:224] Handling call
0709 13:09:10.984944 (+221589us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54002b0110. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0d0b2 00007fbd88a86a89 00007fbd88a1eda6 00007fbd889f0088 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc
0709 13:09:18.894959 (+7910015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:17.283179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:17.307564 (+ 24385us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:17.307603 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:09:17.307622 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:17.566085 (+258463us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.566188 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.566265 (+    77us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:09:17.581994 (+ 15729us) tablet.cc:701] Row locks acquired
0709 13:09:17.582055 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:09:17.582411 (+   356us) write_op.cc:270] Start()
0709 13:09:17.582662 (+   251us) write_op.cc:276] Timestamp: P: 1783602557582314 usec, L: 0
0709 13:09:17.582727 (+    65us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.588236 (+  5509us) log.cc:844] Serialized 4030 byte log entry
0709 13:09:17.968902 (+380666us) op_driver.cc:464] REPLICATION: finished
0709 13:09:18.273737 (+304835us) write_op.cc:301] APPLY: starting
0709 13:09:18.275791 (+  2054us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:18.276145 (+   354us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:18.280143 (+  3998us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:18.287264 (+  7121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:18.287631 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:09:18.287688 (+    57us) write_op.cc:312] APPLY: finished
0709 13:09:18.288066 (+   378us) log.cc:844] Serialized 77 byte log entry
0709 13:09:18.301828 (+ 13762us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.323083 (+ 21255us) write_op.cc:454] Released schema lock
0709 13:09:18.323174 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:18.323647 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:18.323679 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6088,"reported_tablets":22,"spinlock_wait_cycles":70663936,"child_traces":[["op",{"apply.queue_time_us":292272,"apply.run_cpu_time_us":4315,"apply.run_wall_time_us":49910,"num_ops":10,"prepare.queue_time_us":674737,"prepare.run_cpu_time_us":17974,"prepare.run_wall_time_us":377204,"raft.queue_time_us":116181,"raft.run_cpu_time_us":31936,"raft.run_wall_time_us":283125,"replication_time_us":380073,"thread_start_us":814793,"threads_started":4,"wal-append.queue_time_us":49672}]]}
I20260709 13:09:18.917706 28999 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:18.961536 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.942312 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:18.984993 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.985780 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:18.950966 29065 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:18.993021 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.964774 29006 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.994184 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:18.994776 27267 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:19.001370 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61342.1us
I20260709 13:09:19.001821 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:18.962746 28842 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:18.996174 27416 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:18.982076 29283 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.007239 28943 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.013827 28943 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.014278 28943 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.016350 29076 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.020347 29216 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.003976 29293 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.021211 29293 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.021777 29293 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:18.952548 29027 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.008996 28970 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:19.009739 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.025053 28943 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.003679 29006 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.022986 27265 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.027848 27265 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:19.028669 27265 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.029887 27265 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.011593 28940 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:18.982030 29294 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:18.984233 29103 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.033757 27414 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.007373 29296 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:19.010150 27163 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 2 to 1, leader changed from <none> to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:19.012250 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:19.031569 28940 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.036844 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.036943 29296 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.036110 28940 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.038153 27163 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 5 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.040179 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.040277 29091 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.040791 27380 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.039949 27163 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 3 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.041100 29084 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.041180 29091 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:19.042227 29301 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:19.042443 29091 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:19.042572 29301 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.042845 29084 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.043457 29296 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:19.043670 29301 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:19.047966 29301 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.047678 29296 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.048877 29296 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.048906 29006 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.045874 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.051474 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.052803 28961 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.052035 29084 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.021147 28937 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.042990 29091 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:19.043823 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 128261us
I20260709 13:09:19.055464 28961 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:19.056037 29091 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.057371 29091 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.058091 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.058172 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.062549 29084 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:09:19.065801 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.060452 29294 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.060458 27265 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:09:19.065783 29119 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.066921 27265 pending_rounds.cc:85] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 1
I20260709 13:09:19.066944 29119 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:19.067333 27265 pending_rounds.cc:107] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:09:19.067726 27265 raft_consensus.cc:2889] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.067960 29119 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.069023 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:19.069540 29119 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.069782 29006 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.069698 28888 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.075126 29084 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.076294 29004 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.076918 29284 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:19.077605 29004 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:19.079313 29302 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:19.080159 29293 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.081086 27265 pending_rounds.cc:107] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:19.083035 27265 raft_consensus.cc:2889] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:19.085843 29298 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:09:19.083264 28943 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:19.083632 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.088431 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.090070 29119 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:19.060106 28961 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.090735 29106 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:19.091030 27334 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:19.092051 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.092649 27337 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.092888 29119 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:19.093865 29119 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.012933 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:19.095574 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82722.6us
I20260709 13:09:19.097086 28943 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.097618 28943 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.097199 29283 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:19.098536 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:19.099383 29284 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:19.099772 29284 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.100318 29298 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:19.100052 28943 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.100875 29298 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.103984 29298 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:19.106598 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 192500us
I20260709 13:09:18.989396 28999 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:19.107899 28999 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.108932 28999 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.100871 29284 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.110152 29284 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.110457 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.111213 29067 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.118119 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.118894 27263 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.120998 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.138547 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:19.144652 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.159226 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 101118us
I20260709 13:09:19.134835 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.162215 27267 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:19.162506 27337 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:19.169508 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.173642 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.174471 27338 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:19.163482 29293 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.113972 29294 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.182696 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.187829 27266 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.187902 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.218690 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:19.161955 29216 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:19.214926 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 137645us
I20260709 13:09:19.175510 29103 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:19.228428 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.184110 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.172497 28970 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:09:19.240135 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:19.247426 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.247198 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.218405 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:19.246258 27263 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:19.189838 29112 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 13:09:19.252934 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 318536us
I20260709 13:09:19.254608 28970 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.237344 29084 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.289534 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:19.294055 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.289734 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:19.255048 29293 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:19.301139 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.303910 27337 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:19.304154 27263 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:19.226116 29076 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:19.306541 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.307134 27336 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.249168 27334 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:19.306880 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:19.315006 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:19.321851 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 77083.8us
I20260709 13:09:19.315799 27337 raft_consensus.cc:2376] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6. Re-sending same reply.
I20260709 13:09:19.249428 29216 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.313136 27409 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:19.329756 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 109728us
W20260709 13:09:19.329885 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 259532us
I20260709 13:09:19.300014 29295 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.333653 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.303548 29293 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:19.329550 29067 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:19.336733 27337 raft_consensus.cc:2376] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3. Re-sending same reply.
I20260709 13:09:19.338670 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:19.337284 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 117549us
I20260709 13:09:19.340046 29292 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:19.340478 29292 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:19.340673 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.340965 29292 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.341337 28014 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:19.343230 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.346050 27267 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.344012 29067 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.348330 29067 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:19.348906 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:19.348348 29216 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.352692 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.355435 27413 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:19.357626 29067 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.359817 29293 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.361095 29293 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.326035 28836 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.375753 27336 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:19.364910 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.312253 28940 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.333745 29320 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:19.383062 27342 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:19.396556 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.394809 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.401540 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.392485 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:19.403113 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.404383 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.404654 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.404858 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.405627 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.406122 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.401657 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.409358 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:19.410239 29280 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.418044 28943 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.418991 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.420416 28940 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:19.421263 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.421684 27266 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:19.422219 28012 raft_consensus.cc:2410] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:19.405678 27340 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.428393 27259 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:09:19.405565 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.359827 29067 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:19.435650 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.431511 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:19.434777 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 125331us
I20260709 13:09:19.442051 27308 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.378325 29216 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.464979 29216 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.454689 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.467622 27261 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:19.470408 27413 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.471359 28836 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.473965 27416 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:19.476305 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:19.477059 27412 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:19.344867 29295 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.482252 29295 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.453492 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.484324 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.485705 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.377027 29004 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:09:19.456763 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.488819 27336 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:19.457523 27335 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:19.490897 29216 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:19.492308 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.493884 29280 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.494654 29280 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.495383 29280 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.497051 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.500490 29280 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.501367 29280 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.502041 29280 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.430039 29320 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.508322 27261 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:19.452915 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.531052 27341 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:19.503343 29103 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:19.536437 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.540370 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:19.541365 27263 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:19.552116 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 191023us
I20260709 13:09:19.554092 27335 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:19.556936 27266 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:19.512805 29112 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.538568 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:19.563330 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.563881 27261 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.563498 27260 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:19.568468 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:19.570191 27340 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:19.563127 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.572139 27266 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:19.577507 27267 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:19.581254 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.582212 27340 raft_consensus.cc:2368] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:19.592921 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.593324 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.576310 28013 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:19.597677 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.599068 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.599733 27342 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:09:19.601444 27343 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:19.557199 28937 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:19.604825 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.561118 29216 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:19.617733 27335 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:19.625278 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.626243 27341 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
W20260709 13:09:19.618541 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.618424 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.567031 29112 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.575265 28009 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:19.637880 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.640209 27338 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:19.628997 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:19.640944 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 108374us
I20260709 13:09:19.630990 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:19.625757 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.621882 29326 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.669394 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.670780 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.671643 27341 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:09:19.672950 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 95101.5us
I20260709 13:09:19.673987 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.687500 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.688355 27341 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:19.688632 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 95777.4us
I20260709 13:09:19.692029 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.687309 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:19.665925 29296 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.005s
I20260709 13:09:19.701972 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:19.711025 27341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "b0e4232110db400d8f43fe2170c24c95"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:19.711958 27341 raft_consensus.cc:606] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Received request to transfer leadership to TS b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:19.712548 27341 raft_consensus.cc:614] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:19.640499 29216 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:19.696066 29298 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:09:19.691442 29320 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:19.723240 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.673830 29159 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:19.690109 28943 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:19.665078 29052 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:09:19.665706 28836 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:09:19.737675 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.741488 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:19.746417 29325 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:09:19.740231 29159 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.749449 29159 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:19.694856 29295 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:19.750317 28978 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:19.751531 29306 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.458s	user 0.003s	sys 0.000s
I20260709 13:09:19.751065 28978 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.731758 29298 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.753747 28978 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.754393 29065 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.756103 27261 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:19.749675 29112 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.753744 29298 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.754817 29065 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:19.674607 29327 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:19.729132 29296 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:19.766820 27411 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:19.738807 29318 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:09:19.728111 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.739293 29280 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.717634 28999 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 13:09:19.800554 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 89949.7us
W20260709 13:09:19.800895 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 131628us
I20260709 13:09:19.795209 29103 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.804484 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.804826 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.806774 28999 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:19.807264 28999 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:19.785225 29296 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:19.820258 27336 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:19.798421 28943 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:19.823287 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.829797 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.817719 28888 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:19.808219 28999 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.799218 29341 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:19.817986 29296 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:19.832754 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:19.849150 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 44881.6us
I20260709 13:09:19.850348 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:19.800312 29303 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:09:19.841460 29341 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:19.858603 29341 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:19.841006 29298 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.862591 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:19.862592 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:19.836896 29023 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:19.846304 28943 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.883738 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.885216 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:19.889595 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.889948 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:19.887706 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:19.890810 28013 raft_consensus.cc:2376] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3. Re-sending same reply.
I20260709 13:09:19.885674 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:19.856659 29295 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:19.901099 29348 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.903152 29348 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:19.903838 29348 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:19.904976 29348 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:19.905875 29216 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:19.840597 29065 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.907145 29065 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:19.908972 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:19.909147 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.886998 28999 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:19.920833 29343 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:09:19.912671 29338 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:19.922788 29351 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:19.924594 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:19.931052 28888 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.931845 27380 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.935926 27413 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:19.939455 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:19.894270 29103 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.944792 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:19.941773 28937 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.945559 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:19.988499 29334 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:09:19.945611 29292 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.604s	user 0.012s	sys 0.002s
I20260709 13:09:20.048205 29292 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.023080 29296 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:20.058314 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.060418 29296 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.020819 27336 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:20.050954 29292 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.070957 29366 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.071593 28999 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.071594 29366 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.072163 28999 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.021662 29341 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:19.942071 29283 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:19.947053 28888 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.074250 29366 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.026292 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.012365 29356 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
W20260709 13:09:20.075589 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49435us
I20260709 13:09:20.077430 29292 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.080134 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1763) took 1208 ms. Trace:
I20260709 13:09:20.081230 29341 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.080516 27264 rpcz_store.cc:276] 0709 13:09:18.871335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.899151 (+ 27816us) service_pool.cc:224] Handling call
0709 13:09:18.905636 (+  6485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.032635 (+126999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.032663 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.033117 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.252818 (+219701us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:19.252888 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.079734 (+826846us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001b94d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:20.079782 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.079830 (+    48us) raft_consensus.cc:1685] finished
0709 13:09:20.079842 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.080052 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3684,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":624,"spinlock_wait_cycles":291193600,"thread_start_us":218969,"threads_started":1,"wal-append.queue_time_us":318116}
I20260709 13:09:20.069103 27259 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:19.942224 28943 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.031684 29295 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:20.033202 29284 consensus_meta.cc:287] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.923s	user 0.006s	sys 0.008s
I20260709 13:09:20.150879 27266 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:20.036021 27268 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:19.978068 27262 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.040796 29084 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:20.045167 29358 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.157s	user 0.004s	sys 0.002s
W20260709 13:09:20.019637 29363 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.083s	user 0.003s	sys 0.000s
I20260709 13:09:20.074101 28999 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.087213 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.153385 27339 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:20.066628 29351 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.104671 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.106556 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:20.068006 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 122150us
I20260709 13:09:20.077201 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.159133 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:20.114738 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:20.117506 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.119328 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:20.119577 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:20.119794 29339 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.120306 27417 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:20.120167 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:20.029019 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.129854 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.084587 28978 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:09:20.130272 29293 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.769s	user 0.015s	sys 0.007s
I20260709 13:09:20.130968 29307 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:20.135053 29303 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:20.077196 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.139386 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.141497 29314 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:20.141734 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:20.142781 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:20.188249 27413 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:20.150243 29295 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.201695 29314 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.038921 28937 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.203483 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:20.204483 27417 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:20.204843 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:20.205654 28961 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:20.206301 29340 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.206179 28961 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.206748 29340 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.207126 29340 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.159303 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:20.208454 27412 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:20.163568 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.168728 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:20.167405 27338 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
W20260709 13:09:20.176143 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69690.5us
I20260709 13:09:20.178241 27267 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:20.179040 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 49273us
W20260709 13:09:20.212843 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53660.8us
I20260709 13:09:20.213388 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.213639 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:20.184165 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 107051us
I20260709 13:09:20.215428 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.155340 29084 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:20.185341 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:20.218294 27268 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.200668 29303 consensus_queue.cc:1243] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:09:20.161239 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.222357 29293 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.207261 29216 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.210682 27264 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:20.217352 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:20.215004 29356 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.226068 27410 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:20.225991 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:20.174074 28978 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:20.227029 29368 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.227676 28978 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.228420 29368 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:20.229055 28978 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.228435 27414 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:20.230720 27233 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:20.231503 29216 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:20.217793 28888 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.231992 29216 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:20.218163 29284 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:09:20.232901 29216 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.234215 29284 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:20.236127 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:20.166534 29320 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:20.179924 27334 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.220499 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.221009 29310 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.221589 29280 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:20.252940 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:20.237526 27268 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:20.215595 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:20.179806 29322 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:20.189064 28999 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.183409 29307 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:20.269387 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53866.1us
I20260709 13:09:20.177652 29302 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:09:20.271136 28961 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:20.290151 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73774.2us
I20260709 13:09:20.291078 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:20.271296 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:20.292835 27414 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:20.270123 29284 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:20.281847 29295 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.180016 29339 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.289654 29027 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.305387 29329 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.303057 29294 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.293565 29338 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.332221 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.247440 29320 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:20.334641 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.337206 27416 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:20.289189 29076 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:09:20.331446 29329 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:20.299206 29368 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:09:20.333878 29284 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:20.337559 29312 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.347625 27231 leader_election.cc:400] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
W20260709 13:09:20.350917 27265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.015s	sys 0.032s
I20260709 13:09:20.284699 29310 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.342818 29295 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:20.352129 27265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.016s	sys 0.032s
I20260709 13:09:20.285275 29322 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.342969 29329 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.348625 29312 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:20.386266 29376 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:20.354998 29314 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.396308 29320 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.353591 29341 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.343546 29307 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.417500 29307 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.419528 29284 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:20.420495 29323 consensus_queue.cc:1175] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:09:20.423810 29339 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:20.428331 29310 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:20.428076 29084 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.432168 29084 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.404764 29312 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.452306 29293 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:20.452778 29293 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:20.453788 29293 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.462610 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:20.463794 29310 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:20.464337 29310 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:20.465467 29310 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.468135 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.469436 29345 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.469857 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.470666 27338 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:20.469934 29345 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.471593 29345 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.476312 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.479750 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.484745 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.485186 27268 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:20.485456 27260 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:20.485710 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.488109 27260 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:20.489473 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:20.406528 28937 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:20.498507 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:20.496385 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.503520 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:20.503777 28014 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:20.504105 27341 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:20.504284 29119 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.504783 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.505051 28836 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:20.506122 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.506160 27337 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:20.506939 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.507545 27267 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:20.507717 29346 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.508219 29346 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.508329 28010 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:20.508646 29346 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.511813 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:20.512584 27380 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:20.339983 29338 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.496198 27334 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
W20260709 13:09:20.521839 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.522207 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:20.529644 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 182293us
I20260709 13:09:20.535003 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:20.535698 27268 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:20.538841 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.539899 27334 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:20.514343 29293 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:20.556723 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.603183 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:20.555552 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.609952 27337 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:20.527209 29106 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.543247 29368 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:20.674153 29379 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:09:20.689308 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 167166us
W20260709 13:09:20.693593 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151164us
I20260709 13:09:20.694695 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.521536 29312 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.526422 29340 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.620191 29106 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:20.644414 28999 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:20.708199 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:20.713188 29373 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:09:20.766125 27336 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:20.769047 27413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.033s
I20260709 13:09:20.719394 29106 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:20.797930 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 89811.2us
I20260709 13:09:20.741222 28842 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:20.773267 29292 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:20.767766 29345 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:20.811673 29216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.001s
I20260709 13:09:20.818214 29294 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:20.847097 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.800066 29295 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.848729 28013 raft_consensus.cc:2368] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5.
W20260709 13:09:20.840322 29216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.001s
I20260709 13:09:20.847731 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:20.853772 29380 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:09:20.854872 29378 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:09:20.841984 29322 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.863932 29312 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:20.865064 29382 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:09:20.871423 29294 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:20.875312 29292 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:20.878223 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56197.8us
I20260709 13:09:20.878729 29293 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:20.850085 29295 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:20.813457 27413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.007s	sys 0.033s
I20260709 13:09:20.895583 29338 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:20.895121 29329 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.521s	user 0.000s	sys 0.006s
I20260709 13:09:20.968580 29329 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.971460 29283 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:20.973335 29329 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:20.940979 29375 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.199s	user 0.003s	sys 0.000s
I20260709 13:09:20.975431 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1021) took 1427 ms. Trace:
I20260709 13:09:20.975870 27265 rpcz_store.cc:276] 0709 13:09:19.548500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.742521 (+194021us) service_pool.cc:224] Handling call
0709 13:09:19.780486 (+ 37965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.780975 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.781014 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.781595 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.355566 (+573971us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:20.355614 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.355695 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.940249 (+584554us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:20.975055 (+ 34806us) raft_consensus.cc:1685] finished
0709 13:09:20.975083 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.975346 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":680,"raft.queue_time_us":3133,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9429,"spinlock_wait_cycles":225011456,"thread_start_us":549610,"threads_started":1,"wal-append.queue_time_us":834012}
I20260709 13:09:20.941291 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:20.979374 29293 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:20.979861 29293 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:20.980297 29293 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:20.982378 29383 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.141s	user 0.001s	sys 0.001s
W20260709 13:09:20.969600 29381 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:09:20.941928 29294 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.956450 28937 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:20.984730 28937 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.900933 29345 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:20.956576 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 347791us
I20260709 13:09:20.988227 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:20.989818 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:20.990614 29294 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:20.990980 29294 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:20.991354 29294 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:20.992280 29339 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:20.992684 29339 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.993019 29339 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:20.957268 29368 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:20.996178 29368 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.922174 29303 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:20.998620 29303 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:20.999706 29303 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.000944 29303 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:20.932940 28842 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.002476 28842 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:20.935575 29340 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:20.939278 28999 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:21.004702 28999 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.007858 28999 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.009132 29294 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:21.010396 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69177us
I20260709 13:09:21.011296 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.012202 29292 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.013584 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.019071 27163 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 127) took 9688 ms. Trace:
I20260709 13:09:20.987115 28937 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.023670 27163 rpcz_store.cc:276] 0709 13:09:11.349860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.350244 (+   384us) service_pool.cc:224] Handling call
0709 13:09:21.018971 (+9668727us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:19.330607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:19.359803 (+ 29196us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:19.359863 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:09:19.359883 (+    20us) tablet.cc:662] Decoding operations
0709 13:09:19.360520 (+   637us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:19.360577 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:19.360606 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:09:19.360967 (+   361us) tablet.cc:701] Row locks acquired
0709 13:09:19.360987 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:09:19.361117 (+   130us) write_op.cc:270] Start()
0709 13:09:19.361224 (+   107us) write_op.cc:276] Timestamp: P: 1783602559361080 usec, L: 0
0709 13:09:19.361243 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:19.361906 (+   663us) log.cc:844] Serialized 1762 byte log entry
0709 13:09:19.936632 (+574726us) op_driver.cc:464] REPLICATION: finished
0709 13:09:20.343851 (+407219us) write_op.cc:301] APPLY: starting
0709 13:09:20.346452 (+  2601us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:20.358596 (+ 12144us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:20.413139 (+ 54543us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:20.413737 (+   598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:20.413942 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:09:20.413985 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:20.415238 (+  1253us) log.cc:844] Serialized 41 byte log entry
0709 13:09:20.415399 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:20.415575 (+   176us) write_op.cc:454] Released schema lock
0709 13:09:20.415614 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:20.415999 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:20.416029 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8573,"reported_tablets":15,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":396644,"apply.run_cpu_time_us":2904,"apply.run_wall_time_us":75183,"num_ops":4,"prepare.queue_time_us":227431,"prepare.run_cpu_time_us":20388,"prepare.run_wall_time_us":250448,"raft.queue_time_us":178575,"raft.run_cpu_time_us":63674,"raft.run_wall_time_us":233774,"replication_time_us":568614,"thread_start_us":554990,"threads_started":4,"wal-append.queue_time_us":306050}]]}
I20260709 13:09:21.028793 29339 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:20.958331 29347 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 13:09:21.084944 29339 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.030043 28842 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.031876 27165 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 3 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:20.947082 29302 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.087074 27165 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.088255 29302 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:21.088755 29302 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.089243 27165 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:09:21.042872 29307 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.006s
I20260709 13:09:21.091343 29292 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.090929 27165 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.960862 29301 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:09:21.092615 27165 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:21.093956 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 80463.2us
I20260709 13:09:21.094812 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.094156 27165 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.035632 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.095934 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.036660 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.037709 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.097695 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:21.098675 27343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.015s
W20260709 13:09:21.099058 27343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.010s	sys 0.015s
I20260709 13:09:20.950911 29106 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.099826 27165 catalog_manager.cc:5697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:21.105180 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 66852.5us
I20260709 13:09:21.104866 27165 catalog_manager.cc:5697] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:21.117909 27263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.017s	sys 0.009s
W20260709 13:09:21.118278 27263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.017s	sys 0.009s
W20260709 13:09:20.957912 29084 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.000s
I20260709 13:09:21.119194 27165 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.104694 29106 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:21.122166 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.023s	sys 0.076s
I20260709 13:09:20.959746 28943 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.105857 29346 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.006s
I20260709 13:09:20.943243 29295 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.127390 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:21.121446 27165 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.128062 28013 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:09:21.122687 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.023s	sys 0.076s
I20260709 13:09:20.962527 29320 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.124225 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.086937 29293 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.131923 27165 catalog_manager.cc:5697] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:21.142133 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 445117us
I20260709 13:09:21.144336 29345 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:21.144701 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.144968 29345 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.145843 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:21.146744 27336 raft_consensus.cc:2368] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5.
I20260709 13:09:21.121480 29216 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.126206 28978 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.149653 27165 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 3 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.128307 28842 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:21.127609 28961 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.180563 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.181384 27411 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
W20260709 13:09:21.179929 27338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.013s	sys 0.016s
W20260709 13:09:21.182786 27338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.013s	sys 0.016s
I20260709 13:09:21.180581 27165 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.184122 27165 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 3 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 4 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.141727 28970 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:21.179462 29314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.022s
I20260709 13:09:21.189836 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.193943 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:21.205440 27342 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.205596 27417 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.205839 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:21.195667 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:21.206683 27414 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:21.196795 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.147372 29345 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.185937 27165 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.154765 28978 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:21.180459 28842 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.180737 29294 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.191828 28961 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.238404 27414 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:21.131278 29346 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.251610 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:21.130337 28943 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:21.222000 29314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.007s	sys 0.022s
I20260709 13:09:21.192245 29295 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.241430 28978 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.296352 27408 raft_consensus.cc:2368] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:21.151396 29320 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:21.292369 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.288599 29322 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.295961 29232 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.251075 28961 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.241667 28842 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.235805 29216 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.252105 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:21.291498 29340 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:21.306859 27342 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
W20260709 13:09:21.308386 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.309724 27336 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:21.234213 27165 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 3 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 4 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.323787 29398 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.325254 29366 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.287881 27417 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:21.286407 28013 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:21.248878 29294 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:21.311931 29394 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:09:21.345582 27165 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.299906 29396 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:21.357968 27415 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:21.363035 27978 leader_election.cc:400] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5.
I20260709 13:09:21.370656 27978 leader_election.cc:403] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:09:21.373344 27232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.015s
I20260709 13:09:21.295003 29302 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.339619 29345 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:21.378904 27233 leader_election.cc:400] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:21.380340 27233 leader_election.cc:403] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.331229 29232 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.369791 28689 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.369773 29106 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.385856 27232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.015s
I20260709 13:09:21.382733 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:21.385743 27165 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:09:21.391829 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.394407 27413 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.331848 29322 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.392422 27165 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.398180 27265 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:21.376713 29357 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5.
I20260709 13:09:21.362829 29340 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.402917 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:21.415417 27266 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:21.370464 29294 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.404558 27165 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.407694 27264 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:21.408538 27260 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:21.399756 27307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.000s	sys 0.017s
W20260709 13:09:21.400308 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 441198us
I20260709 13:09:21.424713 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:21.432034 27307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.000s	sys 0.018s
I20260709 13:09:21.432268 27262 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:21.372262 29366 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.425633 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:21.418754 27266 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:21.395701 29293 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.365669 29398 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.398590 29216 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.415027 29324 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.384493 29345 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.375679 29396 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.395206 28689 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.400774 29295 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.438028 27165 catalog_manager.cc:5697] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 2 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.400992 29106 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:21.479765 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:21.482206 29391 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:09:21.484741 29232 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:21.479383 29388 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:09:21.485885 28943 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.461891 29301 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:09:21.495122 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.473412 27334 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.507055 28689 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.507627 29401 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.508356 29295 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.509351 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.511404 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.511600 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1772) took 1036 ms. Trace:
I20260709 13:09:21.436363 29322 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.485204 29398 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.502866 29324 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:21.537751 27261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.003s	sys 0.018s
I20260709 13:09:21.518560 28902 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.540483 28014 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
W20260709 13:09:21.518608 29392 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:09:21.578729 28014 pending_rounds.cc:85] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Aborting all ops after (but not including) 4
I20260709 13:09:21.477649 29065 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:21.544842 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 400176us
I20260709 13:09:21.537307 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:21.586203 27408 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.431624 29399 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 13:09:21.564358 27261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.003s	sys 0.018s
I20260709 13:09:21.543351 27339 rpcz_store.cc:276] 0709 13:09:20.475410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.476829 (+  1419us) service_pool.cc:224] Handling call
0709 13:09:20.477121 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.496741 (+ 19620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.496770 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.513431 (+ 16661us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.123634 (+610203us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:21.123674 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.123734 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.511389 (+387655us) raft_consensus.cc:1685] finished
0709 13:09:21.511409 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.511543 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9638,"raft.queue_time_us":21448,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10252,"thread_start_us":497015,"threads_started":1,"wal-append.queue_time_us":906839}
I20260709 13:09:21.531553 28961 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.579519 28014 pending_rounds.cc:107] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Aborting uncommitted NO_OP operation due to leader change: 4.5
W20260709 13:09:21.582388 29390 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:21.583997 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:21.537885 28940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.016s
I20260709 13:09:21.587030 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.601835 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.602990 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.604710 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.595049 28014 raft_consensus.cc:2889] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:21.588580 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1768) took 1114 ms. Trace:
I20260709 13:09:21.607278 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.608803 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:21.616253 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:21.617159 27262 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.617285 27380 leader_election.cc:400] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5.
I20260709 13:09:21.617846 27380 leader_election.cc:403] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:21.566347 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.623483 29339 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:21.588677 28888 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:21.622779 28940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.003s	sys 0.019s
I20260709 13:09:21.598152 29312 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.628610 29408 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.646391 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.653882 27339 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.542225 29401 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.620117 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:21.658277 27334 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:21.627274 29292 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.627583 29293 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.662725 29312 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.675875 29406 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.679572 29413 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:21.680709 29393 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:09:21.602660 28961 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.645056 27259 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:21.593135 28902 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.599628 29065 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.648541 29346 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.665130 29232 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:21.706017 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 332796us
I20260709 13:09:21.701187 29294 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.693969 29302 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.653036 28888 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.689747 27262 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:21.638278 29368 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:21.704530 29405 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.704633 29413 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.727975 27262 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:21.718850 29411 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.725739 29232 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:21.729373 29410 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:21.729156 29411 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.727548 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:21.731019 29402 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:09:21.731487 29411 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.731598 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:21.732836 28888 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.733678 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1036) took 1195 ms. Trace:
I20260709 13:09:21.734242 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.735235 27409 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:21.736841 29314 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.737383 29314 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:21.738693 28999 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:21.739265 28999 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:21.740178 28999 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.704298 29406 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.742878 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1790) took 1242 ms. Trace:
I20260709 13:09:21.666160 29324 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.695448 28978 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.743314 27263 rpcz_store.cc:276] 0709 13:09:20.500459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.500572 (+   113us) service_pool.cc:224] Handling call
0709 13:09:20.500881 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.510487 (+  9606us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:20.510824 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.143632 (+632808us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.178943 (+ 35311us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.179090 (+   147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:21.179185 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.179262 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.742662 (+563400us) raft_consensus.cc:1685] finished
0709 13:09:21.742681 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.742818 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13024,"prepare.queue_time_us":906,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":30724,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":26692,"thread_start_us":607381,"threads_started":1,"wal-append.queue_time_us":876815}
I20260709 13:09:21.729429 29413 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.745424 28978 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.720744 29340 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.746917 29294 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.747851 28961 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.748061 29295 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.749256 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.724735 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1770) took 1249 ms. Trace:
I20260709 13:09:21.738284 29314 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.750890 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1786) took 1265 ms. Trace:
I20260709 13:09:21.749554 29312 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.752590 27261 rpcz_store.cc:276] 0709 13:09:20.485289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.486690 (+  1401us) service_pool.cc:224] Handling call
0709 13:09:20.515060 (+ 28370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.530982 (+ 15922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.531029 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.534407 (+  3378us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.590642 (+1056235us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:21.590686 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.590772 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.750683 (+159911us) raft_consensus.cc:1685] finished
0709 13:09:21.750704 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.750833 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2011,"raft.queue_time_us":66,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13200,"thread_start_us":964100,"threads_started":1,"wal-append.queue_time_us":1063202}
I20260709 13:09:21.764612 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.765789 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.734099 27267 rpcz_store.cc:276] 0709 13:09:20.538107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.538379 (+   272us) service_pool.cc:224] Handling call
0709 13:09:20.610829 (+ 72450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.621645 (+ 10816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.621676 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.693174 (+ 71498us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.133823 (+440649us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:21.133873 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.133963 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.733438 (+599475us) raft_consensus.cc:1685] finished
0709 13:09:21.733462 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.733614 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10345,"raft.queue_time_us":19876,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":41837,"thread_start_us":367534,"threads_started":1,"wal-append.queue_time_us":802436}
I20260709 13:09:21.767685 27339 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:21.750572 27343 rpcz_store.cc:276] 0709 13:09:20.474817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.474938 (+   121us) service_pool.cc:224] Handling call
0709 13:09:20.475279 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.475625 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.475651 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.476128 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.099565 (+623437us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:21.127464 (+ 27899us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.128109 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.128204 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.482454 (+354250us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b18003c6e20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:21.720262 (+237808us) raft_consensus.cc:1685] finished
0709 13:09:21.724472 (+  4210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.724667 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24158,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":24390,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":10637,"spinlock_wait_cycles":6382976,"thread_start_us":622958,"threads_started":1,"wal-append.queue_time_us":887981}
I20260709 13:09:21.768524 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.771049 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.771396 27413 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:21.729194 29405 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:21.773702 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:21.726269 29366 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.749583 28902 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.791893 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:21.792563 27263 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.762876 28961 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.794178 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.793443 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:21.796298 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 166858us
I20260709 13:09:21.779915 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.769923 29106 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.771100 29345 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.814657 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.817268 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:21.793759 29311 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:21.828285 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:21.799742 29396 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.772478 28842 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:21.835490 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 228314us
I20260709 13:09:21.836398 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.826836 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.823562 29295 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.838572 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.840471 27417 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:09:21.832278 28902 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.842128 29401 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.847644 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:21.846305 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:21.846712 27265 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:21.848403 28013 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:21.793426 29405 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.849650 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:21.854332 28014 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:21.826535 28961 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.858026 28970 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:21.858248 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:21.861869 28970 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:21.862097 29421 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.859957 28014 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:21.864449 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.838330 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:21.866815 28012 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:21.863420 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.839316 29311 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:21.878448 29418 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:21.878489 28842 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.868645 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.869437 29421 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:21.880054 28842 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:21.880155 29405 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.880486 28842 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.880795 27259 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:21.880861 28842 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.862952 28970 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:21.875025 29414 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:09:21.838894 29419 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:21.876312 29406 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.876808 28012 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:21.848565 29295 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.870065 27267 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:21.863055 28961 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.882462 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:21.884963 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.888175 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:21.905722 27417 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:21.907644 27408 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:21.878962 29311 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.897557 27263 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:21.888876 29418 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.847829 28902 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.908926 29338 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5.
I20260709 13:09:21.927618 27268 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:21.928341 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:21.917495 29418 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.926352 28961 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.930408 28961 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.932116 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:21.933141 29302 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:21.925679 29419 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:21.933687 29302 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:21.934722 29302 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:21.937669 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:21.939431 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.940446 27259 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:21.913584 28902 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.939384 29421 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:21.941147 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:21.949721 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:21.950484 27262 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:21.942395 29405 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:21.902711 29413 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:21.961051 28888 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:21.962393 29413 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:21.965221 28961 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:21.968654 29403 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.387s	user 0.004s	sys 0.000s
I20260709 13:09:21.952468 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:21.971091 28940 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:21.972483 29295 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:21.974082 29418 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:21.976262 28940 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:21.954133 29405 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:21.956456 28010 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.958801 28937 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:21.982299 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:21.989657 27339 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:21.984225 27343 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:21.980911 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:21.985637 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.993306 27336 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:21.996811 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.996928 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1777) took 1459 ms. Trace:
I20260709 13:09:21.998456 27336 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:21.978106 28940 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:21.998795 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:21.999075 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.022194 27342 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:22.000368 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:21.988224 29405 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:21.997709 27340 rpcz_store.cc:276] 0709 13:09:20.537603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.543566 (+  5963us) service_pool.cc:224] Handling call
0709 13:09:20.616310 (+ 72744us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.626010 (+  9700us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:20.676077 (+ 50067us) log.cc:844] Serialized 14 byte log entry
0709 13:09:20.920197 (+244120us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b18001f1e60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:21.167771 (+247574us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.195561 (+ 27790us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.195713 (+   152us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:21.195749 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.195808 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.968045 (+772237us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:21.996582 (+ 28537us) raft_consensus.cc:1685] finished
0709 13:09:21.996614 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.996830 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31157,"prepare.queue_time_us":63160,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":9848,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":10837,"spinlock_wait_cycles":45225728,"thread_start_us":394731,"threads_started":1,"wal-append.queue_time_us":840505}
I20260709 13:09:22.009328 28937 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.011596 28842 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:22.013371 29216 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:09:22.015244 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:21.981590 29419 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:22.076442 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.092397 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:22.020313 28902 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.022547 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:22.023451 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.045296 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.023279 27343 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.029481 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:21.992405 29327 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:22.024785 29301 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:21.992511 28888 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.184s
I20260709 13:09:22.037351 29295 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:09:22.175938 28009 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:22.182338 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.185154 28010 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:22.187996 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.188372 28978 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.218279 29411 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.385888 28978 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.386101 29411 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.388455 29411 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.191741 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:22.389464 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 197832us
I20260709 13:09:22.390568 27337 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:22.231212 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.243805 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:22.392143 27339 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
W20260709 13:09:22.393181 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 363777us
I20260709 13:09:22.708353 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:22.225736 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:22.645594 29292 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.710470 29411 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:22.712666 27336 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:22.524362 27335 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:22.714161 27340 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:22.238015 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.227002 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.237774 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:22.716300 27342 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:22.717154 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:22.720170 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:22.600567 29427 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:22.723507 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:22.480865 29430 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:09:22.721980 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 484304us
I20260709 13:09:22.765815 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:22.759948 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:22.567181 29428 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:09:22.513785 29357 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:22.761615 28014 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:22.768211 27337 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:22.196130 29216 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:22.367213 29420 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:22.710992 29292 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.712024 28978 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.481201 29323 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:22.783295 27263 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:22.428824 29302 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.711357 29301 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.771903 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.787652 27340 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:22.772267 27336 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:22.773209 27339 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:22.177237 29419 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:22.604132 28937 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:22.188512 29320 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:22.666334 28888 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:22.774659 28999 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:22.775398 27342 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:09:22.795387 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 87145.6us
I20260709 13:09:22.714864 29294 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.711104 29411 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.787101 29357 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:22.801004 29406 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:22.801617 29406 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.801941 29411 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.784209 27341 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:22.801856 29357 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.763633 29295 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:22.489471 29327 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.790431 29301 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:22.805470 27343 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:22.806219 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.810463 27414 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:22.807760 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.782769 29323 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.811374 27412 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:22.790477 28842 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:22.812433 27342 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:22.814878 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.814996 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:22.806970 29411 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.806617 29295 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.818055 29411 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.818922 29295 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.806139 29320 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.825388 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:22.826440 27334 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:22.808929 28999 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:22.830961 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.831804 27412 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:22.835582 27334 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:22.836853 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.803987 28888 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.827548 29320 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:22.842456 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.841179 28999 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:22.843487 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:22.797703 29420 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:22.808183 29294 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.874531 29292 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.832190 29419 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.876857 29420 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.877774 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:22.842341 29411 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.892030 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:22.882076 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 116332us
I20260709 13:09:22.849644 29320 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:22.896117 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 173877us
I20260709 13:09:22.905903 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:22.916417 27335 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:22.921068 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.922178 27412 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:22.902779 29292 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:22.928478 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.910938 29420 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:22.932526 27336 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:22.903354 29314 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:22.930893 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.935526 27341 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:22.935070 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.938285 27412 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:22.938978 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.932300 29292 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:22.940024 29292 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:22.939769 28999 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.940285 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:22.943758 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:22.919319 29340 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.959112 29216 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:22.959993 29327 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:22.918166 29411 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:22.937135 29420 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:22.967289 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61486.3us
I20260709 13:09:22.969226 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.970849 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:22.972996 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:22.959190 29432 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:09:22.975745 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:22.979486 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.981006 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.982033 27336 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:22.982949 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:22.979492 27266 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:09:22.984735 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1804) took 1507 ms (client timeout 1642 ms). Trace:
W20260709 13:09:22.985307 27266 rpcz_store.cc:269] 0709 13:09:21.477217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.477367 (+   150us) service_pool.cc:224] Handling call
0709 13:09:22.943555 (+1466188us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:22.984575 (+ 41020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5846400}
I20260709 13:09:22.972277 29420 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:22.977125 29429 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:09:22.988144 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:22.952543 29314 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:22.992141 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:22.961114 29340 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:22.979727 29405 consensus_meta.cc:287] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:09:23.002830 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.004000 27266 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:23.006806 29314 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.048036 29292 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.014142 29320 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.048938 29340 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.050063 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1785) took 1021 ms. Trace:
I20260709 13:09:23.050231 29292 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.050758 29292 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.051326 29320 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.050460 27340 rpcz_store.cc:276] 0709 13:09:22.028655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.788244 (+759589us) service_pool.cc:224] Handling call
0709 13:09:22.799241 (+ 10997us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.799541 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.799576 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.809778 (+ 10202us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.953662 (+143884us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:22.953707 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.953785 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.049872 (+ 96087us) raft_consensus.cc:1685] finished
0709 13:09:23.049892 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.050007 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":636,"raft.queue_time_us":17604,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5068,"thread_start_us":113642,"threads_started":1,"wal-append.queue_time_us":148922}
I20260709 13:09:23.051409 29292 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.052282 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1055) took 1102 ms. Trace:
I20260709 13:09:23.052626 27266 rpcz_store.cc:276] 0709 13:09:21.950075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.997853 (+1047778us) service_pool.cc:224] Handling call
0709 13:09:23.052224 (+ 54371us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.052951 27340 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:23.053630 29292 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.054119 27340 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:23.043412 29294 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.027812 27336 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:23.020702 29446 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.998508 29323 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:23.042423 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 66728.3us
I20260709 13:09:23.047574 29450 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:23.047266 29411 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:22.999684 29302 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.031042 28888 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.054566 29295 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:23.057333 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69309.9us
I20260709 13:09:23.057667 27340 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:23.096972 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:23.058702 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:23.098232 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1057) took 1147 ms. Trace:
I20260709 13:09:22.998857 29405 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:23.064946 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:23.017295 28842 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:23.055584 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 448) took 1079 ms. Trace:
I20260709 13:09:23.098655 27266 rpcz_store.cc:276] 0709 13:09:21.950712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.058421 (+1107709us) service_pool.cc:224] Handling call
0709 13:09:23.098172 (+ 39751us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.076699 29340 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.085603 29320 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.086570 29411 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.111090 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.108528 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.108979 29320 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.107748 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.112636 29320 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.107836 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:23.113112 27266 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:23.113631 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1059) took 1162 ms. Trace:
I20260709 13:09:23.113935 27266 rpcz_store.cc:276] 0709 13:09:21.951369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.107506 (+1156137us) service_pool.cc:224] Handling call
0709 13:09:23.113576 (+  6070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.114816 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.115384 27266 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:23.115795 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1062) took 1162 ms. Trace:
I20260709 13:09:23.116071 27266 rpcz_store.cc:276] 0709 13:09:21.953201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.114584 (+1161383us) service_pool.cc:224] Handling call
0709 13:09:23.115751 (+  1167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.116852 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.117357 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:23.117775 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1063) took 1164 ms. Trace:
I20260709 13:09:23.118047 27266 rpcz_store.cc:276] 0709 13:09:21.953821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.116643 (+1162822us) service_pool.cc:224] Handling call
0709 13:09:23.117733 (+  1090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.118809 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.120386 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1052) took 1171 ms. Trace:
I20260709 13:09:23.122699 27266 rpcz_store.cc:276] 0709 13:09:21.949238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.118613 (+1169375us) service_pool.cc:224] Handling call
0709 13:09:23.120326 (+  1713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.096395 29450 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:23.104912 28842 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:23.124356 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.105268 29446 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.127415 27266 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:23.125325 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:23.127187 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.127988 27408 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:23.128381 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:23.128928 27306 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.895s (SENT) [suppressed 19 similar messages]
I20260709 13:09:23.129186 27266 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:09:23.129568 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1056) took 1179 ms. Trace:
I20260709 13:09:23.129840 27266 rpcz_store.cc:276] 0709 13:09:21.950368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.128166 (+1177798us) service_pool.cc:224] Handling call
0709 13:09:23.129522 (+  1356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.130682 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.131258 27266 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:23.132073 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.121057 29411 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.121300 29340 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.107142 29448 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:23.096822 29302 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.120375 29320 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.132325 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:23.127281 29446 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.132887 29437 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:23.133821 29292 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.136706 28999 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.132507 29451 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.164938 29450 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.160955 27408 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:23.171819 28999 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.153905 29446 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.147943 29449 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:09:23.167586 29454 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:23.180394 29455 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:09:23.182603 29422 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 1.313s	user 0.014s	sys 0.003s
W20260709 13:09:23.191862 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64761.3us
I20260709 13:09:23.150913 29436 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:09:23.139302 28888 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:23.163070 29437 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:23.215286 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76473us
I20260709 13:09:23.171067 29292 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.219514 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.219825 29405 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.249557 28999 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.169229 29216 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:23.107057 28012 rpcz_store.cc:276] 0709 13:09:21.965496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.965667 (+   171us) service_pool.cc:224] Handling call
0709 13:09:21.966033 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.966420 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.966455 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.966951 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.512151 (+545200us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.521605 (+  9454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.564930 (+ 43325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.032031 (+467101us) raft_consensus.cc:1685] finished
0709 13:09:23.032050 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.044904 (+ 12854us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1105,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":300189,"threads_started":1,"wal-append.queue_time_us":818842}
I20260709 13:09:23.170820 29448 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.202764 29327 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.260499 29448 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.260694 29327 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.262884 29448 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.236554 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.178287 29420 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.263387 29327 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.192340 29451 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.264497 29405 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.264632 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.264909 29405 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.265069 29420 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.265347 29405 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.265758 29420 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:23.247843 29437 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.266551 29366 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.266976 29366 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.267099 29065 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.267429 29366 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.194442 28842 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.248418 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.249557 29292 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.252034 29445 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.272213 29320 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.272495 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.272617 29445 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.273715 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:23.239449 29435 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.256362 29436 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.257162 29295 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.259966 29216 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:23.265847 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.271930 29292 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:23.274626 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.295703 29292 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:23.296629 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.296692 29292 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.297993 29292 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:23.299217 28999 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.299666 28999 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.299495 29436 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.300046 28999 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.302173 29436 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.302800 28842 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.305464 29465 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.306037 28943 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.306063 29465 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.275270 27266 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:23.272279 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1791) took 1198 ms. Trace:
I20260709 13:09:23.240355 29463 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.233829 29454 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.266809 29420 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:23.286827 29216 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.288707 29302 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.244146 29464 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.292398 29448 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:23.293113 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:23.306785 28943 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.283118 28978 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.295221 29433 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:23.310141 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.333858 27343 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:23.290560 29451 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.312705 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:23.321762 29454 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.290539 29301 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.281525 29435 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.293573 29437 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:23.327709 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 194700us
I20260709 13:09:23.320744 29106 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.312666 29303 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.308789 27342 rpcz_store.cc:276] 0709 13:09:22.073683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.798266 (+724583us) service_pool.cc:224] Handling call
0709 13:09:22.812248 (+ 13982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.813887 (+  1639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.272091 (+458204us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b54002dad50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.272221 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9769344}
W20260709 13:09:23.321023 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 188763us
I20260709 13:09:23.344990 27340 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.320676 29465 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.323772 29295 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.354439 29301 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.345010 29420 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:09:23.328163 29293 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:23.292402 29411 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.330026 28978 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.311709 29446 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.343833 29449 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.322813 29463 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.361908 29435 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.370491 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:23.395771 28978 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.397475 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.336372 29433 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:23.362875 29445 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:23.398275 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 70188.3us
I20260709 13:09:23.413496 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.414861 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:23.359766 29448 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:23.407967 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.330312 29464 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.380432 29436 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.417642 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.423853 27342 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:23.424154 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:23.424762 27415 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:09:23.425709 29476 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.426216 29476 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.428277 29476 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.429147 29474 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.429726 29474 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.403973 29451 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:23.431671 29451 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:23.431762 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.432818 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:23.432948 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.432732 29451 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.433360 29476 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.433640 27408 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.433898 29476 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.384882 29302 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.434798 29302 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.436993 29302 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.438582 28842 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.432195 29474 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.421624 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.434223 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.397215 29338 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.424791 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:23.380849 29295 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.401350 29449 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:23.551738 27267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1044) took 1781 ms (client timeout 2234 ms). Trace:
W20260709 13:09:23.505956 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.489109 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:23.762197 27267 rpcz_store.cc:269] 0709 13:09:21.770154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.770341 (+   187us) service_pool.cc:224] Handling call
0709 13:09:23.551556 (+1781215us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b54003089d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.551674 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172725632}
I20260709 13:09:23.762758 27261 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:23.488248 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:23.443143 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.618726 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:23.764204 27414 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:23.552211 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 184) took 1752 ms. Trace:
W20260709 13:09:23.620569 27334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1619) took 1617 ms (client timeout 2153 ms). Trace:
I20260709 13:09:23.429728 27340 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:23.481343 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 329) took 2181 ms. Trace:
I20260709 13:09:23.486212 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.762887 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:23.457901 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 79564.8us
I20260709 13:09:23.678076 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.794494 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.778942 27415 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:23.695770 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.623822 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.036111 27411 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 2.
W20260709 13:09:23.596767 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1061) took 1644 ms (client timeout 1654 ms). Trace:
I20260709 13:09:23.902982 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.594871 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.039239 27261 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:23.504208 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.040109 27266 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:23.595973 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1793) took 2192 ms. Trace:
W20260709 13:09:24.038275 27263 rpcz_store.cc:269] 0709 13:09:21.952871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.707622 (+754751us) service_pool.cc:224] Handling call
0709 13:09:23.596541 (+888919us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b540031e7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.596670 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150260096}
I20260709 13:09:23.765566 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:24.040803 27265 rpcz_store.cc:276] 0709 13:09:21.403127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.403543 (+   416us) service_pool.cc:224] Handling call
0709 13:09:21.403786 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.848723 (+444937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.595607 (+1746884us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54001b94d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:23.595862 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1018253568}
I20260709 13:09:24.041862 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.789602 27408 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
W20260709 13:09:23.950266 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.013s
I20260709 13:09:24.042804 27263 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:24.044217 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.004s	sys 0.014s
I20260709 13:09:23.680855 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:23.621639 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.605554 27338 rpcz_store.cc:276] 0709 13:09:20.474280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.475277 (+   997us) service_pool.cc:224] Handling call
0709 13:09:20.475574 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.475908 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.475940 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.476387 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.186618 (+710231us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:21.588024 (+401406us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.588256 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.588331 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.588374 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:21.588387 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.588521 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9708,"prepare.queue_time_us":287247,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":23180,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":7908,"thread_start_us":1063666,"threads_started":2,"wal-append.queue_time_us":917715}
W20260709 13:09:23.865362 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 443532us
I20260709 13:09:23.883893 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:23.764735 27336 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:24.046753 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:24.047541 27413 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:23.490161 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:23.766379 27334 rpcz_store.cc:269] 0709 13:09:22.003151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.225311 (+222160us) service_pool.cc:224] Handling call
0709 13:09:23.620380 (+1395069us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b540025bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.620487 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267472896}
I20260709 13:09:23.626461 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.063745 27335 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:23.628952 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 186) took 1824 ms. Trace:
I20260709 13:09:24.050163 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1067) took 1126 ms. Trace:
I20260709 13:09:23.596439 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.039301 28011 rpcz_store.cc:276] 0709 13:09:21.299660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.299785 (+   125us) service_pool.cc:224] Handling call
0709 13:09:21.323931 (+ 24146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.532056 (+208125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.532090 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:21.532128 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:21.532165 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.481060 (+1948895us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540006d6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:23.481117 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.481258 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478197504}
I20260709 13:09:24.064638 27263 rpcz_store.cc:276] 0709 13:09:22.924165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.041332 (+1117167us) service_pool.cc:224] Handling call
0709 13:09:24.050086 (+  8754us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.058321 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.064527 27264 rpcz_store.cc:276] 0709 13:09:21.804663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.807298 (+  2635us) service_pool.cc:224] Handling call
0709 13:09:23.552369 (+1745071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.552568 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.552595 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.552633 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:23.552662 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.552721 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.628665 (+ 75944us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54003089d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.628840 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4012460800}
I20260709 13:09:24.065912 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.048314 27267 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:24.066715 27263 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:24.067328 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1069) took 1138 ms. Trace:
I20260709 13:09:24.067780 27263 rpcz_store.cc:276] 0709 13:09:22.928640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.065665 (+1137025us) service_pool.cc:224] Handling call
0709 13:09:24.067259 (+  1594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.068925 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.066717 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:24.070384 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:24.065013 27260 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:23.416500 29433 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.765872 27268 rpcz_store.cc:276] 0709 13:09:21.800075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.800233 (+   158us) service_pool.cc:224] Handling call
0709 13:09:21.926652 (+126419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.930155 (+  3503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.552004 (+1621849us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540031f1d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:23.552153 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289954688}
I20260709 13:09:24.097261 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.097608 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:24.095914 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:23.545665 29409 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.829s	user 0.004s	sys 0.014s
I20260709 13:09:23.701077 29312 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.499716 28902 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.117743 27410 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9.
I20260709 13:09:24.116250 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:23.796025 29366 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.001s
I20260709 13:09:24.256053 29312 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.900972 29294 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:24.256484 29366 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.839026 29435 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:24.257191 29294 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.258617 29366 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.258701 29312 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.503281 29448 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.259105 29435 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:24.256100 28007 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:23.631688 29418 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.259763 29435 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.214768 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:24.117223 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 354402us
W20260709 13:09:24.260761 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46079us
I20260709 13:09:24.262135 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:24.221524 28013 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:24.263545 27262 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:23.655850 29419 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:23.481381 28943 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.226397 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.226598 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.494611 29464 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.619918 29406 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.638007 29452 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.797365 29399 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.462147 29476 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.213522 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.308648 27266 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9.
W20260709 13:09:23.833982 28999 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:09:23.419035 29323 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.228289 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.622009 29446 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.236842 27380 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:23.927913 28009 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:24.247630 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.317873 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.462963 29436 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:23.926950 29413 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.592235 29232 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.636700 29339 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.251029 27265 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.253314 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:23.505712 29408 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:24.255631 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:24.227049 29400 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:09:24.029479 28978 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 13:09:23.621836 29463 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:23.492353 29437 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:23.480520 29405 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.259492 29448 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:24.212497 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 163188us
I20260709 13:09:23.501814 28970 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:23.927227 29320 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.927443 28937 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:24.221776 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.265707 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:24.384130 27414 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:23.696028 29411 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.095654 29421 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.794981 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:23.615721 29293 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:23.547394 29340 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:23.794476 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:24.271589 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.271591 27412 raft_consensus.cc:2368] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
W20260709 13:09:24.275352 27343 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.039s	sys 0.088s
W20260709 13:09:24.420782 27343 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.039s	sys 0.088s
I20260709 13:09:24.275584 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:24.195474 27165 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 231) took 5938 ms. Trace:
I20260709 13:09:24.276574 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.010751 29449 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:24.116325 29465 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:24.048537 29420 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:24.278651 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.006s	sys 0.019s
I20260709 13:09:24.286898 27264 raft_consensus.cc:2410] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:24.219017 29314 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:23.439193 28842 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:23.889950 29470 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.301923 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:24.282159 29084 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.070s	sys 0.099s
I20260709 13:09:24.116161 29345 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 13:09:24.116533 29474 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.170s
I20260709 13:09:24.450536 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1593) took 1045 ms. Trace:
I20260709 13:09:24.212826 29338 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.260059 29418 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.377321 28943 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:09:24.318629 27267 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:24.226650 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:23.866835 29454 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.260339 29435 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.321832 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:24.465153 27410 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:24.358620 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.384119 29339 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:24.361793 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.426172 27165 rpcz_store.cc:276] 0709 13:09:18.257432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:18.275837 (+ 18405us) service_pool.cc:224] Handling call
0709 13:09:24.195354 (+5919517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:21.843064 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:21.843666 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:21.843700 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:09:21.843719 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:21.850346 (+  6627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:21.850407 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:21.850434 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:21.954466 (+104032us) tablet.cc:701] Row locks acquired
0709 13:09:21.970166 (+ 15700us) write_op.cc:260] PREPARE: finished
0709 13:09:21.970320 (+   154us) write_op.cc:270] Start()
0709 13:09:21.970444 (+   124us) write_op.cc:276] Timestamp: P: 1783602561970268 usec, L: 0
0709 13:09:21.970469 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:21.971255 (+   786us) log.cc:844] Serialized 8335 byte log entry
0709 13:09:22.996587 (+1025332us) op_driver.cc:464] REPLICATION: finished
0709 13:09:23.167049 (+170462us) write_op.cc:301] APPLY: starting
0709 13:09:23.188356 (+ 21307us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:23.273379 (+ 85023us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:23.273509 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:23.287831 (+ 14322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:23.288182 (+   351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:09:23.288237 (+    55us) write_op.cc:312] APPLY: finished
0709 13:09:23.288649 (+   412us) log.cc:844] Serialized 145 byte log entry
0709 13:09:23.288851 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:23.289050 (+   199us) write_op.cc:454] Released schema lock
0709 13:09:23.289106 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:23.325612 (+ 36506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:23.326286 (+   674us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":431845,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":145328,"apply.run_cpu_time_us":5435,"apply.run_wall_time_us":167046,"num_ops":21,"prepare.queue_time_us":92869,"prepare.run_cpu_time_us":20911,"prepare.run_wall_time_us":339025,"raft.queue_time_us":160240,"raft.run_cpu_time_us":13661,"raft.run_wall_time_us":108301,"replication_time_us":1017688,"thread_start_us":420155,"threads_started":4,"wal-append.queue_time_us":274858,"wal-append.run_cpu_time_us":44696,"wal-append.run_wall_time_us":2034076}]]}
W20260709 13:09:24.337908 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 101213us
I20260709 13:09:24.365459 27413 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.284881 29294 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.387439 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.383278 28970 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.319697 29323 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.318183 29477 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:24.419914 29293 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.484289 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:24.407823 27980 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9.
I20260709 13:09:24.392114 27415 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:24.337116 29292 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:24.357570 29406 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:24.338990 29451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.014s	sys 0.044s
I20260709 13:09:24.328194 29476 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:24.405246 27262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1060) took 2440 ms (client timeout 1667 ms). Trace:
I20260709 13:09:24.428556 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.364205 29408 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:24.330370 29295 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:24.443406 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.006s	sys 0.021s
I20260709 13:09:24.497227 27341 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.430224 27265 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:24.497903 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1828) took 1072 ms. Trace:
I20260709 13:09:24.498322 27265 rpcz_store.cc:276] 0709 13:09:23.425513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.115959 (+690446us) service_pool.cc:224] Handling call
0709 13:09:24.497841 (+381882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.499212 27409 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:24.499594 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.433247 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:24.419857 29444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.029s	sys 0.096s
I20260709 13:09:24.381098 29478 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:09:24.446164 27339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.022s	sys 0.019s
I20260709 13:09:24.440737 27342 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:24.505270 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.506353 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:24.504550 27339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.022s	sys 0.019s
W20260709 13:09:24.447654 28014 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.038s
W20260709 13:09:24.507256 28014 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.006s	sys 0.038s
W20260709 13:09:24.449716 27264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1058) took 2498 ms (client timeout 3198 ms). Trace:
I20260709 13:09:24.320359 29479 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:24.446108 27234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.012s	sys 0.014s
I20260709 13:09:24.502496 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.452453 29449 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.450994 27412 rpcz_store.cc:276] 0709 13:09:23.405459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.414560 (+  9101us) service_pool.cc:224] Handling call
0709 13:09:24.446875 (+1032315us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54000e9054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.450465 (+  3590us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949853056}
I20260709 13:09:24.402266 28010 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.317297 28999 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.462452 27263 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:24.463557 27268 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:24.445497 29314 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.464064 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1075) took 1100 ms. Trace:
I20260709 13:09:24.353945 28013 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
W20260709 13:09:24.450217 29084 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.071s	sys 0.099s
I20260709 13:09:24.453630 29420 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.383877 28978 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.402114 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:24.387056 29320 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:24.365458 29216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.025s	sys 0.045s
I20260709 13:09:24.390499 28937 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.476583 27408 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:24.452081 29465 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:24.408608 29421 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.495836 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.312054 29399 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.525759 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1077) took 1149 ms. Trace:
I20260709 13:09:24.526297 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1599) took 1084 ms. Trace:
I20260709 13:09:24.526252 27268 rpcz_store.cc:276] 0709 13:09:23.376728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.226382 (+849654us) service_pool.cc:224] Handling call
0709 13:09:24.525685 (+299303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.499747 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:24.500326 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:24.495466 27262 rpcz_store.cc:269] 0709 13:09:21.951640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.710704 (+759064us) service_pool.cc:224] Handling call
0709 13:09:23.486028 (+775324us) spinlock_profiling.cc:243] Waited 6.17 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:24.391330 (+905302us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003142d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.391516 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505660928}
I20260709 13:09:24.529129 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.529793 27262 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:24.309082 29452 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.532593 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.535102 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.498323 27980 leader_election.cc:403] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.401257 29413 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:24.507997 27264 rpcz_store.cc:269] 0709 13:09:21.951008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.116329 (+2165321us) service_pool.cc:224] Handling call
0709 13:09:24.449627 (+333298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.536532 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.536738 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.516428 27267 rpcz_store.cc:276] 0709 13:09:23.363510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.095656 (+732146us) service_pool.cc:224] Handling call
0709 13:09:24.463996 (+368340us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.501253 29451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.015s	sys 0.052s
I20260709 13:09:24.543883 27337 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:24.544305 27260 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.513378 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:24.508169 27234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.013s	sys 0.014s
I20260709 13:09:24.483534 29477 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.451807 29470 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:24.503669 29444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.031s	sys 0.102s
I20260709 13:09:24.526819 27409 rpcz_store.cc:276] 0709 13:09:23.442172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.442346 (+   174us) service_pool.cc:224] Handling call
0709 13:09:24.526163 (+1083817us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54000f1c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.526247 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067084672}
I20260709 13:09:24.553293 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:24.530328 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1827) took 1105 ms. Trace:
I20260709 13:09:24.554066 27262 rpcz_store.cc:276] 0709 13:09:23.425274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.528898 (+1103624us) service_pool.cc:224] Handling call
0709 13:09:24.530268 (+  1370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.533380 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:24.537307 27264 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:24.536216 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:24.556252 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1826) took 1131 ms. Trace:
I20260709 13:09:24.556771 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.556998 27264 rpcz_store.cc:276] 0709 13:09:23.424971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.536527 (+1111556us) service_pool.cc:224] Handling call
0709 13:09:24.556172 (+ 19645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.534240 29295 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:24.539408 28842 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.540683 29399 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.533030 28006 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:24.512710 29433 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.579046 27260 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:24.546901 27412 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:24.517263 29479 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:24.550189 27340 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:24.452834 29448 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.508038 29476 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:24.550606 27411 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:24.551235 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 196) took 1211 ms. Trace:
I20260709 13:09:24.513979 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.558497 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.597185 27266 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:24.600775 27338 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:24.605568 28842 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.603524 29413 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.580840 29216 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:24.588956 27341 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:24.611480 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.612015 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.606936 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:24.606335 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1788) took 2570 ms. Trace:
I20260709 13:09:24.617663 27339 rpcz_store.cc:276] 0709 13:09:22.036363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.788863 (+752500us) service_pool.cc:224] Handling call
0709 13:09:22.798990 (+ 10127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.799351 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.799389 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.806846 (+  7457us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.508414 (+701568us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b18002ad840. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:24.507127 (+998713us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.508755 (+  1628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.508847 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.605954 (+ 97107us) raft_consensus.cc:1685] finished
0709 13:09:24.605980 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.606252 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1527,"raft.queue_time_us":15562,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2970,"spinlock_wait_cycles":7267584,"thread_start_us":998517,"threads_started":1,"wal-append.queue_time_us":1731492}
I20260709 13:09:24.613519 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:24.605773 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47349.1us
I20260709 13:09:24.600256 27263 rpcz_store.cc:276] 0709 13:09:23.340402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.068613 (+728211us) service_pool.cc:224] Handling call
0709 13:09:24.551069 (+482456us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540031f6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.551180 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903531776}
I20260709 13:09:24.625160 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.602548 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.626397 27267 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:24.626870 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1823) took 1202 ms. Trace:
I20260709 13:09:24.627260 27267 rpcz_store.cc:276] 0709 13:09:23.424219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.580939 (+1156720us) service_pool.cc:224] Handling call
0709 13:09:24.626816 (+ 45877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.627944 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.630254 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.510404 29449 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.567518 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.525170 29465 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.576100 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:24.576237 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.527379 29314 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:24.517881 29294 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:24.604017 29454 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.503952 29292 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.505790 29406 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.596489 27417 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:24.631422 27413 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:24.724321 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1602) took 1104 ms. Trace:
I20260709 13:09:24.725086 27413 rpcz_store.cc:276] 0709 13:09:23.619943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.247191 (+627248us) service_pool.cc:224] Handling call
0709 13:09:24.724232 (+477041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.603211 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:24.727744 27410 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:24.504465 29478 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:24.552230 29345 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9.
I20260709 13:09:24.599643 29444 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:09:24.566609 29295 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.708551 29294 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.601655 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.639446 28970 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.639567 29216 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:24.659039 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.658185 29405 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.663501 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.790947 27267 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:24.574014 29477 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.689216 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.608193 29293 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.596076 29479 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:24.640523 29486 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:09:24.609336 29435 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:24.706446 29470 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.709471 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 209) took 1143 ms. Trace:
I20260709 13:09:24.514194 29340 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.631605 29448 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.610425 29418 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:24.712005 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 135843us
I20260709 13:09:24.844537 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:24.605258 29452 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:24.712450 27408 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:24.727051 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1119) took 1094 ms. Trace:
I20260709 13:09:24.785240 29294 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.580651 29464 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:24.735592 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.738161 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:24.739533 29487 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:09:24.576056 29408 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.877068 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1122) took 1237 ms. Trace:
I20260709 13:09:24.877516 27411 rpcz_store.cc:276] 0709 13:09:23.639967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.810174 (+1170207us) service_pool.cc:224] Handling call
0709 13:09:24.876566 (+ 66392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.876753 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.876776 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.876811 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.876840 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.876892 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.877012 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.690043 29436 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:24.741883 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1120) took 1102 ms. Trace:
I20260709 13:09:24.884405 27409 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:24.885070 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1124) took 1244 ms. Trace:
I20260709 13:09:24.885401 27409 rpcz_store.cc:276] 0709 13:09:23.640512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.883765 (+1243253us) service_pool.cc:224] Handling call
0709 13:09:24.884076 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.884823 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.885013 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.886906 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 211) took 1214 ms. Trace:
I20260709 13:09:24.764351 27265 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:24.714104 29084 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:24.763618 27338 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
W20260709 13:09:24.764111 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 59917.5us
I20260709 13:09:24.896508 27338 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.763175 29421 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.772912 29295 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.773921 28937 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.876855 29323 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.581089 29366 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.735304 29478 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.806145 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:24.819389 27414 rpcz_store.cc:276] 0709 13:09:23.566109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.403693 (+837584us) service_pool.cc:224] Handling call
0709 13:09:24.404065 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.543331 (+139266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.543366 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.543417 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.543449 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.709220 (+165771us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000bd6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:24.709275 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.709411 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319629568}
I20260709 13:09:24.900357 29084 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.774750 29292 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.850106 27413 rpcz_store.cc:276] 0709 13:09:23.638943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.725982 (+1087039us) service_pool.cc:224] Handling call
0709 13:09:24.726392 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.726627 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.726666 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.726721 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.726771 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.726841 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.726979 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.683019 28902 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:24.773006 29449 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.780755 29406 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:24.853166 27259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1831) took 1414 ms (client timeout 1544 ms). Trace:
I20260709 13:09:24.931428 29314 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:24.931931 27259 rpcz_store.cc:269] 0709 13:09:23.438250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.597451 (+159201us) service_pool.cc:224] Handling call
0709 13:09:24.852904 (+1255453us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b54001f86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.853083 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220961152}
I20260709 13:09:24.933457 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.934191 27259 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.934477 29314 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.854292 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:24.935529 27341 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.776340 29433 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.849534 29340 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.941813 29340 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.887988 29338 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.889061 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:24.943233 27336 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.888049 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.890960 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1123) took 1250 ms. Trace:
I20260709 13:09:24.947583 27262 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:24.947463 27411 rpcz_store.cc:276] 0709 13:09:23.640227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.878679 (+1238452us) service_pool.cc:224] Handling call
0709 13:09:24.878990 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.890623 (+ 11633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.890657 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.890701 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.890732 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.890789 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.890905 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.882858 27410 rpcz_store.cc:276] 0709 13:09:23.639346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.728547 (+1089201us) service_pool.cc:224] Handling call
0709 13:09:24.741165 (+ 12618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.741402 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.741449 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.741505 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:24.741560 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.741658 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.741815 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.948778 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.949407 27262 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:24.892920 27409 rpcz_store.cc:276] 0709 13:09:23.672767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.886130 (+1213363us) service_pool.cc:224] Handling call
0709 13:09:24.886407 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.886594 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.886621 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.886659 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.886695 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.886745 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.886855 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.950506 27409 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:24.951120 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1129) took 1027 ms. Trace:
I20260709 13:09:24.951480 27409 rpcz_store.cc:276] 0709 13:09:23.924203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.950016 (+1025813us) service_pool.cc:224] Handling call
0709 13:09:24.950310 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.950876 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.951065 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.952777 27409 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:24.952950 29474 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:24.953364 29474 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:24.954213 29474 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.771302 29320 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.897105 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:24.955744 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 58725.9us
I20260709 13:09:24.857142 29464 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:24.957399 29464 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:24.959499 29488 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:24.960213 29488 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:24.717226 29451 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.888060 29465 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.961160 29488 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.961762 29451 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.902410 28010 raft_consensus.cc:2410] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:09:24.962949 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 308) took 1179 ms. Trace:
W20260709 13:09:24.896878 29419 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.004s
I20260709 13:09:24.963421 29465 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:24.903383 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 432528us
I20260709 13:09:24.963447 28010 rpcz_store.cc:276] 0709 13:09:23.783074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.794679 (+ 11605us) service_pool.cc:224] Handling call
0709 13:09:24.962853 (+1168174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.964234 29451 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:24.967002 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:24.967391 27261 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:24.968477 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.968881 27413 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:24.969120 27264 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:24.969327 27261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 194) took 1638 ms (client timeout 1717 ms). Trace:
I20260709 13:09:24.969576 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1126) took 1190 ms. Trace:
I20260709 13:09:24.970009 27413 rpcz_store.cc:276] 0709 13:09:23.779524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.915929 (+1136405us) service_pool.cc:224] Handling call
0709 13:09:24.968540 (+ 52611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.969275 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.969506 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.969959 27261 rpcz_store.cc:269] 0709 13:09:23.330821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.096908 (+766087us) service_pool.cc:224] Handling call
0709 13:09:24.969115 (+872207us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54001f77d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.969254 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734248192}
I20260709 13:09:24.913012 28999 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.777004 29476 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:24.975296 29411 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:24.976204 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.030s	sys 0.061s
I20260709 13:09:24.976049 29411 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:24.976696 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.031s	sys 0.062s
W20260709 13:09:24.977341 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 906962us
I20260709 13:09:24.902211 29420 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:24.901592 29408 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:24.962271 27416 raft_consensus.cc:2393] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:24.981552 27342 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:24.987743 29449 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.988296 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1630) took 1570 ms. Trace:
I20260709 13:09:24.988358 29449 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:24.989128 27337 rpcz_store.cc:276] 0709 13:09:23.417879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.433991 (+ 16112us) service_pool.cc:224] Handling call
0709 13:09:24.988054 (+1554063us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002887d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:24.988227 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171749760}
I20260709 13:09:24.993652 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:24.998980 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:24.802032 29216 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:25.009361 29216 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.002985 27335 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:25.003137 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1833) took 1506 ms. Trace:
I20260709 13:09:25.024943 27261 rpcz_store.cc:276] 0709 13:09:23.496745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.993291 (+1496546us) service_pool.cc:224] Handling call
0709 13:09:25.003066 (+  9775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.003521 29420 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.004786 29411 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.063877 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.064607 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1053) took 3115 ms. Trace:
I20260709 13:09:25.065021 27261 rpcz_store.cc:276] 0709 13:09:21.949481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.063714 (+3114233us) service_pool.cc:224] Handling call
0709 13:09:25.064033 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.064229 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.064263 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.064309 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.064358 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.064428 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.064549 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.066300 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:25.006105 27265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1080) took 1597 ms (client timeout 1937 ms). Trace:
I20260709 13:09:25.007740 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.066370 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:25.067986 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60342.4us
I20260709 13:09:25.068768 27261 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:25.069041 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:25.067384 27265 rpcz_store.cc:269] 0709 13:09:23.409100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.499275 (+1090175us) service_pool.cc:224] Handling call
0709 13:09:25.005944 (+506669us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003340d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.006047 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606965120}
I20260709 13:09:25.070669 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.016206 27264 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:24.848436 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.071082 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:25.072548 27265 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:25.033331 27336 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:25.074141 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.075269 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.071947 27262 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:25.109385 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:25.052109 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1811) took 2194 ms (client timeout 2437 ms). Trace:
W20260709 13:09:25.124423 27266 rpcz_store.cc:269] 0709 13:09:22.857751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.314250 (+1456499us) service_pool.cc:224] Handling call
0709 13:09:25.051860 (+737610us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001b80d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.052026 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640870144}
W20260709 13:09:25.057178 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.060633 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.002s	sys 0.024s
I20260709 13:09:25.000649 27233 leader_election.cc:400] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:25.127041 27233 leader_election.cc:403] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:25.077015 29465 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.077173 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.077718 29449 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.076378 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.136145 27264 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:25.079909 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:25.137364 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57528.4us
W20260709 13:09:25.137564 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.850925 29435 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:25.081259 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.139430 27265 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:25.081890 27267 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:25.087491 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.088060 29320 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:25.088943 29345 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:25.089598 29292 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:25.091262 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.091883 29411 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:25.092586 27260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1819) took 2041 ms (client timeout 2142 ms). Trace:
W20260709 13:09:25.161214 27260 rpcz_store.cc:269] 0709 13:09:23.050773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.095563 (+1044790us) service_pool.cc:224] Handling call
0709 13:09:25.092407 (+996844us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54000b0754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.092523 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752495872}
W20260709 13:09:25.094080 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.011s	sys 0.016s
W20260709 13:09:25.162313 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.016s
W20260709 13:09:25.162678 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 754966us
W20260709 13:09:25.163847 27381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.021s	sys 0.019s
W20260709 13:09:25.164198 27381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.021s	sys 0.019s
I20260709 13:09:25.097031 27259 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:25.098629 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.100365 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:25.106155 28014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.014s	sys 0.016s
I20260709 13:09:25.106952 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:25.134342 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:25.112949 27334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.008s	sys 0.021s
I20260709 13:09:25.126798 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.220641 27340 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.221271 27340 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:25.220053 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57088.4us
W20260709 13:09:25.220981 27334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.009s	sys 0.022s
W20260709 13:09:25.127712 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.002s	sys 0.024s
W20260709 13:09:25.219254 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 119008us
I20260709 13:09:25.218578 27261 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.156348 29451 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
W20260709 13:09:25.169893 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 78743.5us
I20260709 13:09:25.226195 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.228461 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:25.128293 27382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.012s	sys 0.006s
W20260709 13:09:25.230085 27382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.012s	sys 0.006s
I20260709 13:09:25.170990 27414 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:25.169376 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:25.162609 29435 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:25.113305 29314 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:25.134779 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 134316us
I20260709 13:09:25.258193 27233 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.112138 28902 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:25.080500 29437 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:25.140444 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.150954 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.259766 27266 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:25.153647 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 210) took 1587 ms. Trace:
I20260709 13:09:25.260502 27415 rpcz_store.cc:276] 0709 13:09:23.566384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.704883 (+1138499us) service_pool.cc:224] Handling call
0709 13:09:24.820537 (+115654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.820796 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.820833 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:24.820892 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.820938 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.821015 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.153391 (+332376us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000e8b50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.153563 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264878464}
I20260709 13:09:25.156348 27411 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:25.197901 27306 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.647s (SENT)
I20260709 13:09:25.262176 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:25.155542 28943 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.217451 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1596) took 1811 ms. Trace:
I20260709 13:09:25.528642 27417 rpcz_store.cc:276] 0709 13:09:23.406463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.406618 (+   155us) service_pool.cc:224] Handling call
0709 13:09:25.217246 (+1810628us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54000ada54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.217383 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298135936}
I20260709 13:09:25.217710 27268 raft_consensus.cc:2410] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:09:25.218384 28014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.021s
I20260709 13:09:25.040904 29420 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.232788 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.128983 27262 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:25.532856 27267 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:25.231812 27264 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.533736 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1810) took 2677 ms. Trace:
I20260709 13:09:25.534173 27267 rpcz_store.cc:276] 0709 13:09:22.856603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.491438 (+2634835us) service_pool.cc:224] Handling call
0709 13:09:25.529060 (+ 37622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.533414 (+  4354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.533672 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.223313 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:25.159771 29345 consensus_queue.cc:1243] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:25.256114 27261 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:25.038039 27341 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:25.538174 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1638) took 1004 ms. Trace:
I20260709 13:09:25.256419 27340 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.539408 27340 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:25.539522 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 306827us
I20260709 13:09:25.540788 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:25.541775 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 318528us
I20260709 13:09:25.543598 27262 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:25.469134 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 212) took 1795 ms. Trace:
I20260709 13:09:25.285842 28937 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.161670 28010 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:25.489444 27260 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:09:25.337262 28902 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.525586 29497 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.344679 29477 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:09:25.317464 29451 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.265793 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.316390 29411 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.162873 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.281955 29366 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.339526 29435 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:25.302821 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44746.7us
W20260709 13:09:25.264272 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 123953us
I20260709 13:09:25.299350 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.344521 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.315990 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:25.327240 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.293589 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:25.336426 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:25.316627 29338 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.263981 29449 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:09:25.586226 29449 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:25.585858 29338 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.586685 29449 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:25.587643 29449 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.588814 29449 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.589026 29338 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:25.266860 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:25.590219 29494 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:09:25.590319 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 323582us
I20260709 13:09:25.552579 29437 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:25.263103 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 65250.5us
I20260709 13:09:25.326025 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.217908 29295 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.166457 29292 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.217729 29320 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:25.487373 27343 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.003s
I20260709 13:09:25.219599 28999 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:25.223556 29476 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.332708 29339 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:25.257469 29314 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.298214 29418 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.324875 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.614615 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1641) took 1079 ms. Trace:
I20260709 13:09:25.288092 29454 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.615803 29454 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:25.616530 29454 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.615272 27337 rpcz_store.cc:276] 0709 13:09:24.536045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.005117 (+469072us) service_pool.cc:224] Handling call
0709 13:09:25.005513 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:25.058129 (+ 52616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.058156 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:25.077047 (+ 18891us) log.cc:844] Serialized 52 byte log entry
0709 13:09:25.284796 (+207749us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:25.315418 (+ 30622us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.315842 (+   424us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.316013 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.316097 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.614304 (+298207us) raft_consensus.cc:1685] finished
0709 13:09:25.614332 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.614521 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52216,"prepare.queue_time_us":31686,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":75,"raft.queue_time_us":70821,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":27223,"spinlock_wait_cycles":84864,"thread_start_us":207273,"threads_started":1,"wal-append.queue_time_us":505799}
I20260709 13:09:25.372373 29419 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:25.619874 29419 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.621618 28902 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.622092 29419 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:25.492451 27265 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:25.623222 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:25.623643 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1812) took 2764 ms. Trace:
I20260709 13:09:25.624056 27265 rpcz_store.cc:276] 0709 13:09:22.858835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.491767 (+2632932us) service_pool.cc:224] Handling call
0709 13:09:25.492173 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.623370 (+131197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.623587 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.318179 29474 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.299355 29493 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.627442 29493 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:25.627720 29502 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:25.627840 29493 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.631047 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 230) took 1127 ms. Trace:
W20260709 13:09:25.632180 27268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 193) took 2301 ms (client timeout 2035 ms). Trace:
I20260709 13:09:25.633015 27335 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:09:25.632761 27268 rpcz_store.cc:269] 0709 13:09:23.330404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.534862 (+1204458us) service_pool.cc:224] Handling call
0709 13:09:25.631907 (+1097045us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54001f8bd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.632088 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567299968}
I20260709 13:09:25.322691 28978 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:25.622922 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 232) took 1048 ms. Trace:
I20260709 13:09:25.636036 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 226) took 1252 ms. Trace:
I20260709 13:09:25.636480 27339 rpcz_store.cc:276] 0709 13:09:24.383710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.980950 (+597240us) service_pool.cc:224] Handling call
0709 13:09:24.981350 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.058078 (+ 76728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.058111 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.058624 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.378744 (+320120us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.378792 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.378877 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.635804 (+256927us) raft_consensus.cc:1685] finished
0709 13:09:25.635825 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.635975 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76251,"raft.queue_time_us":85292,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":30208,"thread_start_us":254123,"threads_started":1,"wal-append.queue_time_us":453861}
I20260709 13:09:25.396458 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 214) took 1602 ms. Trace:
I20260709 13:09:25.531700 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 450) took 1750 ms. Trace:
I20260709 13:09:25.304154 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1128) took 1439 ms. Trace:
I20260709 13:09:25.544584 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1813) took 2684 ms. Trace:
I20260709 13:09:25.639046 27262 rpcz_store.cc:276] 0709 13:09:22.859920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.542991 (+2683071us) service_pool.cc:224] Handling call
0709 13:09:25.543363 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.544315 (+   952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.544528 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.377888 29464 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.641011 29065 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:25.641489 29065 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:25.642746 29464 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.538573 27341 rpcz_store.cc:276] 0709 13:09:24.533550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.802636 (+269086us) service_pool.cc:224] Handling call
0709 13:09:25.538112 (+735476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.544420 27414 rpcz_store.cc:276] 0709 13:09:23.673647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.907086 (+1233439us) service_pool.cc:224] Handling call
0709 13:09:25.170547 (+263461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.230990 (+ 60443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.468846 (+237856us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400087850. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.469055 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584133888}
I20260709 13:09:25.547283 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1809) took 2692 ms. Trace:
I20260709 13:09:25.644371 27260 rpcz_store.cc:276] 0709 13:09:22.855199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.488674 (+2633475us) service_pool.cc:224] Handling call
0709 13:09:25.489049 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.546969 (+ 57920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.547214 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.645905 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1070) took 2713 ms. Trace:
I20260709 13:09:25.646229 27260 rpcz_store.cc:276] 0709 13:09:22.932657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.645146 (+2712489us) service_pool.cc:224] Handling call
0709 13:09:25.645449 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.645606 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.645634 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.645674 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.645700 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.645748 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.645850 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.642474 29065 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.550810 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:25.377158 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.018s	sys 0.014s
W20260709 13:09:25.663404 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.032s	sys 0.017s
W20260709 13:09:25.664145 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 819679us
I20260709 13:09:25.665053 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.537827 29420 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:25.567081 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 301345us
I20260709 13:09:25.574945 27264 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:25.635526 27336 rpcz_store.cc:276] 0709 13:09:24.575186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.132752 (+557566us) service_pool.cc:224] Handling call
0709 13:09:25.133272 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.134122 (+   850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.134169 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.135583 (+  1414us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.525471 (+389888us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:25.525523 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.525620 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.622661 (+ 97041us) raft_consensus.cc:1685] finished
0709 13:09:25.622685 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.622854 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":131,"spinlock_wait_cycles":765184,"thread_start_us":295096,"threads_started":1,"wal-append.queue_time_us":453288}
I20260709 13:09:25.575495 28013 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:25.577221 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.670253 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:25.670855 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 93770.7us
I20260709 13:09:25.671485 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.672425 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.578176 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.578979 27415 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:25.673316 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.579651 27259 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:25.582247 29478 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.669s	user 0.012s	sys 0.000s
I20260709 13:09:25.566260 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.545765 28937 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.687455 28937 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:25.687634 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 109567us
I20260709 13:09:25.688450 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.576167 27266 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 2.
I20260709 13:09:25.547870 29481 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:25.564169 29497 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:25.692126 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 125941us
I20260709 13:09:25.694350 29498 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.694422 29497 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:25.694765 29498 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.695216 29498 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.695339 28015 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:25.348875 29479 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.552387 28943 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:25.697458 28943 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.698632 29479 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.699282 29479 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.699646 29479 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.700002 29479 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.700294 29512 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.700733 29512 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.701169 29512 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.556074 29499 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:25.603433 27343 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.007s	sys 0.003s
I20260709 13:09:25.638456 28014 rpcz_store.cc:276] 0709 13:09:23.781301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.781459 (+   158us) service_pool.cc:224] Handling call
0709 13:09:23.781835 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.782077 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:24.507613 (+725536us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.530655 (+1023042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.530735 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:25.530803 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.530930 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.531106 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1013168,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":807,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5558,"thread_start_us":1670527,"threads_started":2,"wal-append.queue_time_us":869954}
I20260709 13:09:25.703584 29499 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:25.703927 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1798) took 2390 ms. Trace:
I20260709 13:09:25.563673 29411 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.704382 29339 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.704742 29464 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:25.704914 29411 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.705325 29464 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:25.706210 29464 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.707329 29084 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.709208 29084 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:25.709623 29084 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.606285 27261 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:25.704707 28943 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.610716 29476 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.704530 29499 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.714102 29476 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:25.714243 28943 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.612857 29292 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:25.613368 28010 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:25.712378 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1817) took 2847 ms. Trace:
W20260709 13:09:25.614128 29504 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:09:25.715078 27261 rpcz_store.cc:276] 0709 13:09:22.865307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.543372 (+2678065us) service_pool.cc:224] Handling call
0709 13:09:25.543695 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.711351 (+167656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.712153 (+   802us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b5400319cd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:25.712325 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143212416}
I20260709 13:09:25.613672 29320 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.605363 28009 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:25.631459 27342 rpcz_store.cc:276] 0709 13:09:24.503451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.020689 (+517238us) service_pool.cc:224] Handling call
0709 13:09:25.021105 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.073556 (+ 52451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.073588 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:25.074203 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.497200 (+422997us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:25.497262 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.497363 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.630765 (+133402us) raft_consensus.cc:1685] finished
0709 13:09:25.630826 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.630985 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52019,"raft.queue_time_us":53217,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":19491,"thread_start_us":344379,"threads_started":1,"wal-append.queue_time_us":474942}
I20260709 13:09:25.634474 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1644) took 1036 ms. Trace:
I20260709 13:09:25.637812 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.549347 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.717501 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:25.718134 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 168867us
I20260709 13:09:25.718792 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.719041 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1072) took 2766 ms. Trace:
I20260709 13:09:25.638866 27410 rpcz_store.cc:276] 0709 13:09:23.865280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.949281 (+1084001us) service_pool.cc:224] Handling call
0709 13:09:25.218439 (+269158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.218643 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.218669 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.218708 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.218745 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.218800 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.303877 (+ 85077us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000ada50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.304064 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618188544}
I20260709 13:09:25.647441 27263 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:25.661864 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1071) took 2718 ms. Trace:
I20260709 13:09:25.704298 27343 rpcz_store.cc:276] 0709 13:09:23.313157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.334988 (+ 21831us) service_pool.cc:224] Handling call
0709 13:09:23.335444 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.335737 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:24.421206 (+1085469us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.703565 (+1282359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.703624 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:25.703669 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.703738 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.703848 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48322,"prepare.queue_time_us":57375,"prepare.run_cpu_time_us":648,"prepare.run_wall_time_us":6851,"raft.queue_time_us":23847,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":52894,"thread_start_us":2367011,"threads_started":3,"wal-append.queue_time_us":491371}
I20260709 13:09:25.719494 27264 rpcz_store.cc:276] 0709 13:09:22.952241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.669632 (+2717391us) service_pool.cc:224] Handling call
0709 13:09:25.675275 (+  5643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.675515 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.675554 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.675613 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.675663 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.675738 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.718864 (+ 43126us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b540032a850. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.718990 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12300544}
I20260709 13:09:25.720574 27260 rpcz_store.cc:276] 0709 13:09:22.943300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.647082 (+2703782us) service_pool.cc:224] Handling call
0709 13:09:25.661220 (+ 14138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.661446 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.661479 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.661534 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:25.661576 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.661644 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.661787 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.638346 27411 rpcz_store.cc:276] 0709 13:09:23.794335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.948584 (+1154249us) service_pool.cc:224] Handling call
0709 13:09:25.156144 (+207560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.261817 (+105673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.396146 (+134329us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000e9550. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.396370 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476629248}
W20260709 13:09:25.666217 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74604.1us
I20260709 13:09:25.674952 27267 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:25.677500 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 126774us
I20260709 13:09:25.673386 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.564975 29451 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:25.594794 29488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.023s	sys 0.048s
I20260709 13:09:25.679931 29366 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:09:25.680301 29408 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.004s
W20260709 13:09:25.726904 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53585.3us
I20260709 13:09:25.728001 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:25.680626 28902 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:25.730525 28902 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:25.730942 28902 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.731073 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:25.733624 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:25.680408 28999 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:25.680477 29500 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.681159 29478 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.676839 29418 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.680310 29437 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.683202 29433 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:25.725423 29488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.023s	sys 0.049s
I20260709 13:09:25.696964 29065 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.600183 29495 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.563584 29477 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.639740 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1814) took 1343 ms. Trace:
I20260709 13:09:25.749101 29216 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.676785 29448 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.723348 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.748162 29500 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:25.736775 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1815) took 2874 ms. Trace:
I20260709 13:09:25.736922 27981 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.794338 27267 rpcz_store.cc:276] 0709 13:09:22.862513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.545051 (+2682538us) service_pool.cc:224] Handling call
0709 13:09:25.674763 (+129712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.722775 (+ 48012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.736608 (+ 13833us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000b86d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.736723 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267680640}
W20260709 13:09:25.794983 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58136.3us
I20260709 13:09:25.614631 29314 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:25.748591 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1081) took 1821 ms (client timeout 1874 ms). Trace:
I20260709 13:09:25.753813 29476 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.752125 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:25.691653 29510 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.804572 29510 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.805141 29510 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.783358 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.757077 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:25.815286 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58319.9us
I20260709 13:09:25.736505 29492 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:09:25.705003 29339 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.817304 28011 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:25.749713 29338 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.752276 29465 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.786123 27338 rpcz_store.cc:276] 0709 13:09:24.296510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.899472 (+602962us) service_pool.cc:224] Handling call
0709 13:09:24.899804 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.973176 (+ 73372us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:24.973548 (+   372us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.483403 (+509855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.483464 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.483509 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.639452 (+155943us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b54002da354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:25.639503 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.639669 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21598,"prepare.queue_time_us":5529,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":18668,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":16169,"spinlock_wait_cycles":168086272,"thread_start_us":496432,"threads_started":1,"wal-append.queue_time_us":564678}
I20260709 13:09:25.802151 29366 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:25.789535 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66259us
I20260709 13:09:25.828702 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.829704 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:25.752802 29345 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.716776 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:25.753938 29481 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:25.791358 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 194754us
W20260709 13:09:25.835616 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.799773 27263 rpcz_store.cc:269] 0709 13:09:23.938809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.624880 (+686071us) service_pool.cc:224] Handling call
0709 13:09:25.748379 (+1123499us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000b81d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.748530 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341856512}
I20260709 13:09:25.801827 29500 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:25.801990 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.760499 29495 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.785759 29408 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.754670 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:25.816644 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.821028 29339 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:25.822038 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 69991.9us
I20260709 13:09:25.821247 29338 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.820263 29515 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.717509 27335 rpcz_store.cc:276] 0709 13:09:24.598185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.219735 (+621550us) service_pool.cc:224] Handling call
0709 13:09:25.632729 (+412994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:25.633663 (+   934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.634283 (+   620us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540013f950. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:25.634408 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939792640}
I20260709 13:09:25.749029 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1073) took 2788 ms. Trace:
I20260709 13:09:25.827759 29465 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:25.838266 28978 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:25.816072 29493 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:25.843761 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 47983.7us
I20260709 13:09:25.815719 29513 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.849263 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.815339 29476 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.818318 27267 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:25.851207 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:25.837826 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 155609us
I20260709 13:09:25.824905 28943 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:25.829075 29448 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:25.851644 29408 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:25.802448 29216 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.862859 27259 rpcz_store.cc:276] 0709 13:09:22.960973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.674405 (+2713432us) service_pool.cc:224] Handling call
0709 13:09:25.748380 (+ 73975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.748580 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.748618 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.748678 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:25.748727 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.748803 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.748954 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.808480 29295 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.833858 29366 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:25.864603 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 110005us
I20260709 13:09:25.888602 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:25.837886 27338 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:25.833685 29345 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:25.859297 29338 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.835224 29481 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:25.842784 27306 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.840s (SENT)
I20260709 13:09:25.901603 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:25.867486 29465 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.801036 29411 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:25.876788 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1076) took 2504 ms. Trace:
I20260709 13:09:25.879750 29448 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.856992 29497 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.879518 27981 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9.
I20260709 13:09:25.871670 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:25.902621 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 59887.1us
I20260709 13:09:25.849726 29495 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.878592 29492 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.907296 27267 rpcz_store.cc:276] 0709 13:09:23.372331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.795280 (+2422949us) service_pool.cc:224] Handling call
0709 13:09:25.817917 (+ 22637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.876530 (+ 58613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.876731 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.871599 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:25.891705 29366 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:25.877192 29514 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.880419 29408 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.876636 28978 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:25.878793 29521 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:25.931095 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52741.9us
I20260709 13:09:25.882284 29515 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:25.889149 28943 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:25.948176 27306 leader_election.cc:336] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.895s (SENT)
W20260709 13:09:26.038628 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 90483.2us
W20260709 13:09:26.039563 27306 leader_election.cc:336] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.974s (SENT)
W20260709 13:09:25.949255 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 70977.3us
I20260709 13:09:26.040315 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1068) took 3112 ms. Trace:
I20260709 13:09:25.891355 29345 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:25.904778 29481 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:25.935155 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 92923.7us
I20260709 13:09:25.889914 29517 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:25.951319 27268 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:25.900589 29295 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:25.951562 27259 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:25.973941 29452 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:26.028985 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1078) took 2630 ms. Trace:
I20260709 13:09:26.070073 27263 rpcz_store.cc:276] 0709 13:09:23.399199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.836825 (+2437626us) service_pool.cc:224] Handling call
0709 13:09:25.837122 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.903997 (+ 66875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:25.904038 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.904095 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:25.904134 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.028635 (+124501us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54003039d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:26.028697 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.028898 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153336064}
I20260709 13:09:26.032683 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:26.088649 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.088958 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56355.8us
I20260709 13:09:26.040491 29448 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:25.932979 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61456.1us
I20260709 13:09:26.040771 27262 rpcz_store.cc:276] 0709 13:09:22.927625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.640175 (+2712550us) service_pool.cc:224] Handling call
0709 13:09:25.640507 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.640702 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:25.872532 (+231830us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.039906 (+167374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.040005 (+    99us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:26.040059 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.040129 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.040257 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28153,"prepare.queue_time_us":263676,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"thread_start_us":398557,"threads_started":2}
I20260709 13:09:25.901105 29496 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:09:25.932976 29497 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:26.055325 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1065) took 3146 ms. Trace:
I20260709 13:09:26.096073 27265 rpcz_store.cc:276] 0709 13:09:22.908429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.624836 (+2716407us) service_pool.cc:224] Handling call
0709 13:09:25.625206 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.625441 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:25.832768 (+207327us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.054881 (+222113us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.054946 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:26.055009 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.055086 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.055256 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47315,"prepare.queue_time_us":262548,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":15029,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":21022,"thread_start_us":428494,"threads_started":3,"wal-append.queue_time_us":228328}
W20260709 13:09:25.981101 29511 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:09:26.060050 27267 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.103533 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1825) took 2678 ms. Trace:
I20260709 13:09:26.103994 27267 rpcz_store.cc:276] 0709 13:09:23.424706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.997400 (+2572694us) service_pool.cc:224] Handling call
0709 13:09:26.059796 (+ 62396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.103272 (+ 43476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.103476 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:25.900741 29418 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.108326 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1066) took 3193 ms. Trace:
I20260709 13:09:26.108851 27268 rpcz_store.cc:276] 0709 13:09:22.915053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.634059 (+2719006us) service_pool.cc:224] Handling call
0709 13:09:25.634466 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.063592 (+429126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.108084 (+ 44492us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001b85d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:26.108260 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728235904}
I20260709 13:09:25.878718 29513 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.019940 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1821) took 2888 ms. Trace:
I20260709 13:09:26.063668 29517 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:26.065172 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1824) took 2640 ms. Trace:
I20260709 13:09:26.025254 29479 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.115978 27259 rpcz_store.cc:276] 0709 13:09:23.424461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.906547 (+2482086us) service_pool.cc:224] Handling call
0709 13:09:25.951347 (+ 44800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.064924 (+113577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.065117 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.117725 27259 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:25.981637 29433 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:25.997449 29323 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.119495 29323 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.118314 29512 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.090752 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:25.932356 29492 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:26.121600 29433 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:25.908756 29451 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.098413 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1829) took 2660 ms. Trace:
I20260709 13:09:26.118453 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1832) took 2622 ms. Trace:
I20260709 13:09:26.051915 29478 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:26.122844 27263 rpcz_store.cc:276] 0709 13:09:23.437657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.087514 (+2649857us) service_pool.cc:224] Handling call
0709 13:09:26.087823 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.088008 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.088037 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.088078 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:26.088110 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.088161 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.097872 (+  9711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.124222 29478 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:26.112166 27262 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:26.126185 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1830) took 2688 ms. Trace:
I20260709 13:09:26.123694 27259 rpcz_store.cc:276] 0709 13:09:23.496387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.117084 (+2620697us) service_pool.cc:224] Handling call
0709 13:09:26.117496 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.118127 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.118377 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.126693 27262 rpcz_store.cc:276] 0709 13:09:23.437939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.111701 (+2673762us) service_pool.cc:224] Handling call
0709 13:09:26.111993 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.125860 (+ 13867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.126116 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.126546 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1082) took 2095 ms. Trace:
I20260709 13:09:26.128780 27262 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:26.111488 27260 rpcz_store.cc:276] 0709 13:09:23.131765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.737982 (+2606217us) service_pool.cc:224] Handling call
0709 13:09:25.738356 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.738611 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:25.878448 (+139837us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.019462 (+141014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.019542 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:26.019606 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.019695 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.019860 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286682,"raft.queue_time_us":108,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":24574,"spinlock_wait_cycles":22060160,"thread_start_us":262935,"threads_started":2}
I20260709 13:09:26.130270 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1085) took 1900 ms. Trace:
I20260709 13:09:26.131031 27260 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:26.131914 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1834) took 1879 ms. Trace:
I20260709 13:09:26.132302 27260 rpcz_store.cc:276] 0709 13:09:24.252580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.130241 (+1877661us) service_pool.cc:224] Handling call
0709 13:09:26.130605 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.131588 (+   983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.131845 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.120086 29323 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:25.891820 29454 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.122042 29492 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:26.091728 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 199495us
I20260709 13:09:26.091955 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:26.069967 29452 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:26.128892 27263 rpcz_store.cc:276] 0709 13:09:24.031750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.124637 (+2092887us) service_pool.cc:224] Handling call
0709 13:09:26.125292 (+   655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.125521 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:26.125573 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.125630 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:26.126280 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.126362 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.126491 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:26.065093 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 193487us
I20260709 13:09:26.102391 29499 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:25.979664 29514 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.130759 27262 rpcz_store.cc:276] 0709 13:09:24.230311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.128183 (+1897872us) service_pool.cc:224] Handling call
0709 13:09:26.128551 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.129991 (+  1440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.130201 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.104595 29497 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.186044 27263 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:26.136147 28943 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:26.186733 29537 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.186843 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1836) took 1888 ms. Trace:
I20260709 13:09:26.191605 27263 rpcz_store.cc:276] 0709 13:09:24.298277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.178172 (+1879895us) service_pool.cc:224] Handling call
0709 13:09:26.178469 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.186538 (+  8069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.186769 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:26.187798 27259 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:26.066586 29515 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:09:26.182816 29452 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.137167 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:26.202140 29523 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:09:26.202900 29474 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.577s	user 0.020s	sys 0.002s
W20260709 13:09:26.205897 29420 consensus_meta.cc:287] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.000s
I20260709 13:09:26.184368 28009 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:26.137135 29517 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.210199 27263 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.211199 27262 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:09:26.218024 27262 pending_rounds.cc:85] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:09:26.218374 27262 pending_rounds.cc:107] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:09:26.218724 27262 raft_consensus.cc:2889] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:26.220290 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.220772 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:26.221558 27262 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.180171 29477 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.135371 29512 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.213135 27260 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.190773 29499 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:26.206390 29420 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.246312 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1820) took 3162 ms. Trace:
I20260709 13:09:26.266595 27264 rpcz_store.cc:276] 0709 13:09:23.083794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.749617 (+2665823us) service_pool.cc:224] Handling call
0709 13:09:25.784660 (+ 35043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.784904 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:09:25.853709 (+ 68805us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.245950 (+392241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.246007 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:26.246059 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.246134 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.246254 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":240509,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":25945,"thread_start_us":425282,"threads_started":2}
I20260709 13:09:26.193725 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:26.269403 27263 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:26.179566 28978 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.268175 28012 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:26.293496 27266 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:26.271822 29418 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.302901 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:26.271624 29493 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.197036 29537 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.307401 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1818) took 3327 ms. Trace:
W20260709 13:09:26.300154 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89300.9us
I20260709 13:09:26.308768 27410 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.312014 27261 rpcz_store.cc:276] 0709 13:09:22.980320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.723036 (+2742716us) service_pool.cc:224] Handling call
0709 13:09:25.723355 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:25.723543 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:26.062360 (+338817us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.306872 (+244512us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:26.306955 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:26.307044 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.307131 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.307324 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":250727,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":116,"thread_start_us":582566,"threads_started":2}
W20260709 13:09:26.321889 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 228433us
I20260709 13:09:26.299829 29216 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.358827 27262 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:26.305586 29538 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.309803 29477 raft_consensus.cc:2764] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:26.305968 29411 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.327809 29295 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:26.492244 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:26.493788 27306 leader_election.cc:336] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.692s (SENT)
I20260709 13:09:26.353914 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:26.356030 29437 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 13:09:26.476791 29435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.015s	sys 0.012s
W20260709 13:09:26.502415 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 442159us
I20260709 13:09:26.350414 29500 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.574517 29526 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.577093 27262 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.317572 29418 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.370477 29493 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:09:26.492266 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:26.503654 29527 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
W20260709 13:09:26.665995 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.354630 29474 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.142s
W20260709 13:09:26.509646 29498 consensus_meta.cc:287] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.004s
W20260709 13:09:26.508654 29435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.016s	sys 0.012s
I20260709 13:09:26.370873 29366 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.494014 29512 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:26.345376 29481 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:26.647083 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 137882us
I20260709 13:09:26.663635 27414 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:26.579492 29477 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.584985 29454 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.638284 29479 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.598274 29513 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:26.475728 29538 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.475406 29499 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:26.697813 29530 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.497s	user 0.004s	sys 0.007s
I20260709 13:09:26.787761 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1083) took 2670 ms. Trace:
I20260709 13:09:26.788224 27259 rpcz_store.cc:276] 0709 13:09:24.117290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.127985 (+2010695us) service_pool.cc:224] Handling call
0709 13:09:26.128390 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.192618 (+ 64228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.787525 (+594907us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b540031f1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:26.787703 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135801216}
W20260709 13:09:26.790436 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.004s	sys 0.016s
W20260709 13:09:26.790916 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.004s	sys 0.016s
W20260709 13:09:26.773391 28902 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.042s	user 0.008s	sys 0.012s
I20260709 13:09:26.740708 29477 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:26.763224 29435 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.828698 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 256350us
W20260709 13:09:26.788674 29532 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.517s	user 0.000s	sys 0.003s
I20260709 13:09:26.779788 29514 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:26.836388 27380 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:26.667503 29526 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.793610 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:26.822023 29339 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.957s	user 0.010s	sys 0.000s
I20260709 13:09:26.842118 27380 leader_election.cc:403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:09:26.692375 29498 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.795152 29444 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:26.764794 29512 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:26.832159 29492 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.645s	user 0.012s	sys 0.000s
I20260709 13:09:26.799150 29420 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:26.899434 27410 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.001s
I20260709 13:09:26.900790 27410 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:26.793342 29437 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:26.830646 29454 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.849674 29525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.018s	sys 0.020s
I20260709 13:09:26.881778 29444 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:26.885059 28937 consensus_meta.cc:287] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.197s	user 0.013s	sys 0.001s
I20260709 13:09:26.882735 29339 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.885608 29366 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:26.890802 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 88931.1us
W20260709 13:09:26.908843 29525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.019s	sys 0.020s
I20260709 13:09:26.893399 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:26.826694 29547 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:26.827049 28902 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.899609 29492 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.843518 29542 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:09:26.830870 29435 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:26.940438 27233 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.004s	sys 0.008s
W20260709 13:09:26.955914 27233 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.004s	sys 0.008s
W20260709 13:09:26.956357 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 867001us
W20260709 13:09:26.942509 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 191226us
W20260709 13:09:26.922307 29465 consensus_meta.cc:287] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.990s	user 0.007s	sys 0.009s
W20260709 13:09:26.912477 29540 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
W20260709 13:09:26.915138 29314 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.100s	user 0.004s	sys 0.004s
W20260709 13:09:26.924773 28999 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.189s	user 0.010s	sys 0.001s
W20260709 13:09:26.925384 29551 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:09:26.965844 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.920948 29526 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.911199 29498 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:26.913250 29500 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:26.900123 29340 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:26.919615 28937 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.912385 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:26.922075 29481 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.913427 29537 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.921273 29339 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:26.913241 29510 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.108s	user 0.021s	sys 0.001s
W20260709 13:09:26.918385 29323 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.784s	user 0.025s	sys 0.007s
W20260709 13:09:26.992057 29452 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.783s	user 0.006s	sys 0.003s
I20260709 13:09:27.011958 29452 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.930575 29454 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.012578 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.013921 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.014209 29452 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.958231 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:26.938468 29517 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.001s
I20260709 13:09:27.015729 29517 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.016772 29538 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:27.017132 29435 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.932914 29437 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.017895 29517 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:27.018724 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.017s	sys 0.011s
W20260709 13:09:27.019629 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.017s	sys 0.011s
W20260709 13:09:26.911818 29550 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:09:26.918646 29474 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:26.971583 27338 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:26.973268 29555 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.003s
W20260709 13:09:26.994679 29449 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.405s	user 0.007s	sys 0.006s
I20260709 13:09:26.922592 29512 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:26.957521 29465 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.032971 29465 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:26.979633 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.937575 29366 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:26.970463 29543 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:09:26.994745 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1835) took 2710 ms. Trace:
I20260709 13:09:27.035346 29366 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.035521 27260 rpcz_store.cc:276] 0709 13:09:24.284562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.133228 (+1848666us) service_pool.cc:224] Handling call
0709 13:09:26.133630 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.224413 (+ 90783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.994485 (+770072us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54003142d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:26.994679 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182334336}
I20260709 13:09:26.959920 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:26.992455 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:26.959892 29448 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.853s	user 0.000s	sys 0.012s
I20260709 13:09:26.919363 29444 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:26.982630 29345 consensus_meta.cc:287] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.915s	user 0.005s	sys 0.009s
I20260709 13:09:26.977118 28999 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:26.902231 29477 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:26.973330 29559 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:27.000038 29552 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:27.025076 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:27.040483 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 82336.6us
I20260709 13:09:27.068922 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:27.047612 29495 consensus_meta.cc:287] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.097s	user 0.022s	sys 0.003s
W20260709 13:09:27.021209 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 695751us
W20260709 13:09:27.023962 29084 consensus_meta.cc:287] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.309s	user 0.015s	sys 0.000s
I20260709 13:09:26.951071 29547 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:26.974967 29314 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:27.027480 29549 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.347s	user 0.001s	sys 0.000s
I20260709 13:09:26.992159 29418 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.015048 29454 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:26.986183 29340 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:26.997189 28009 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.717s	user 0.004s	sys 0.004s
I20260709 13:09:27.069702 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:27.080968 29444 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:27.043455 29521 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.013s	sys 0.004s
I20260709 13:09:27.042497 29517 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.079264 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:27.053215 29345 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.022378 29510 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.119978 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.023749 29323 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.053352 29554 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.029870 29481 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:27.126096 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.127698 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.129225 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:27.095791 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 129220us
W20260709 13:09:27.097141 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 260890us
I20260709 13:09:27.066473 29542 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:26.991652 28937 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.132448 29572 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:27.132853 29572 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:27.133747 29572 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.135119 29572 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.136102 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:27.106017 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.106405 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.109483 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.082086 29495 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.113198 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:27.079818 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.012s	sys 0.043s
W20260709 13:09:27.118935 29338 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.212s	user 0.019s	sys 0.015s
W20260709 13:09:27.141865 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.013s	sys 0.043s
I20260709 13:09:27.117659 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:27.142318 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 950213us
I20260709 13:09:27.142689 27417 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.121449 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.122054 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.143869 27408 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:27.046399 29448 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:27.111451 29521 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.013s	sys 0.004s
I20260709 13:09:27.145852 29521 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:27.146389 29448 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.137452 27409 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:27.109303 28999 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:27.146780 29521 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.147555 28999 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:27.147981 28999 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.141393 28011 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:27.107501 28009 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:27.082679 29084 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.155972 27413 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.155849 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.119254 29437 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.163565 28014 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:27.123807 29567 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:27.126014 29568 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:27.140177 29454 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:27.119774 29517 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.160142 28937 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:27.179920 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.163730 28902 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.189522 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:27.168247 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 333) took 1072 ms. Trace:
I20260709 13:09:27.195407 27417 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:27.172396 29492 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:27.203138 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.207540 27260 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:27.203776 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.203486 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.204052 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.210474 27265 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:27.206451 27263 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:27.212421 27265 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:27.213338 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.208678 27260 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:09:27.204387 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.205722 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.217449 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.166489 28943 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:09:27.221510 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1074) took 4257 ms. Trace:
I20260709 13:09:27.170711 29567 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:27.158762 29338 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.188027 29437 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:09:27.221920 27266 rpcz_store.cc:276] 0709 13:09:22.963688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.691593 (+2727905us) service_pool.cc:224] Handling call
0709 13:09:25.691879 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:26.294358 (+602479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:27.221292 (+926934us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54001d88d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:27.221450 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383186176}
I20260709 13:09:27.222996 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.186038 29454 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.225768 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.229317 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.229954 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.188444 28937 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:27.232484 29366 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.236037 29576 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:27.196725 28009 rpcz_store.cc:276] 0709 13:09:26.091497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.091654 (+   157us) service_pool.cc:224] Handling call
0709 13:09:27.164090 (+1072436us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:27.190923 29568 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.185678 29474 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:09:27.240078 29340 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.240320 29476 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.176800 29465 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:09:27.171285 29556 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:09:27.229579 29526 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:27.224788 27261 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:27.190490 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.242854 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.187016 28007 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:27.208670 27417 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:27.230626 29560 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:09:27.180473 29544 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:09:27.179571 29566 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:09:27.205063 29525 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:27.277241 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81483.9us
I20260709 13:09:27.222235 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:27.224150 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:27.219456 29435 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:09:27.232543 29571 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
W20260709 13:09:27.600456 29574 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:09:27.601034 29517 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.285617 27266 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:27.282073 27262 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:27.442405 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:27.295499 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 100484us
I20260709 13:09:27.606691 27265 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:27.607722 27259 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.608039 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.303087 27416 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:09:27.432381 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.609267 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.608178 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.618031 27263 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:27.623037 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.538946 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.625746 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.626482 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.627668 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.629200 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.630200 27336 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:27.631207 27341 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:27.278082 29065 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.495s	user 0.014s	sys 0.000s
I20260709 13:09:27.270896 29479 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:27.601960 29517 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.633337 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.692134 27413 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:27.694775 27338 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:27.701738 27336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:27.702771 27336 raft_consensus.cc:606] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:27.703892 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:27.707906 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 88487.2us
W20260709 13:09:27.364568 29580 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:27.299396 29084 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.299572 29314 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.411759 29448 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.319175 29345 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.747740 28013 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:27.624878 28943 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.752624 27340 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:27.767814 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.768327 29448 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.753955 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.770370 27417 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:27.770802 29448 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.462286 29547 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.759686 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.765285 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.602347 29548 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.473s
I20260709 13:09:27.771485 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:27.627246 28937 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.735723 27268 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:27.279800 29567 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:27.843606 29454 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.815348 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:27.776314 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:27.779906 27337 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:27.780601 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:27.721064 29474 consensus_queue.cc:1243] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:09:27.521526 28999 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.715224 29340 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:27.774717 29497 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.577s	user 0.016s	sys 0.002s
I20260709 13:09:27.820415 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.758109 29576 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:27.781972 28943 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:27.858397 29444 consensus_meta.cc:287] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.002s
I20260709 13:09:27.772045 29565 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.721242 29479 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.715040 29517 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.761147 29065 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.873535 29582 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 13:09:27.864897 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.889513 28006 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:27.930416 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:27.856292 29338 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:27.931201 29065 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.696098 29521 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:27.931988 29578 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.421s	user 0.001s	sys 0.000s
W20260709 13:09:27.890230 29408 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.864s	user 0.014s	sys 0.002s
I20260709 13:09:27.963179 29408 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.963924 29561 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.964350 29561 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:27.868714 29340 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:27.940449 28010 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 347) took 1734 ms (client timeout 1692 ms). Trace:
W20260709 13:09:27.941004 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 349) took 1734 ms (client timeout 1647 ms). Trace:
I20260709 13:09:27.816675 29510 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:27.959280 29065 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.931455 29565 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:27.948593 29583 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:09:27.934634 28937 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.867769 29497 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.892119 29576 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.969358 29525 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:27.977574 29340 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.978868 29437 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.978444 29561 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.979280 29437 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:27.980506 29568 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.979811 29561 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.982333 29545 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.982686 29545 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:27.968683 29521 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.983465 29545 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.984416 29545 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.985103 29521 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.988190 29517 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.988044 29525 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.989114 29479 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.989471 29495 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.990935 29492 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.991330 29492 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:27.992272 29497 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:27.992139 29492 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:27.993319 29492 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:27.994364 29554 consensus_meta.cc:287] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.000s
I20260709 13:09:27.994801 29554 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:27.997140 29589 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:27.997586 29589 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:27.998167 29576 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:27.998354 29589 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:27.994468 29538 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:27.984830 29567 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.002514 29538 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:28.002750 29589 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:28.003437 29538 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.004189 29567 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:28.004694 29538 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:27.773473 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 64627.4us
W20260709 13:09:28.035957 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.040s	sys 0.046s
W20260709 13:09:28.036736 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.040s	sys 0.046s
I20260709 13:09:28.038340 27259 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:28.044689 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.046249 27337 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:27.829114 27336 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:28.048446 27343 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:28.048609 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.049823 27339 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:27.814635 27263 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:28.052942 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.054627 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.055771 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:27.849767 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.059388 27411 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:28.060892 27417 raft_consensus.cc:2393] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:27.969251 28006 rpcz_store.cc:269] 0709 13:09:26.206441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.760623 (+1554182us) service_pool.cc:224] Handling call
0709 13:09:27.937393 (+176770us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:27.967609 28010 rpcz_store.cc:269] 0709 13:09:26.205922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.751116 (+545194us) service_pool.cc:224] Handling call
0709 13:09:27.930227 (+1179111us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:27.940250 (+ 10023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19968256}
W20260709 13:09:28.064399 28036 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:09:28.064675 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.066766 28937 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:28.067771 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.068600 29408 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:28.068789 29340 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.068852 29448 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.070529 29454 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.071794 29479 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:28.081282 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.098261 28009 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.103734 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.107525 27337 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:28.108891 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.111093 27337 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.116322 28008 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:28.117417 29340 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.120276 29448 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:28.111543 27234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.007s
I20260709 13:09:28.122777 29479 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:28.123533 27234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.007s	sys 0.007s
W20260709 13:09:28.129065 27233 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 2.056s (SENT) [suppressed 47 similar messages]
I20260709 13:09:28.129179 27339 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:28.130551 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.130666 29517 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.131949 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.132989 29454 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.134974 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:28.176994 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.176138 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.178187 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.178413 29448 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.179206 27413 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.179960 29454 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.180236 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.180665 27412 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:28.181149 27413 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:28.181973 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.182143 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.183097 27413 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.183064 27412 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.186875 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.188231 27336 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:28.193642 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.173141 29517 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.202113 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:28.205837 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.220993 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.222321 27336 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:28.235702 29340 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.236416 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.239490 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.239862 27412 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.237720 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.244271 27339 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.185303 29479 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.246500 27410 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.247407 27268 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:28.248361 27409 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.249763 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.250067 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 467) took 2003 ms. Trace:
I20260709 13:09:28.250643 28011 rpcz_store.cc:276] 0709 13:09:26.246094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.107310 (+861216us) service_pool.cc:224] Handling call
0709 13:09:27.122686 (+ 15376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.153805 (+ 31119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.249358 (+1095553us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b54004d30d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.249806 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42536192}
I20260709 13:09:28.252575 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 336) took 2154 ms. Trace:
I20260709 13:09:28.253376 27335 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.253121 28014 rpcz_store.cc:276] 0709 13:09:26.097741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.097988 (+   247us) service_pool.cc:224] Handling call
0709 13:09:26.098267 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.167526 (+1069259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.251919 (+1084393us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54004d49d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.252329 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445391104}
I20260709 13:09:28.259851 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:28.260931 27259 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.264384 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:28.265307 27264 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.266073 28978 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:28.266605 28978 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:28.269809 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:28.270946 27263 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:28.271993 29323 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.273602 29320 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:28.274143 29320 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:28.275669 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.277120 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.278133 27410 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:28.277606 29437 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.298182 27259 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:28.279099 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.558221 27413 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
W20260709 13:09:28.652179 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.543066 27338 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:28.311570 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.278962 29437 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.281682 29345 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:28.363085 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.531298 27335 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:28.419380 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.24535e+06us
W20260709 13:09:28.635846 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.373752 27264 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:28.363379 27412 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:28.292948 29517 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.338739 29493 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.292316 29539 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:28.652863 29603 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:28.423321 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83676.1us
I20260709 13:09:28.723546 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.412062 28999 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:28.706903 29565 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:28.705204 28943 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:28.739857 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1816) took 1129 ms. Trace:
I20260709 13:09:28.344010 29320 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.726478 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.395941 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:28.727594 29545 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.005s
W20260709 13:09:28.673834 29589 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.010s
I20260709 13:09:28.411805 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:28.417796 28978 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:28.708581 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 302833us
I20260709 13:09:28.736523 27410 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.671407 29572 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:28.735864 29345 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:28.744058 27335 rpcz_store.cc:276] 0709 13:09:27.607193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.607315 (+   122us) service_pool.cc:224] Handling call
0709 13:09:28.193190 (+585875us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:28.736946 (+543756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18590976}
I20260709 13:09:28.747107 27413 raft_consensus.cc:2376] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:28.748236 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.754246 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.751559 29544 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.756402 29544 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.757490 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.758348 27337 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:28.758764 29544 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.759331 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.761260 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:28.765844 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.767720 29602 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:09:28.768087 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1826) took 1071 ms. Trace:
I20260709 13:09:28.768569 27341 rpcz_store.cc:276] 0709 13:09:27.696221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.696872 (+   651us) service_pool.cc:224] Handling call
0709 13:09:27.697270 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.738356 (+ 41086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:27.738403 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:27.738460 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:27.738511 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.767485 (+1028974us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b540014b4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.767568 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:28.767802 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93848832}
I20260709 13:09:28.769357 29320 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.771641 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.773226 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.773469 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.774075 27410 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:28.774369 27414 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.775183 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.776463 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:28.777087 27414 raft_consensus.cc:2376] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
W20260709 13:09:28.769702 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.771801 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:28.778086 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.769901 27259 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:28.739884 29539 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:28.775022 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.780864 27410 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.781599 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.783157 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.786059 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.787240 27415 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.751796 29572 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:28.788981 27415 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:28.790267 29572 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:28.790871 27380 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.600s (SENT)
I20260709 13:09:28.791827 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:28.789661 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1616) took 1082 ms. Trace:
I20260709 13:09:28.794468 27415 rpcz_store.cc:276] 0709 13:09:27.706892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.787946 (+1081054us) service_pool.cc:224] Handling call
0709 13:09:28.788438 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.789354 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.789581 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:28.795186 27342 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:28.802481 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1823) took 1173 ms. Trace:
I20260709 13:09:28.802114 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:28.807518 27412 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.808434 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.779402 29493 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:28.802891 27342 rpcz_store.cc:276] 0709 13:09:27.629131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.636324 (+  7193us) service_pool.cc:224] Handling call
0709 13:09:28.760893 (+1124569us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:28.802426 (+ 41533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19048704}
I20260709 13:09:28.812196 28999 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:28.821825 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.823838 27413 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.821595 27414 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:28.826514 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1610) took 1618 ms. Trace:
I20260709 13:09:28.796468 29603 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:28.826931 27413 rpcz_store.cc:276] 0709 13:09:27.208158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.794322 (+1586164us) service_pool.cc:224] Handling call
0709 13:09:28.826444 (+ 32122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:28.829335 27410 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:28.829902 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1161) took 1715 ms. Trace:
I20260709 13:09:28.830164 27410 rpcz_store.cc:276] 0709 13:09:27.114264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.790431 (+1676167us) service_pool.cc:224] Handling call
0709 13:09:28.806764 (+ 16333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.829710 (+ 22946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.829862 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:28.826033 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.835794 29603 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:28.836488 29545 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:28.838415 28978 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.843716 27410 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:28.844329 28008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 470) took 1708 ms. Trace:
I20260709 13:09:28.844748 28008 rpcz_store.cc:276] 0709 13:09:27.136263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.817738 (+681475us) service_pool.cc:224] Handling call
0709 13:09:28.844033 (+1026295us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400750154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:28.844231 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332409600}
I20260709 13:09:28.847028 27410 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:28.850507 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1156) took 1740 ms. Trace:
I20260709 13:09:28.851625 27410 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:28.852067 27410 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:28.853358 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.853109 27410 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:28.854745 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.849066 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.847914 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.854939 27410 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.850898 27416 rpcz_store.cc:276] 0709 13:09:27.110484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.160727 (+ 50243us) service_pool.cc:224] Handling call
0709 13:09:27.161054 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:27.609176 (+448122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.849955 (+1240779us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540015bb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.850315 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325932800}
I20260709 13:09:28.858314 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.860342 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:28.861878 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 114196us
W20260709 13:09:28.864125 29586 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 1.324s	user 0.003s	sys 0.007s
I20260709 13:09:28.868687 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.869477 27336 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:28.856392 29517 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:28.872367 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.873035 27416 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:28.881592 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.882436 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.858031 29345 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:28.882179 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.889245 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.860598 29539 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:28.892951 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 111257us
I20260709 13:09:28.900058 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.894033 29517 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:28.903328 29517 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:28.903436 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.906179 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.908387 27413 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:28.909379 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.910286 27341 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:28.911074 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.911768 27341 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:28.912057 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 334) took 2819 ms. Trace:
I20260709 13:09:28.912618 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.912578 28007 rpcz_store.cc:276] 0709 13:09:26.092906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.096623 (+  3717us) service_pool.cc:224] Handling call
0709 13:09:26.576912 (+480289us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:26.577115 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.631299 (+1054184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.911620 (+1280321us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540043bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.911899 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419617920}
I20260709 13:09:28.913626 27341 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.914512 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.915804 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 337) took 2816 ms. Trace:
I20260709 13:09:28.916056 29539 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.920783 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.922250 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.922796 27342 raft_consensus.cc:2376] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:28.916218 28013 rpcz_store.cc:276] 0709 13:09:26.100402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.100775 (+   373us) service_pool.cc:224] Handling call
0709 13:09:26.101082 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:27.766862 (+1665780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.915342 (+1148480us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540060f754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.915627 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786228480}
I20260709 13:09:28.926694 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.931752 29477 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:28.932974 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1827) took 1212 ms. Trace:
I20260709 13:09:28.933403 27338 rpcz_store.cc:276] 0709 13:09:27.720870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.721352 (+   482us) service_pool.cc:224] Handling call
0709 13:09:27.721677 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.734427 (+1012750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.932674 (+198247us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b54000e2754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.932893 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874495232}
I20260709 13:09:28.934770 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:28.936203 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.928666 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.937359 27336 raft_consensus.cc:2376] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:28.940183 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.942066 27335 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.939260 27342 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:28.945057 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.946240 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:28.948468 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:28.948834 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.949152 27261 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.951735 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 219) took 2796 ms. Trace:
I20260709 13:09:28.952167 27411 rpcz_store.cc:276] 0709 13:09:26.155050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.155264 (+   214us) service_pool.cc:224] Handling call
0709 13:09:26.186242 (+ 30978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:28.098566 (+1912324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.951440 (+852874us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000bd6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:28.951658 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4306064640}
I20260709 13:09:28.949075 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.956772 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.957633 27335 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:28.957952 27268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 1858) took 1745 ms (client timeout 1903 ms). Trace:
I20260709 13:09:28.955488 29345 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:28.958824 27335 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:28.962752 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:28.958384 27268 rpcz_store.cc:269] 0709 13:09:27.212117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.222022 (+  9905us) service_pool.cc:224] Handling call
0709 13:09:28.957734 (+1735712us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540024b3d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:28.957882 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262598912}
I20260709 13:09:28.965816 27334 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:28.964617 27338 raft_consensus.cc:2376] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4. Re-sending same reply.
I20260709 13:09:28.968905 27414 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:28.970032 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:28.973374 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:28.975243 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.976158 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.976585 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.976878 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.977177 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.982689 29538 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.887s	user 0.010s	sys 0.006s
I20260709 13:09:28.983635 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:28.987435 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:28.969368 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.684s (SENT)
I20260709 13:09:28.987898 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:28.988189 28012 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:28.988914 28006 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:28.989248 27380 leader_election.cc:336] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.690s (SENT)
I20260709 13:09:28.990022 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:28.990695 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:28.991420 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:28.992158 28011 raft_consensus.cc:2393] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:28.990094 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:28.993074 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:28.994061 28009 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:28.994638 27409 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
W20260709 13:09:28.984548 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.994963 29437 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:28.990247 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.996073 27980 connection.cc:256] RPC call timeout handler was delayed by -1.0619939499999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:09:29.001135 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.002246 27416 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:29.003116 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:29.003676 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.004788 27412 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:29.004653 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:29.005934 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:28.967588 29493 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:29.003948 28013 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.007138 27412 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:28.982936 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:29.017807 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:29.018362 27306 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.647s (SENT)
W20260709 13:09:29.020128 27306 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.874s (SENT)
I20260709 13:09:29.020720 27306 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:29.021109 27408 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.007988 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.023607 29559 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:29.024641 29559 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.025025 29559 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:29.026079 29559 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.028105 29559 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.009666 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:29.008433 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:29.032344 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.035318 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.010039 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.040562 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:29.041322 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 52158.7us
I20260709 13:09:29.048336 27342 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:29.039801 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.049989 27414 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:29.033938 29589 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:09:29.053419 29589 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.053795 29589 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:29.055558 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.055801 27343 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:29.056348 27413 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:29.057174 27343 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.064057 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.064942 27415 raft_consensus.cc:2410] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:29.064850 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.065795 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.047710 27416 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:29.071671 27408 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:29.059358 29496 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.075306 27412 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:29.082422 27410 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:29.083997 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.084560 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.086159 27261 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:29.087296 27262 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:29.090863 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.091607 28013 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:29.092376 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.094494 28999 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.017871 28007 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:29.095641 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:29.084013 29512 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:09:29.054791 29589 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:29.103677 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71489.8us
I20260709 13:09:29.104409 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.096879 28978 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.103315 27267 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:29.102945 27417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1613) took 1827 ms (client timeout 2139 ms). Trace:
I20260709 13:09:29.107089 28011 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:29.109210 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:29.111831 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.119962 27340 raft_consensus.cc:2376] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4. Re-sending same reply.
W20260709 13:09:29.112128 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0962238150000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:09:29.112332 29496 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.120944 28008 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 3 LEARNER]: Advancing to term 5
W20260709 13:09:29.121274 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.113375 27259 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:29.120062 28999 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:29.118996 27417 rpcz_store.cc:269] 0709 13:09:27.274016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.771000 (+496984us) service_pool.cc:224] Handling call
0709 13:09:29.094288 (+1323288us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54000bdbd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:29.100901 (+  6613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503289728}
I20260709 13:09:29.130451 27262 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:09:29.130534 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.132253 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.132484 27261 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:29.132977 27268 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:29.135285 28012 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:29.136089 28015 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:29.136960 29542 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.137499 29542 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.143467 29493 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:29.144523 29493 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.145139 29493 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:29.143777 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.146361 29493 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.144583 29477 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:29.146392 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.148232 29493 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.149359 29496 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.149748 29536 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.150125 29320 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:29.150455 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.169703 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.156699 28999 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.159360 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.172693 27334 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:29.151041 27267 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:29.166760 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.171294 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.164304 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:29.162878 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.201040 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.171481 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:29.187261 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64134.9us
I20260709 13:09:29.159884 27414 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.160730 27416 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:29.177634 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.210045 27413 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:29.168570 27415 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:09:29.162155 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:29.159057 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.157811 27410 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.164065 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:29.212455 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 192434us
I20260709 13:09:29.213485 27337 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.163578 27411 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.219915 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.220268 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.221441 27339 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:29.221280 27165 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.223069 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58839.9us
I20260709 13:09:29.224084 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.223496 27165 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.225229 29477 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:29.226118 29559 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:29.226173 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.210616 27415 pending_rounds.cc:85] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 3
W20260709 13:09:29.163904 28015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 335) took 3070 ms (client timeout 1692 ms). Trace:
I20260709 13:09:29.225886 27165 catalog_manager.cc:5697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.228293 27409 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.225910 29477 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:29.226756 29559 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:29.231818 29542 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:29.200876 29575 consensus_queue.cc:1175] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "203d83f7fac847e0beee51aa18513b25" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:09:29.232833 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.233062 29559 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.234879 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.235594 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.235877 27343 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.236199 28006 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:29.228809 28015 rpcz_store.cc:269] 0709 13:09:26.093225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.093347 (+   122us) service_pool.cc:224] Handling call
0709 13:09:27.179751 (+1086404us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:29.163667 (+1983916us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b54006617d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:29.163795 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4537959424}
I20260709 13:09:29.236493 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:29.237308 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.219960 29437 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.238116 29437 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.238320 27336 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:29.238499 29437 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.237212 27339 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:29.240610 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:29.231068 29477 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.241804 27340 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:29.228344 27415 pending_rounds.cc:107] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:29.242892 27415 raft_consensus.cc:2889] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:29.226739 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:29.244174 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 136642us
I20260709 13:09:29.245853 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:29.153175 29606 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.346s	user 0.002s	sys 0.001s
I20260709 13:09:29.248701 27410 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.200551 29589 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.250133 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.151059 29496 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:29.250895 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 100591us
I20260709 13:09:29.254163 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:29.249300 27380 leader_election.cc:336] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.773s (SENT)
I20260709 13:09:29.251742 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.255415 27335 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:29.255581 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.256349 27341 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:29.151237 29536 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.256821 29539 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.257251 29536 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.257362 29539 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.258075 29539 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.247641 27408 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
W20260709 13:09:29.259605 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.212106 29320 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.251950 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.263062 27409 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:29.263622 27165 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:29.261523 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.272289 27410 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.271840 27165 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.264691 27416 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:29.274927 27415 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:29.273854 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.276542 27165 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.254001 29542 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:29.280170 27408 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:29.267131 29320 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.284348 27412 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:29.287315 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.288995 28999 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.289091 27165 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.291062 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.292765 27415 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:29.291446 27165 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 2, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 2 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:29.288789 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.281761 29542 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:29.297071 29345 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:29.297557 29345 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.297930 29345 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.300964 28999 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:29.301429 29570 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:29.302201 29546 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:29.302503 28999 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.302625 29546 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:29.302968 28999 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:29.283317 29496 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.303874 29546 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.304370 28978 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.305261 29546 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.314147 29496 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.303874 28999 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.315608 27165 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 4, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:29.316676 28999 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.317467 27165 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.323225 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.324246 27408 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.326509 29512 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.327152 29512 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.328487 27408 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:29.329759 29512 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:29.334146 29559 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:29.339147 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 47118.2us
W20260709 13:09:29.342079 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 45543.1us
I20260709 13:09:29.343418 27267 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:29.343333 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 94055.7us
I20260709 13:09:29.344081 27165 catalog_manager.cc:5697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.345835 29570 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:09:29.350147 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.338877 29542 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.362293 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:29.362303 29500 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:29.363092 29570 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.366818 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.366652 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.367578 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.353003 27341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41a124c306f9418a8556266f795a58b3"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:29.383571 27341 raft_consensus.cc:606] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:29.383957 27341 raft_consensus.cc:614] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:29.367741 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.381594 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 210) took 1113 ms. Trace:
I20260709 13:09:29.385372 27335 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.365914 29345 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.369930 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.372164 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.375020 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.387488 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.388129 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.385746 27263 rpcz_store.cc:276] 0709 13:09:28.265272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:28.273873 (+  8601us) service_pool.cc:224] Handling call
0709 13:09:28.274325 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:28.302556 (+ 28231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:28.302606 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:28.395565 (+ 92959us) log.cc:844] Serialized 26 byte log entry
0709 13:09:28.729144 (+333579us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:28.729262 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:28.729401 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:28.934632 (+205231us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b48002907d8. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd87b5aaa1 00007fbd87b51b37 00007fbd87b519ca 00007fbd87c4926f 00007fbd87c48f37 00007fbd87c5d55c 00007fbd87c5d508 00007fbd87c5d488 00007fbd87c5d443 00007fbd87c5c6ec 00007fbd86b86a96
0709 13:09:29.152309 (+217677us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:29.378328 (+226019us) raft_consensus.cc:1685] finished
0709 13:09:29.378348 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:29.378496 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26419,"raft.run_cpu_time_us":3030,"raft.run_wall_time_us":632531,"spinlock_wait_cycles":29093376,"thread_start_us":323363,"threads_started":1,"wal-append.queue_time_us":386082}
I20260709 13:09:29.382400 29570 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:29.378556 29437 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:29.391067 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.391970 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.410244 27340 raft_consensus.cc:2376] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4. Re-sending same reply.
I20260709 13:09:29.392316 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.412436 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.413892 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.414809 27343 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:29.392743 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.393816 27342 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.395465 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.395629 27335 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:29.395932 29575 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:29.399726 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.416522 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.407748 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.381388 27165 catalog_manager.cc:5697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 5, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.409690 27339 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.416612 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.416900 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.419811 27334 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.405045 27336 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:29.420495 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.421015 29575 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.421977 29437 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:29.423352 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48399.7us
W20260709 13:09:29.424306 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.425141 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.425812 28999 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:29.426229 28999 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:29.426630 28999 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.428880 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.429697 27337 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:29.430821 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.431910 29546 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.419704 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.440815 27340 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.432814 27165 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 4, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.439828 27338 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:29.423038 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.443228 28999 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.403548 29496 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:09:29.407071 28008 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 5 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:09:29.446938 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51565.5us
W20260709 13:09:29.452764 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.446544 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 74486us
I20260709 13:09:29.455948 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.460889 29477 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.462405 29500 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.464401 28999 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:29.467826 29493 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.443426 29437 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.489754 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:29.495249 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 106749us
I20260709 13:09:29.497876 29575 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.498858 27383 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:29.482227 27165 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 4 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.477353 27340 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:29.433575 29539 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.513509 27165 catalog_manager.cc:5697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 3, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.515929 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 93001.7us
W20260709 13:09:29.518412 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50958.5us
I20260709 13:09:29.518316 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.486444 29493 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:29.508844 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83514.3us
I20260709 13:09:29.535912 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.525450 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:29.533536 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.538333 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:29.525552 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.541764 29623 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.543146 29623 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:29.545591 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.558269 28999 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.558950 28999 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:29.553325 27380 leader_election.cc:336] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.820s (SENT)
W20260709 13:09:29.562443 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52656.6us
W20260709 13:09:29.567773 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49552us
I20260709 13:09:29.568205 27342 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:29.569581 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.577593 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.544999 29493 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.506042 29437 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.571070 27165 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.581990 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.577414 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:29.583360 27342 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
W20260709 13:09:29.584134 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 80607.8us
I20260709 13:09:29.552930 29623 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:29.585742 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 181791us
I20260709 13:09:29.588456 28999 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.590351 27165 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 5, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.533427 29538 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:09:29.577132 29464 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.504026 29570 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.582139 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:29.613344 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.602219 29539 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:29.605728 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.606241 29542 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:29.607805 29615 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:29.608776 29345 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.609390 29628 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.616151 29570 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.594106 29559 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.593829 29537 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.172s
I20260709 13:09:29.589917 29623 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.618932 27260 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.619855 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:29.620646 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.621320 28999 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.589681 29536 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:29.623549 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 87458.5us
I20260709 13:09:29.624195 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:29.613160 28012 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:29.631801 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.649823 27264 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.597319 27165 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 3, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.629397 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.651724 27265 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:29.651914 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 55710.5us
I20260709 13:09:29.653075 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.638706 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.639112 27259 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:29.654385 27266 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.638787 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.639786 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.640736 27267 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:29.642010 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.655239 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.642740 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:29.599619 29617 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.656508 27340 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.659289 27261 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:29.659212 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.656762 29628 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:29.662334 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.662979 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.663426 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.664031 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:29.688879 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.664613 29538 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:29.695299 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.695617 27259 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:29.696000 27268 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:29.690694 28006 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:29.696769 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.835s (SENT)
I20260709 13:09:29.699941 27408 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.668550 28008 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.669943 29624 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.709930 27264 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:29.711227 27165 catalog_manager.cc:5697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:29.693612 29628 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:29.712342 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 97885.9us
I20260709 13:09:29.697546 29538 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.716084 27165 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 5, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:09:29.755932 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 89848.6us
I20260709 13:09:29.715759 29538 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:29.706455 29437 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:29.763482 27165 catalog_manager.cc:5697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:29.759491 29537 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.757347 29628 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.777751 27260 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:29.784783 29625 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.784916 29629 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
W20260709 13:09:29.784785 29631 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:09:29.786701 29477 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:29.789690 27267 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:29.789882 27266 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:29.798815 27340 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:29.801857 27408 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:29.728216 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.744405 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:29.817245 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 164268us
I20260709 13:09:29.821403 29537 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.823741 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.824399 28978 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.825026 29619 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:29.825560 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.826189 29500 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.826995 29622 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:29.827981 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:29.828550 28999 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:29.831629 29620 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.831902 29320 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.814019 29542 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:29.843153 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.803377 29536 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.850126 29617 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:29.878729 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:29.850028 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 130040us
I20260709 13:09:29.852850 29537 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:29.853461 27415 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:29.854161 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 139696us
I20260709 13:09:29.813517 29624 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:29.862315 29620 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:29.894294 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 68824.5us
I20260709 13:09:29.861783 29464 raft_consensus.cc:2764] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:29.865438 27410 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:29.898218 27263 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:29.880391 27268 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:29.881220 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:29.899541 27380 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.856s (SENT)
I20260709 13:09:29.864301 27412 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:29.890934 27233 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.895351 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:29.896773 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 55459.1us
W20260709 13:09:29.852633 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.901576 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.902261 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.902410 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.908021 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:29.910782 27265 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.910979 27267 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:09:29.909047 29626 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:29.900717 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:29.911834 27259 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:29.845513 29625 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.902693 28978 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:29.920780 28999 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:29.921347 28999 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:29.921705 28978 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:29.922339 28978 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.910012 29624 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:29.924647 29623 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.922441 28999 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.924841 29624 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.926172 28999 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:29.946380 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:29.946517 29477 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:29.947849 27338 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:29.948618 27263 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:09:29.949494 29589 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.949658 29537 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.950022 29589 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:29.951113 29537 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.952170 29575 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.954107 29589 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.954742 27267 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:29.944885 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.958297 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:29.959282 27340 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:29.960625 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:29.895802 29570 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:09:29.968281 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54096.4us
I20260709 13:09:29.898399 29617 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:29.968374 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 73095.3us
I20260709 13:09:29.928730 29621 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:09:29.973224 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:29.943141 28943 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:29.928977 29626 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:29.975122 29619 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:29.973086 29493 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.979490 29620 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:29.997224 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:29.997802 29620 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.987052 29538 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.001343 29538 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:29.967988 29641 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:29.980952 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 88664.6us
I20260709 13:09:30.005730 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:29.981284 29464 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:29.981983 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:29.981333 29575 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:29.973482 29437 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:30.010649 27260 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:29.972667 29589 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:09:29.985766 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91027.8us
I20260709 13:09:29.915535 29320 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:29.929412 29542 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:29.927083 29623 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:29.994103 27265 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:30.008386 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:30.009618 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.006054 28006 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.995500 29619 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.019663 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:30.020320 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 45980.7us
I20260709 13:09:30.030732 27268 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:30.019465 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.010694 29575 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:30.037345 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 174293us
I20260709 13:09:30.017670 29538 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.006804 29477 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:30.043038 27260 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:30.038844 27262 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:30.041124 27261 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
W20260709 13:09:30.046283 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64391.8us
I20260709 13:09:30.046772 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:30.049377 27380 leader_election.cc:336] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.000s (SENT)
I20260709 13:09:30.049933 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.050848 27981 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.036432 29638 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:30.061317 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.061592 27260 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:30.062407 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.062932 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.063330 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.032966 29542 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:30.053170 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.071310 27412 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:30.071564 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.053587 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.054044 29619 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.038766 29512 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:30.055394 29539 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.055397 29640 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:30.056013 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.072757 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.073005 27410 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:30.056402 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.036692 29641 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.077996 27259 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:30.039834 29575 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.073948 27416 raft_consensus.cc:2376] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6. Re-sending same reply.
W20260709 13:09:30.059700 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.064023 27409 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.065034 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.059571 29617 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.070061 29625 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:30.056574 29626 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.075140 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.082669 27266 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:30.085667 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.087617 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:30.091017 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60414d130cdc460696513fb91e20161f"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:30.091655 27340 raft_consensus.cc:606] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.091970 27340 raft_consensus.cc:614] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:30.093667 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.097604 27261 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:30.098541 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 92662.9us
I20260709 13:09:30.101480 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:30.073619 29640 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.078703 29546 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:30.107769 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:30.046346 29538 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.110047 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.085178 29500 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:30.112319 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.086414 28943 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.085561 29539 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:30.106261 29320 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:30.096033 29464 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:09:30.125331 28943 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.078083 29622 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:30.127887 29512 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.097411 29639 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:09:30.100549 29638 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:30.116070 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.111541 29493 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:30.122778 29538 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:30.108458 29640 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.119294 29645 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:30.120188 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.141716 29639 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:30.142107 29639 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.143040 29639 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.144557 29639 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.112720 29621 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:30.116045 29500 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.144208 28978 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.130095 29512 raft_consensus.cc:2764] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:09:30.110899 29546 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.145068 29621 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:30.165442 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 53165.9us
W20260709 13:09:30.166837 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53062.1us
I20260709 13:09:30.168735 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.130805 29320 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.145826 29645 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.165711 29500 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.141659 29437 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.120476 29624 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:09:30.173118 29621 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.196214 27340 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
W20260709 13:09:30.191816 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 59477.9us
I20260709 13:09:30.201853 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.203006 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.145985 29622 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:30.174703 29642 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:30.180212 29493 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.213322 29570 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.213445 29622 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:30.214103 29622 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.140595 29542 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.193403 29645 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.204777 29619 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:30.188694 29623 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:09:30.208860 29537 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:30.224668 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.214924 28006 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:30.230504 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48612.8us
I20260709 13:09:30.212728 29642 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.216856 29493 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.212177 29538 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:30.235420 29320 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.237238 29622 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.238533 29622 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.239655 28978 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.139865 29641 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.211905 29559 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:09:30.207830 29464 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:09:30.247925 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.275542 27415 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:30.276445 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:30.277077 27340 raft_consensus.cc:606] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.231381 29537 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.283098 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.234992 29493 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:30.277916 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:30.302408 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.280903 29644 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:30.281940 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.306279 27410 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:30.282559 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:30.283397 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.285002 27408 raft_consensus.cc:2410] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:30.285065 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.214938 29643 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 13:09:30.301471 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.303020 27416 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:30.300081 29537 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.300132 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:30.313786 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.309876 29643 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.218427 29539 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.220923 29650 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:09:30.274221 29538 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:30.250139 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:30.314677 28978 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:09:30.332224 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111631us
I20260709 13:09:30.239926 29437 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.336139 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.305740 29644 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.317416 29643 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.243537 29546 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.348026 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
W20260709 13:09:30.357529 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48937.3us
I20260709 13:09:30.358013 27340 raft_consensus.cc:606] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.358438 27340 raft_consensus.cc:614] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:30.357112 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 112833us
I20260709 13:09:30.332757 29620 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.366766 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:30.368182 28999 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:30.371838 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.338847 29652 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:30.386132 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:30.391409 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.402962 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66920.7us
I20260709 13:09:30.244082 29638 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.355449 29538 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.410254 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.351572 29464 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:09:30.416764 28999 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.347401 29634 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260709 13:09:30.444845 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.450565 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.459975 28999 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.351761 29659 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:09:30.462267 27408 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:30.480273 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.476963 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:30.433880 29546 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.339567 29642 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.491415 28999 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:30.496461 29658 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:09:30.499760 29634 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:09:30.501242 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.477427 28978 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:30.517457 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.485791 29650 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.499766 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:30.523224 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151477us
I20260709 13:09:30.524039 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:30.525017 29634 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.525282 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:30.526551 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46411.7us
I20260709 13:09:30.527879 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.483834 29644 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.449208 29538 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.519052 28943 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:30.539628 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.534433 28978 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:30.540361 29656 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:09:30.542124 29662 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:30.542910 29643 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.545388 29652 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:30.587028 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47979.2us
W20260709 13:09:30.545742 29664 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
W20260709 13:09:30.547035 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.589411 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.555927 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:30.564534 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.561282 29629 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:30.536764 29650 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.562192 28978 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:30.607604 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 327929us
I20260709 13:09:30.610608 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.590808 29652 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:30.606436 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 203253us
I20260709 13:09:30.598802 29644 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.597920 29629 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:30.619007 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 63178.8us
I20260709 13:09:30.621368 29663 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:30.624874 29650 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.624745 29645 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.626415 29619 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.627383 29671 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:30.627878 29671 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.628218 29671 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.636451 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.636819 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.612037 28978 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.646093 29674 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:30.646339 29650 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:30.612350 29641 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.562729 28943 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.627090 29645 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.626932 29619 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.632997 29629 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.659926 29464 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.665817 29464 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:30.667125 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.670769 29659 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:30.662153 29641 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:30.672494 29641 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.677214 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:30.703055 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58126.2us
I20260709 13:09:30.704845 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.694715 29512 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:09:30.707825 29669 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.708390 29669 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.709539 29512 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:30.709992 29512 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.710747 29669 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.710821 29512 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:30.712340 29575 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 13:09:30.705782 29477 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.688369 29500 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.719339 29642 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.721979 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:30.722148 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 45912.9us
I20260709 13:09:30.644237 29640 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:30.730181 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 165788us
I20260709 13:09:30.716331 28943 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:30.738667 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.739651 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:30.739899 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.666781 29464 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.763182 27417 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:30.764073 27342 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:30.765179 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.765892 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:30.765959 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:30.738272 29621 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.005s
I20260709 13:09:30.767043 27412 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.768635 27414 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:30.728258 29625 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.770669 29625 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.771703 29537 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.772805 29625 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.774312 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:30.774526 29537 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:30.775657 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 70913.4us
I20260709 13:09:30.775925 29681 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:30.737389 29512 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.774072 29477 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:30.777485 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 55569.8us
I20260709 13:09:30.782896 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.784003 28943 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:30.784497 28943 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.784854 28943 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.780138 29621 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:30.789510 29621 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:30.783905 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.791384 27410 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:30.716552 29320 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:09:30.795039 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.804811 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.805437 29477 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.805104 27261 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:30.807622 29570 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:30.729614 29671 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:30.812435 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.813135 27408 raft_consensus.cc:2376] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:30.814657 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:30.815447 27338 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:30.816838 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:30.817529 27342 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:30.818874 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53842.9us
I20260709 13:09:30.781325 29659 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:30.742116 29575 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:30.823777 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47210.4us
W20260709 13:09:30.874548 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91701.3us
I20260709 13:09:30.876320 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:30.878851 27267 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:09:30.883236 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:30.884145 27264 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:30.821391 29625 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.897437 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.903183 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.908088 27410 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:30.871779 29617 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:30.909345 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.881655 29663 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:30.919749 27409 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:30.923733 27412 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:30.924443 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:30.927758 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.958323 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:30.954347 27342 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:30.960209 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:30.958545 27413 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:30.963685 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:30.966884 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 92427.2us
I20260709 13:09:30.972133 27414 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:30.973152 27263 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:30.973279 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.973829 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:30.973973 27259 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:30.914752 29663 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:30.977408 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:30.981776 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:30.944332 29619 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:30.978029 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:30.943223 29641 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:30.970165 29589 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:30.913642 29625 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.004456 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:31.005869 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:30.907637 29629 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.014497 29700 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:31.019707 27259 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:31.022454 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:31.022612 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:31.023846 27408 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:31.025043 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.025539 27414 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:31.007082 29638 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:31.046741 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.003784 29589 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:31.017266 29626 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.018298 29700 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:31.088078 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 75793.1us
I20260709 13:09:31.092267 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.095378 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:31.072009 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 108803us
I20260709 13:09:31.097391 27259 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:31.013250 29617 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:31.078809 29536 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.079414 29686 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:31.088701 29626 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.008212 29641 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.096647 29666 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.116914 29684 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
W20260709 13:09:31.117780 29692 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:31.027572 29634 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:09:31.084731 29559 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:31.121006 27262 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:31.027824 29628 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:09:31.020516 29464 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:31.140206 27414 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:31.142941 29686 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:31.082705 28978 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.124967 29617 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:31.152181 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 242934us
I20260709 13:09:31.153684 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:31.187644 27408 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:31.086974 29477 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:31.155762 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 63180.4us
W20260709 13:09:31.105703 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 157696us
I20260709 13:09:31.111296 29638 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:31.191375 29477 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.158425 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63113.6us
I20260709 13:09:31.135864 29626 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.191759 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.110355 29639 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:09:31.120198 29536 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.192996 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:31.157840 29575 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.191886 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.166323 29570 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:31.165863 29559 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.165557 29671 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.198745 27408 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:31.225737 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.191826 29477 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:31.232940 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.233431 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.232028 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.110916 29663 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:31.238386 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46606.1us
W20260709 13:09:31.225842 29652 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.012s
I20260709 13:09:31.153040 29666 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.151798 29589 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.253993 29617 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:31.264906 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73212.8us
I20260709 13:09:31.231673 29559 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.265797 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.287676 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.234503 29575 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.230238 29542 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:09:31.310213 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44499.4us
I20260709 13:09:31.311121 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:31.309048 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 129871us
I20260709 13:09:31.314152 27408 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:31.326261 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:31.340658 27414 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:31.345520 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.290488 29625 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.307744 29629 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.266086 29652 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.275336 28943 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.341656 29539 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.347771 29621 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.308084 29575 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.325980 29695 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:31.429070 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60304.2us
I20260709 13:09:31.430250 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:31.346913 29654 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.267068 29700 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.290417 29698 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:09:31.435035 27263 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:31.353142 29697 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.442729 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 155656us
I20260709 13:09:31.355715 29623 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:31.450451 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 218517us
I20260709 13:09:31.408440 29639 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.434687 29625 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:31.452571 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 314088us
I20260709 13:09:31.457549 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:31.440078 29650 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:31.466882 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 155856us
I20260709 13:09:31.467649 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.469029 29698 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.469515 29698 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.469352 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.470489 29698 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.470832 27380 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:31.349565 29570 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.448643 29634 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.453007 29641 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:31.480221 29705 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:31.481591 29575 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:31.461833 29536 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:31.440824 29464 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:31.454814 29699 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.486838 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:31.465845 29654 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.487025 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:31.487727 27380 connection.cc:256] RPC call timeout handler was delayed by -1.01913738799999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:09:31.419369 29539 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.436405 29621 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.495608 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:31.466017 28978 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.523432 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.349427 29686 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.483772 29625 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:31.503432 29725 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:31.505378 29559 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.485898 29726 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:31.448520 29697 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.506376 29666 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.494352 29639 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:09:31.512712 29729 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:31.444854 29690 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.253s
I20260709 13:09:31.526998 29634 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:31.527320 29711 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:09:31.532804 29539 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.561646 29697 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.556721 29709 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.564110 29709 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:31.564488 29709 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:31.499317 29644 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.001s
I20260709 13:09:31.538993 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.540441 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.516598 29654 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.550082 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.575893 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.524780 29619 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:31.534763 29623 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:31.534706 29621 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.521034 29708 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.584177 29708 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:31.584649 29708 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:31.585536 29708 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.556772 29710 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.587214 29652 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:31.587025 29710 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.593072 29710 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.561429 29673 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:31.593719 29673 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:31.594102 29642 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.828s	user 0.010s	sys 0.001s
I20260709 13:09:31.594182 29673 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.595669 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.577607 29723 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:31.577204 29464 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.578096 29719 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.578577 29628 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:31.521082 29699 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:31.560912 29702 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:09:31.587863 27338 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:31.588193 28943 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:31.589278 29701 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:09:31.541069 29716 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:09:31.589862 27340 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:31.590608 29546 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.099s	user 0.007s	sys 0.006s
I20260709 13:09:31.560264 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:31.593921 29687 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.825s	user 0.002s	sys 0.000s
I20260709 13:09:31.600747 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.601348 29500 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.601522 29625 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.596513 29654 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:31.608930 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.610817 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:31.610280 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 156310us
W20260709 13:09:31.611837 29512 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.817s	user 0.008s	sys 0.004s
I20260709 13:09:31.613023 29626 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.616071 27335 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:31.618136 27342 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:31.619961 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:31.685922 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 77083.7us
I20260709 13:09:31.686374 27338 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:31.686764 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:31.621676 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:31.627453 27337 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:31.604041 29723 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:31.582971 29640 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.653656 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:31.658422 29699 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.630503 29628 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:31.662439 29659 consensus_meta.cc:287] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.000s
I20260709 13:09:31.607669 29629 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.697924 29629 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.698665 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:31.699286 27343 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:31.699596 29638 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:31.699949 29638 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:31.700208 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:31.700922 27343 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:31.700812 29638 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.665880 29477 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.667115 29559 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.701762 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:31.606174 29681 consensus_meta.cc:287] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.000s
I20260709 13:09:31.679904 27339 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:31.680097 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.582952 29709 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.587905 29652 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.688395 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 66784.1us
I20260709 13:09:31.694516 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.693451 27340 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:31.696514 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.691691 29729 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:31.694483 29700 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.683717 29698 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:31.701848 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:32.064193 27340 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:31.808622 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.708204 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.066167 27334 raft_consensus.cc:2410] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:32.066756 29732 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.694278 29512 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.067410 29732 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.743285 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:31.704892 27413 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:31.694902 28943 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:32.069715 29732 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.069219 28943 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.070273 29738 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:32.070393 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:32.071295 27410 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:32.070861 29652 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.071558 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:32.072300 27411 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:32.072399 29621 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.068504 27336 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:32.072979 27414 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:32.073210 29621 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:31.696698 29719 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:31.802749 29737 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:32.075390 29738 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:31.708209 29659 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:32.075994 29621 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:31.703289 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:32.077039 27341 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.077865 29738 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:32.078052 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 386611us
I20260709 13:09:32.079005 27336 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:31.763044 29638 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:31.702499 29634 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.386s
I20260709 13:09:31.692777 29723 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:31.702607 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:31.762595 29730 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.074862 29719 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:32.080134 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:32.089524 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.100164 27264 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.089170 27259 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:32.080320 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.092437 27336 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:32.094310 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.103324 27263 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:32.104687 27261 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:09:32.086081 27380 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.558s (SENT)
I20260709 13:09:32.106130 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:32.108119 27409 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.111536 27338 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:32.115273 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.116252 27340 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:32.036494 29714 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.009008 29699 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.124012 27380 leader_election.cc:336] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.727s (SENT)
I20260709 13:09:31.775338 29640 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.127918 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:32.121042 27342 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:32.130780 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.144847 27334 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:32.131336 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:31.982470 29644 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.132686 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:32.080797 28978 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:32.143106 28999 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.177802 28999 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.070888 29681 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:32.082631 29477 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:32.199839 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 119808us
I20260709 13:09:32.200487 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.201189 27342 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:32.101495 29629 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.086107 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:32.213138 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.150916 27264 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:32.152807 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.082897 29698 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:32.105134 29719 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:32.114346 29652 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:32.083192 29589 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.082547 29634 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:32.291647 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.292538 27417 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:32.133560 29725 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.075940 29737 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.297065 29725 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.299376 29737 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:32.143639 29643 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:32.270915 28011 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:32.304688 29546 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:32.305677 29546 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:32.257246 29537 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:32.276578 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 152612us
I20260709 13:09:32.152027 29710 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.276661 28015 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:32.310418 27380 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.812s (SENT)
I20260709 13:09:32.143179 29437 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:32.258962 29642 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:32.177490 28978 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:32.289773 27409 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:32.128837 29512 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.103080 29700 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.203390 29659 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:32.085057 29729 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.292114 29634 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:32.249912 29728 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.291710 29738 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:32.296262 28007 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:32.271041 28006 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:32.342840 29738 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:32.296531 27417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1667) took 1515 ms (client timeout 1816 ms). Trace:
I20260709 13:09:32.342586 29728 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:32.344923 27417 rpcz_store.cc:269] 0709 13:09:30.781012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.781215 (+   203us) service_pool.cc:224] Handling call
0709 13:09:32.291532 (+1510317us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:32.296472 (+  4940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24170496}
I20260709 13:09:32.250558 29674 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.346161 29674 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.346647 29728 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.307637 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:32.348062 27342 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.240120 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.256466 29732 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:32.310815 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:32.279624 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.259769 29626 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.153591 29699 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.276961 29500 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:32.317785 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.306070 29546 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:32.322759 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.361160 27261 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:32.360786 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.323719 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.199214 29640 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.363538 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.316881 29725 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.328222 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.328874 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:32.330016 29696 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.306s	user 0.000s	sys 0.009s
I20260709 13:09:32.331357 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.333050 29719 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:32.387463 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:32.333653 29673 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.739s	user 0.000s	sys 0.010s
I20260709 13:09:32.389246 27413 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.336521 29512 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.391697 29673 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.359587 29681 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:09:32.393908 29512 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.315696 29710 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.205210 29644 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.315204 29537 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.141777 29714 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.396162 29710 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.340067 29700 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.320698 29642 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.342819 29634 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.342504 29659 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:32.397500 27414 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:32.397698 29659 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.398432 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.398674 29642 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.393929 29673 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.399827 27338 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:09:32.400213 27338 pending_rounds.cc:85] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 7
I20260709 13:09:32.400429 27338 pending_rounds.cc:107] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:32.400645 27338 raft_consensus.cc:2889] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:32.401180 28999 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.308153 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.404026 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.404783 27266 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:32.405185 29695 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:32.405509 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.405869 29537 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.406077 27266 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.403532 29723 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.349157 27259 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:32.407809 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:32.408175 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:32.408496 27259 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:32.408703 27336 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.409217 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.409787 27259 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:32.256811 29650 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:09:32.359664 29624 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:32.325246 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:32.376187 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65816.5us
I20260709 13:09:32.378058 27260 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:32.417055 27268 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:32.385706 27340 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
W20260709 13:09:32.385820 27231 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.769s (SENT)
I20260709 13:09:32.417836 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:32.418119 27268 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:32.388442 27343 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:32.335547 28978 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.362864 29500 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.389863 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.391973 28006 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:32.379554 29437 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:32.411731 27342 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:32.413421 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:32.417263 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.852s (SENT)
I20260709 13:09:32.386879 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.421325 27265 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:32.341933 29669 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:32.396477 29644 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.445263 27268 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:32.420408 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.448545 27260 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.448800 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.449862 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:32.450670 27338 raft_consensus.cc:2368] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:32.434803 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:32.435777 27264 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
W20260709 13:09:32.440534 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.421038 28978 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:32.405869 29695 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.451400 27268 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:32.452243 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.397503 29634 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:32.364625 29645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.416s	user 0.003s	sys 0.036s
W20260709 13:09:32.445367 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59590.9us
I20260709 13:09:32.456117 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:32.492949 27231 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.236s (SENT)
I20260709 13:09:32.493398 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:32.458921 27266 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:32.459443 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.460446 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.494720 27265 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:32.462129 27262 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:32.460891 27380 leader_election.cc:336] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.903s (SENT)
I20260709 13:09:32.422405 29500 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:32.480262 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 291169us
I20260709 13:09:32.499292 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:32.500875 29665 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:32.482227 27413 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:32.447410 29537 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:32.484454 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:32.491551 29645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.548s	user 0.004s	sys 0.037s
W20260709 13:09:32.462049 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 387967us
I20260709 13:09:32.450320 29623 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.459983 27337 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:09:32.457228 29743 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:09:32.495995 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.541630 27338 raft_consensus.cc:2410] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:32.445252 28943 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:32.504629 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.543717 27266 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:32.460289 29732 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:32.506192 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:32.507007 27268 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:32.542979 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:32.486871 27264 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:32.507656 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.508716 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:32.505966 27231 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.265s (SENT)
I20260709 13:09:32.547843 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:32.548918 27231 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.398s (SENT)
I20260709 13:09:32.549348 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:32.513883 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:32.514866 27341 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:32.515297 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:32.443300 29546 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.551918 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:32.516690 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 196410us
W20260709 13:09:32.533757 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.514973 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.554100 27417 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.547533 27338 raft_consensus.cc:2368] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:32.505856 29638 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:32.550603 27408 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
W20260709 13:09:32.558188 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 446148us
I20260709 13:09:32.563568 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:32.566622 27342 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:32.569810 27336 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:32.572106 29746 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.572261 29500 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:32.576999 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68375.5us
I20260709 13:09:32.577926 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:32.516109 29674 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.534822 29537 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:32.596755 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.602102 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:32.604262 27408 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:32.605518 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:32.607149 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:32.509434 29437 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:09:32.560635 29730 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:32.630147 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 96730.7us
I20260709 13:09:32.623744 27336 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:32.667773 27408 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:32.666416 27268 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:32.531641 29726 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:09:32.576371 29749 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:32.576141 29623 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:32.564518 29559 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:32.676841 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 123374us
I20260709 13:09:32.550922 29735 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:09:32.564963 28943 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 13:09:32.575479 29500 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:32.575448 29746 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:32.705772 29750 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:09:32.706245 29719 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:32.706826 29748 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:09:32.708935 29654 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.019s	user 0.007s	sys 0.003s
I20260709 13:09:32.684322 29749 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.615799 29538 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:32.585357 29708 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:32.694355 29559 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.728238 29537 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.729569 29699 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.734619 29714 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:32.752593 27417 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:32.739806 29659 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.754145 29756 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:09:32.746184 29640 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:32.789952 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.756345 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 171258us
W20260709 13:09:32.702306 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 137802us
W20260709 13:09:32.758040 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 152635us
W20260709 13:09:32.758389 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81965us
I20260709 13:09:32.687263 29673 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:09:32.762794 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 213901us
I20260709 13:09:32.765827 29671 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.766220 29500 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:32.755782 29626 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 13:09:33.123428 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.864200 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.114971 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1891) took 1416 ms. Trace:
I20260709 13:09:33.002815 27261 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:33.135076 27339 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:09:33.033169 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.136080 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1890) took 1437 ms (client timeout 1643 ms). Trace:
I20260709 13:09:33.162982 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:33.165623 27412 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:09:33.184829 27308 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.894s (SENT) [suppressed 37 similar messages]
W20260709 13:09:33.136662 27343 rpcz_store.cc:269] 0709 13:09:31.698643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.701542 (+  2899us) service_pool.cc:224] Handling call
0709 13:09:33.134482 (+1432940us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002da854. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:33.135950 (+  1468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571060608}
I20260709 13:09:33.128620 27335 rpcz_store.cc:276] 0709 13:09:31.698921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.035103 (+336182us) service_pool.cc:224] Handling call
0709 13:09:32.035526 (+   423us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.047520 (+ 11994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.047570 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.048294 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:09:32.495344 (+447050us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.702040 (+206696us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.760216 (+ 58176us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.760394 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.760487 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.114748 (+354261us) raft_consensus.cc:1685] finished
0709 13:09:33.114767 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.114896 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57289,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":301,"thread_start_us":522800,"threads_started":2,"wal-append.queue_time_us":481997}
I20260709 13:09:33.138195 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:33.248270 27343 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:32.763458 29559 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:33.097754 29638 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.001s
W20260709 13:09:33.068389 29695 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.001s
I20260709 13:09:32.763675 29749 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:33.256204 27416 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:09:33.256956 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:32.763710 29708 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:32.776342 29719 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.775497 29764 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:33.060642 29725 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.048419 29538 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.280663 29538 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.281243 29760 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:33.281973 29760 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.283248 29761 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.283430 29725 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.283944 29761 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:33.273361 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 135277us
I20260709 13:09:33.286671 29761 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:33.287307 27381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.003s	sys 0.044s
I20260709 13:09:33.127071 29671 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:33.276773 27335 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:33.289649 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1711) took 1034 ms. Trace:
I20260709 13:09:33.290087 27335 rpcz_store.cc:276] 0709 13:09:32.254917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.246676 (+991759us) service_pool.cc:224] Handling call
0709 13:09:33.270935 (+ 24259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.289288 (+ 18353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.289575 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:33.269050 29638 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:33.064546 29623 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:33.292023 27381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.003s	sys 0.045s
W20260709 13:09:33.265424 29589 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.957s	user 0.008s	sys 0.004s
I20260709 13:09:33.246631 29639 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:32.768357 29654 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:32.990899 29320 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.302s
W20260709 13:09:33.295810 27336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.039s	sys 0.008s
I20260709 13:09:33.298084 27415 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:33.298233 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 263) took 1194 ms. Trace:
I20260709 13:09:33.272248 29708 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.299707 29623 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:33.312319 27336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.040s	sys 0.008s
I20260709 13:09:33.311682 27414 rpcz_store.cc:276] 0709 13:09:32.103527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.103646 (+   119us) service_pool.cc:224] Handling call
0709 13:09:33.298010 (+1194364us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540027cc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:33.298165 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581982080}
I20260709 13:09:33.237449 29665 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:09:33.273906 28943 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:33.302448 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.010s	sys 0.006s
W20260709 13:09:33.356082 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.010s	sys 0.006s
W20260709 13:09:33.356490 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 600652us
I20260709 13:09:33.295353 29761 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:33.275810 29695 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:33.351228 29752 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:33.297408 29764 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.312939 29538 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:33.290480 29719 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:33.379503 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.400967 29761 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.416075 29695 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:33.407840 29764 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:33.421547 29744 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 1.032s	user 0.012s	sys 0.005s
I20260709 13:09:33.423213 28008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 483) took 1948 ms. Trace:
I20260709 13:09:33.423638 28008 rpcz_store.cc:276] 0709 13:09:31.474328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.474483 (+   155us) service_pool.cc:224] Handling call
0709 13:09:31.474864 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:31.497416 (+ 22552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.500135 (+  2719us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.500813 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.799739 (+298926us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b180038dd00. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:32.151883 (+352144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.204494 (+ 52611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.249930 (+ 45436us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.420769 (+1170839us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:33.422889 (+  2120us) raft_consensus.cc:1685] finished
0709 13:09:33.422921 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.423125 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8569,"raft.queue_time_us":22588,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":20578,"spinlock_wait_cycles":40190208,"thread_start_us":330422,"threads_started":1,"wal-append.queue_time_us":811267}
I20260709 13:09:33.431114 27417 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:33.377643 29500 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.315191 29639 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.361933 29650 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
W20260709 13:09:33.530934 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.434512 29659 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:33.518313 29621 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:33.534430 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.529949 29500 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.536070 27341 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:09:33.529141 29752 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:33.528023 29673 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:33.551671 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 366845us
I20260709 13:09:33.538070 29621 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:33.547580 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 384721us
W20260709 13:09:33.547101 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 302609us
W20260709 13:09:33.573076 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 277085us
I20260709 13:09:33.638017 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:33.546550 29638 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.554577 29659 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:09:33.636336 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69265.6us
I20260709 13:09:33.558918 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:33.567418 28006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.022s	sys 0.026s
I20260709 13:09:33.566265 29621 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:33.570550 29493 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.006s	sys 0.006s
I20260709 13:09:33.547139 29772 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:09:33.649490 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:33.661437 27380 connection.cc:256] RPC call timeout handler was delayed by -1.4452925349999077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:09:33.669045 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:33.653635 28006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.023s	sys 0.026s
I20260709 13:09:33.669880 28015 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:33.644924 29659 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:33.669143 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.673909 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1676) took 1983 ms. Trace:
I20260709 13:09:33.678310 27409 rpcz_store.cc:276] 0709 13:09:31.690796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.692074 (+  1278us) service_pool.cc:224] Handling call
0709 13:09:33.673705 (+1981631us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b540015b154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:33.673850 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96271744}
W20260709 13:09:33.656582 29493 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.007s
I20260709 13:09:33.680540 28014 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:33.655943 29729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.026s	sys 0.057s
I20260709 13:09:33.681268 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.689980 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.692705 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.693713 28015 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:33.667255 29695 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:09:33.647569 29673 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:33.696014 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:33.674896 29512 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.028s	sys 0.015s
I20260709 13:09:33.650425 29589 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:33.695508 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:33.688442 29759 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:09:33.688026 29729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.026s	sys 0.057s
I20260709 13:09:33.655650 29638 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:33.715564 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 277656us
W20260709 13:09:33.703557 29512 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.029s	sys 0.016s
I20260709 13:09:33.723985 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.724061 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:33.707617 29758 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:09:33.733788 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:33.740854 27264 raft_consensus.cc:2376] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:09:33.747503 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.753671 29787 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.753981 28978 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.289s	user 0.008s	sys 0.003s
I20260709 13:09:33.757119 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1134) took 1431 ms. Trace:
I20260709 13:09:33.723842 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.710198 29746 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:33.760023 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.760926 28012 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:33.710597 29770 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.763783 29770 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.764631 29663 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:33.767827 29730 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:33.769305 29730 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.769932 29730 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.771734 29500 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:33.772709 29774 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.773379 29774 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.706313 29725 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:33.784904 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 119281us
I20260709 13:09:33.757671 27267 rpcz_store.cc:276] 0709 13:09:32.325995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.414104 (+ 88109us) service_pool.cc:224] Handling call
0709 13:09:32.415526 (+  1422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.416419 (+   893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.416457 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.456528 (+ 40071us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.580950 (+124422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.595771 (+ 14821us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.617151 (+ 21380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.617253 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.756778 (+1139525us) raft_consensus.cc:1685] finished
0709 13:09:33.756855 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.757036 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14845,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":22632,"spinlock_wait_cycles":81768704,"thread_start_us":54650,"threads_started":1,"wal-append.queue_time_us":800080}
I20260709 13:09:33.788376 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:33.789486 27264 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:33.710652 29782 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:33.754581 29787 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.807243 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:33.797181 29765 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.469s	user 0.001s	sys 0.000s
I20260709 13:09:33.791324 29639 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:33.792821 29773 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.837190 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.803512 29735 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:09:33.859721 27381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.012s	sys 0.022s
I20260709 13:09:33.857460 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:33.808135 29791 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.862425 27381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.013s	sys 0.022s
I20260709 13:09:33.862633 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:33.805341 29761 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:33.864495 29783 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:33.823002 29698 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.865001 29761 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:33.865408 29698 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.865546 29761 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.860435 29729 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:33.823450 29760 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:33.867501 29729 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.868053 29698 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:33.869673 29708 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:09:33.869963 29761 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:33.870196 29708 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.738786 29659 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.871943 29659 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.813704 29782 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:33.875900 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:33.870554 29761 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:33.870705 29764 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:34.014899 27307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.015s
W20260709 13:09:34.037904 27307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.016s
I20260709 13:09:34.001148 27416 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.012578 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.039798 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1705) took 1785 ms. Trace:
I20260709 13:09:34.040337 27338 rpcz_store.cc:276] 0709 13:09:32.254028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.556383 (+302355us) service_pool.cc:224] Handling call
0709 13:09:32.556778 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.573475 (+ 16697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.573508 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.574080 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.757242 (+183162us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:32.757843 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.757892 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.039523 (+1281631us) raft_consensus.cc:1685] finished
0709 13:09:34.039552 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.039726 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14896,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":182774,"threads_started":1,"wal-append.queue_time_us":397692}
W20260709 13:09:34.043689 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.035912 27265 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:34.046183 27265 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.048868 27265 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:34.052130 28015 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 11. Ops: []
I20260709 13:09:34.001804 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:34.059399 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.986549 29781 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:09:33.868095 29771 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:09:33.877897 29735 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.069037 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:33.876920 29770 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.069875 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:34.055617 29791 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:33.876190 29774 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.029810 29698 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.054771 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:33.944954 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 82409.2us
I20260709 13:09:34.074607 27415 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:34.072863 28006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 336) took 1575 ms. Trace:
I20260709 13:09:34.057753 29639 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.069900 27416 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:34.036043 29784 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.071623 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1910) took 1566 ms. Trace:
I20260709 13:09:34.083001 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.083942 27260 rpcz_store.cc:276] 0709 13:09:32.504858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.630288 (+125430us) service_pool.cc:224] Handling call
0709 13:09:32.756064 (+125776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.759627 (+  3563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.759650 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.776680 (+ 17030us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.364251 (+587571us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:33.364296 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.364370 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.071394 (+707024us) raft_consensus.cc:1685] finished
0709 13:09:34.071415 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.071563 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4474,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":1599,"thread_start_us":274016,"threads_started":1,"wal-append.queue_time_us":505050}
W20260709 13:09:34.042423 29758 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:34.013211 29801 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:34.063742 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 239479us
I20260709 13:09:34.036556 29802 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:34.052170 29764 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.093057 29760 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:34.094013 29791 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:33.861016 29773 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:33.876303 29776 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:34.057698 29761 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.101517 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.103485 27412 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:34.089285 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:34.091367 29802 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.094079 29760 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.108404 29760 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:34.108630 29776 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.109334 29760 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.073189 29774 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.060838 29781 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.089923 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:34.089591 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:34.106611 29708 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:34.078259 28006 rpcz_store.cc:276] 0709 13:09:32.497184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.507830 (+ 10646us) service_pool.cc:224] Handling call
0709 13:09:32.510273 (+  2443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.534757 (+ 24484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.546537 (+ 11780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.694808 (+148271us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.426152 (+731344us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd7fb270ac 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b
0709 13:09:33.686599 (+260447us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.691805 (+  5206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.704243 (+ 12438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.038844 (+334601us) raft_consensus.cc:1685] finished
0709 13:09:34.038864 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.070804 (+ 31940us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1169,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":32358,"spinlock_wait_cycles":53373824,"thread_start_us":967546,"threads_started":1,"wal-append.queue_time_us":1008071}
I20260709 13:09:34.112409 29760 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.113104 29776 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.113222 29659 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:34.115464 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.141250 27412 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:34.141489 27416 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:34.115808 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1893) took 2416 ms. Trace:
I20260709 13:09:34.116796 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1132) took 1791 ms. Trace:
I20260709 13:09:34.106832 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:34.126359 27380 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.643s (SENT)
I20260709 13:09:34.097781 29783 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:34.146561 29783 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.088955 29730 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.147634 27416 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:34.148070 29767 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.148375 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.149137 27416 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:34.134218 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.086932 29639 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.140103 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.108261 29773 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.142511 27259 rpcz_store.cc:276] 0709 13:09:32.325520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.410363 (+ 84843us) service_pool.cc:224] Handling call
0709 13:09:32.410656 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.420008 (+  9352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.420051 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.451193 (+ 31142us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.755487 (+304294us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.842385 (+ 86898us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.049509 (+207124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.049611 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.116494 (+1066883us) raft_consensus.cc:1685] finished
0709 13:09:34.116528 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.116715 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208094,"prepare.queue_time_us":87203,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":58654,"raft.queue_time_us":215563,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":37142,"spinlock_wait_cycles":30341376,"thread_start_us":205612,"threads_started":1,"wal-append.queue_time_us":789662}
I20260709 13:09:34.151993 27414 raft_consensus.cc:2410] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:09:34.151372 27410 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:34.142338 27334 rpcz_store.cc:276] 0709 13:09:31.699572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.066804 (+367232us) service_pool.cc:224] Handling call
0709 13:09:32.144523 (+ 77719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:32.145164 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.115634 (+1970470us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b5400039dd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.115757 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178006272}
I20260709 13:09:34.154563 27412 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:34.119271 29638 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.119647 29781 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:33.876559 29782 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.158560 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:34.159642 27259 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.099437 29801 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.158242 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.151345 29659 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:34.157747 29634 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.667s	user 0.013s	sys 0.000s
W20260709 13:09:34.165073 27261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1133) took 1839 ms (client timeout 2181 ms). Trace:
I20260709 13:09:34.120200 29774 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:34.164367 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.166944 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.099640 29784 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.165581 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.170895 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:34.165573 27261 rpcz_store.cc:269] 0709 13:09:32.325754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.398136 (+ 72382us) service_pool.cc:224] Handling call
0709 13:09:34.164861 (+1766725us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540031e554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.165016 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387640192}
I20260709 13:09:34.170994 27412 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
I20260709 13:09:34.163846 29789 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:34.173735 27263 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:34.175354 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.175866 27335 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:34.176043 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.176463 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.176633 27338 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:34.176966 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.177358 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.177438 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.177959 27414 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:34.178125 29512 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.179268 29512 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.179649 29512 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:34.180473 29512 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.178186 27338 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:34.184338 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.184876 27334 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.148648 29767 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.166512 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.186954 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.187557 28006 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
W20260709 13:09:34.187690 27340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 279) took 2072 ms (client timeout 1556 ms). Trace:
W20260709 13:09:34.188073 27340 rpcz_store.cc:269] 0709 13:09:32.115562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.131044 (+ 15482us) service_pool.cc:224] Handling call
0709 13:09:34.187517 (+2056473us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54003309d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.187627 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550946560}
I20260709 13:09:34.189085 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.189608 27340 raft_consensus.cc:2376] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:09:34.163715 29621 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.190133 27342 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:34.190483 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.191494 28009 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:34.191615 29621 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:34.192040 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.192801 27415 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:34.193200 27415 pending_rounds.cc:85] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 2
I20260709 13:09:34.193178 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.193614 27415 pending_rounds.cc:107] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:34.193849 27340 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.195834 27338 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:34.197172 27338 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:34.198081 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1706) took 1943 ms. Trace:
I20260709 13:09:34.198441 27342 rpcz_store.cc:276] 0709 13:09:32.254212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.567592 (+313380us) service_pool.cc:224] Handling call
0709 13:09:34.189808 (+1622216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:34.190492 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.197906 (+  7414us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003309d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.198031 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3632797440}
I20260709 13:09:34.193873 27415 raft_consensus.cc:2889] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.205029 27334 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:34.181599 29512 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:34.207201 27231 leader_election.cc:400] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:34.207671 27231 leader_election.cc:403] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.208518 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:34.209715 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.209662 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:34.211436 29772 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:34.171689 29729 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.220150 27259 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:34.227032 27334 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:34.228554 27334 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:34.233166 27340 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:34.225351 29749 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.932s	user 0.009s	sys 0.002s
W20260709 13:09:34.237191 29813 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:34.183468 29808 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.223884 29708 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:09:34.239959 29674 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:34.213042 29725 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:34.257223 29725 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.240792 29659 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.241555 29802 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.242189 29784 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:34.234560 28978 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.242885 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44139.4us
I20260709 13:09:34.244160 27342 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:34.242651 29559 consensus_meta.cc:287] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.968s	user 0.012s	sys 0.000s
I20260709 13:09:34.247872 29808 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.246805 27338 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:34.256106 29663 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:34.224079 29493 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:34.271057 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.272274 27414 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:34.267129 29559 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.274151 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.274426 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.274685 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1681) took 1091 ms. Trace:
I20260709 13:09:34.275091 27417 rpcz_store.cc:276] 0709 13:09:33.183112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.183364 (+   252us) service_pool.cc:224] Handling call
0709 13:09:33.183727 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.431734 (+248007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.274456 (+842722us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540010e354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:34.274630 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":568322432}
I20260709 13:09:34.275422 29803 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:34.248787 29749 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.275422 29559 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.267982 29674 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:34.273047 29761 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.274175 29801 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.270203 28978 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.320947 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:34.282406 29774 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.271291 29634 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:34.326913 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:34.319540 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.323484 29761 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:34.288614 29789 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.338202 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:34.339107 27262 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.276329 29803 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.342124 29735 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:34.343966 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:34.347569 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.348465 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.348942 27261 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:34.349565 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.350201 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.350865 27260 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:09:34.351476 29654 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:34.351812 27260 pending_rounds.cc:85] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 2
I20260709 13:09:34.352216 27260 pending_rounds.cc:107] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:34.352785 27260 raft_consensus.cc:2889] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:34.354136 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.354563 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.355690 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.356353 27259 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:34.356627 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.357285 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.358404 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.359038 27261 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:34.360317 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.361630 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.362222 27265 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:34.363034 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.363389 28978 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.363576 27265 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 2.
W20260709 13:09:34.364110 29769 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.723s	user 0.002s	sys 0.002s
I20260709 13:09:34.363962 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.365329 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1708) took 2110 ms. Trace:
I20260709 13:09:34.363977 28978 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.365772 27336 rpcz_store.cc:276] 0709 13:09:32.254503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.694833 (+440330us) service_pool.cc:224] Handling call
0709 13:09:32.719813 (+ 24980us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.720045 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.720069 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.756128 (+ 36059us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.312739 (+556611us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:33.312787 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.312854 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.363568 (+1050714us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:34.365050 (+  1482us) raft_consensus.cc:1685] finished
0709 13:09:34.365068 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.365271 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7775104,"thread_start_us":547740,"threads_started":1,"wal-append.queue_time_us":784062}
I20260709 13:09:34.334607 29761 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:34.366511 27259 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:34.365891 27260 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:09:34.367688 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:34.370360 29749 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.370872 27265 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:34.343024 29803 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.344853 29559 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:09:34.391453 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0678674920000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:09:34.391831 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0453674919999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:09:34.391867 28014 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 5 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:34.394368 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.395125 27340 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:34.396072 27340 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:34.394524 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.399829 27334 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:34.403568 27413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 266) took 2267 ms (client timeout 1820 ms). Trace:
I20260709 13:09:34.403810 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.401409 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:34.404223 27413 rpcz_store.cc:269] 0709 13:09:32.127345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.129412 (+  2067us) service_pool.cc:224] Handling call
0709 13:09:34.393965 (+2264553us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400086e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.394061 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263310592}
I20260709 13:09:34.405023 27336 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:34.403730 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.406556 27342 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:34.401150 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.407933 27335 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:34.384930 28978 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.396731 29559 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:34.409606 29559 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.410198 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.410425 28978 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.411098 28007 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:34.400764 29725 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.414551 27336 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:34.419688 29821 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:34.421064 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.421897 27336 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:34.423638 29824 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.416850 29818 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:09:34.423132 29817 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.129s	user 0.004s	sys 0.000s
I20260709 13:09:34.429706 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.430401 27336 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
W20260709 13:09:34.434055 29819 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:09:34.437520 29820 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:09:34.439498 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:34.440754 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.444552 27336 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:34.444551 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.446218 27342 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:34.447209 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.421008 29761 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.448856 29761 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.448938 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.450676 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.452076 29623 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.453583 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.454427 27336 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:34.441234 27262 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:34.424219 29824 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.478544 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.479315 27342 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:34.481093 27335 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:34.482175 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.482832 27336 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
I20260709 13:09:34.484963 29320 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:34.485503 29320 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:34.475263 29781 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.492039 29723 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.498380 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.486649 29320 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:34.499518 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.502280 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.499508 29802 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:09:34.499795 27336 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:34.507105 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1897) took 2806 ms. Trace:
I20260709 13:09:34.507514 27339 rpcz_store.cc:276] 0709 13:09:31.700763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.083268 (+382505us) service_pool.cc:224] Handling call
0709 13:09:33.134630 (+1051362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.135616 (+   986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.506847 (+1371231us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002da850. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.507005 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2416746368}
I20260709 13:09:34.508021 29787 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.510466 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:34.500766 29781 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:34.503389 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.504071 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.515628 27338 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 2.
I20260709 13:09:34.515820 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:34.504436 29824 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.516662 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:34.518416 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:34.519647 29766 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:34.520320 29766 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:34.520730 27337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1885) took 2828 ms (client timeout 2224 ms). Trace:
I20260709 13:09:34.522644 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:34.521135 27337 rpcz_store.cc:269] 0709 13:09:31.692090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.692243 (+   153us) service_pool.cc:224] Handling call
0709 13:09:34.520544 (+2828301us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540014bed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.520633 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800215296}
I20260709 13:09:34.521252 29766 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.552870 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.554409 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.563687 28999 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.564153 28999 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.564119 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.564730 28999 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:34.559672 29690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.867s	user 0.017s	sys 0.017s
I20260709 13:09:34.559527 29629 raft_consensus.cc:2764] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:34.562928 28008 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:34.569258 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.570232 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:34.566185 29690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.889s	user 0.017s	sys 0.017s
I20260709 13:09:34.573850 28978 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:34.574790 28999 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.573940 29824 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:34.575798 28978 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.576274 28978 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:34.577068 28999 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.581864 29671 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:34.566448 29725 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:34.585212 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.585321 28978 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.591048 29546 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:34.592958 29746 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:34.617093 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1704) took 2363 ms. Trace:
I20260709 13:09:34.617726 27341 rpcz_store.cc:276] 0709 13:09:32.253808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.554931 (+301123us) service_pool.cc:224] Handling call
0709 13:09:32.555353 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.540168 (+984815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.616727 (+1076559us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54002dad54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:34.617005 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254737152}
I20260709 13:09:34.583042 29671 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:34.593297 29825 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:09:34.631434 28978 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.598140 29725 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.633882 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.637049 28978 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:34.637465 28978 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.637847 28978 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:34.638345 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.622016 29746 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:34.635732 29725 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:34.646692 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.647408 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 67637.3us
W20260709 13:09:34.648175 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.651340 29546 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:34.650424 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:34.651772 29829 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:09:34.671900 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.715122 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.793190 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:34.888603 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.788358 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:34.783792 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:34.669641 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1682) took 1485 ms. Trace:
I20260709 13:09:34.890429 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:34.894390 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 101288us
I20260709 13:09:34.702000 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.684351 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:34.796370 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 128141us
I20260709 13:09:34.710945 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1914) took 1012 ms. Trace:
I20260709 13:09:34.891637 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:34.897238 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 212960us
I20260709 13:09:31.655419 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:34.706459 28999 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:34.892423 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:34.650090 29755 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.940s	user 0.007s	sys 0.006s
I20260709 13:09:34.655613 28978 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:34.898454 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:34.846504 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.893224 27267 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.899061 27260 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:34.887526 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 237153us
I20260709 13:09:34.899853 28999 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:34.895115 27408 rpcz_store.cc:276] 0709 13:09:33.184233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.184377 (+   144us) service_pool.cc:224] Handling call
0709 13:09:33.298147 (+113770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.190379 (+892232us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800378c40. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd82c29060 00007fbd82c29bfb 00007fbd82c3464b
0709 13:09:34.190509 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.190533 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.190975 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.250700 (+ 59725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:34.250734 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.250808 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.447378 (+196570us) raft_consensus.cc:1685] finished
0709 13:09:34.447413 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.669372 (+221959us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540027cc50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.669545 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245783,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4594,"spinlock_wait_cycles":290319360,"thread_start_us":311971,"threads_started":2,"wal-append.queue_time_us":59734}
I20260709 13:09:34.949399 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:34.904357 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 116140us
I20260709 13:09:34.957757 27268 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:34.732649 27261 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:09:34.877066 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:34.732446 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1126) took 2409 ms (client timeout 1866 ms). Trace:
I20260709 13:09:34.937557 27266 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:34.897931 27264 rpcz_store.cc:276] 0709 13:09:33.698637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.801480 (+102843us) service_pool.cc:224] Handling call
0709 13:09:33.818189 (+ 16709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:34.097977 (+279788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.097999 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:34.104612 (+  6613us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.155365 (+ 50753us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:34.155393 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.286905 (+131512us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:34.710595 (+423690us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54001f86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:34.710655 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.710702 (+    47us) raft_consensus.cc:1685] finished
0709 13:09:34.710718 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.710874 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7553,"raft.queue_time_us":199780,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":1440,"spinlock_wait_cycles":127196800,"thread_start_us":260052,"threads_started":2,"wal-append.queue_time_us":73248}
W20260709 13:09:34.890450 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106754us
I20260709 13:09:34.964190 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.966176 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:34.966739 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:34.660765 29757 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.955s	user 0.005s	sys 0.005s
I20260709 13:09:34.765450 29320 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:34.885739 29729 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 13:09:34.701131 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.878461 29652 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:34.740262 29719 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.970335 28999 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:34.877271 29782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.000s	sys 0.013s
W20260709 13:09:34.961371 27263 rpcz_store.cc:269] 0709 13:09:32.322579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.323361 (+   782us) service_pool.cc:224] Handling call
0709 13:09:34.732145 (+2408784us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540034f154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:34.732312 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4110319488}
I20260709 13:09:34.704667 29709 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.967186 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:34.701442 29738 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:34.702365 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:34.972640 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.715245 28943 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:35.002450 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 43963.9us
W20260709 13:09:35.301512 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 334409us
I20260709 13:09:35.302661 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:35.094017 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 195623us
I20260709 13:09:35.304504 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:34.734819 29663 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:34.960237 27261 pending_rounds.cc:85] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 3
I20260709 13:09:35.186030 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:35.048013 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 81923us
I20260709 13:09:35.310643 27261 pending_rounds.cc:107] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:09:35.311064 27261 raft_consensus.cc:2889] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.074481 27413 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:35.295702 27260 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:34.877935 29538 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:35.079653 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 265) took 2966 ms. Trace:
I20260709 13:09:35.012573 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:35.089314 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:35.316345 27259 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:35.316913 27417 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:35.012648 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 135664us
I20260709 13:09:35.010818 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.900264 29625 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:35.011477 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:35.295032 29782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.014s	sys 0.030s
W20260709 13:09:35.138496 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.799413 29695 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.815470 29831 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.064904 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:35.016889 28978 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:35.073732 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 177788us
I20260709 13:09:35.297075 28999 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.233801 27266 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:35.300730 27308 connection.cc:256] RPC call timeout handler was delayed by -1.3839304169999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 13:09:34.696075 29640 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.904153 29761 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:34.899945 29639 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:35.338461 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:34.704125 29767 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:35.070108 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.077638 29808 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:34.900123 29811 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:35.317607 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:35.314378 28009 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:35.323432 27260 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:09:35.341331 27343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.019s	sys 0.007s
I20260709 13:09:34.969133 29617 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:35.325654 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:35.094475 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:35.327117 27308 connection.cc:256] RPC call timeout handler was delayed by -1.2985602239999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:09:35.325423 27267 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:34.904512 29546 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:35.315984 27411 rpcz_store.cc:276] 0709 13:09:32.113796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.113946 (+   150us) service_pool.cc:224] Handling call
0709 13:09:32.132231 (+ 18285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.132646 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.132687 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.203633 (+ 70946us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.570289 (+366656us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:32.570346 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.570437 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.559877 (+1989440us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:35.033449 (+473572us) raft_consensus.cc:1685] finished
0709 13:09:35.033470 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:35.079573 (+ 46103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":756,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":59087,"spinlock_wait_cycles":41788288,"thread_start_us":262862,"threads_started":1,"wal-append.queue_time_us":432620}
I20260709 13:09:35.335644 28978 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.043737 29437 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:35.360659 27308 connection.cc:256] RPC call timeout handler was delayed by -1.0715964079998912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25379999999999997s for a response
W20260709 13:09:35.366262 27308 connection.cc:256] RPC call timeout handler was delayed by -1.051130196000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3012s for a response
I20260709 13:09:35.011950 29737 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.328s
I20260709 13:09:35.061100 29477 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.095011 29824 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.342432 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:35.438972 27413 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.301753 28943 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:35.319319 27268 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:35.349787 27343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.019s	sys 0.007s
I20260709 13:09:35.314893 29834 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:35.341956 29625 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:35.323014 29778 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:09:35.358382 27163 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:35.352011 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.315776 29663 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.323979 29732 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.358911 27383 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:35.355692 27165 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 211) took 8174 ms. Trace:
I20260709 13:09:35.357899 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:35.461483 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 103634us
W20260709 13:09:35.366638 27308 connection.cc:256] RPC call timeout handler was delayed by -1.0069252149999102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:09:35.337277 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:35.327327 29709 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.452503 27163 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 1 to 3, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:09:35.349103 29838 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:35.335337 29761 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:35.433881 27414 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:34.678390 29746 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.477161 27413 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:09:35.384565 28978 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.386457 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:35.306897 29652 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.367205 29546 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.349084 29811 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:35.338292 29695 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.503002 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:35.503851 27334 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:35.440687 29477 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:35.466662 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:35.463630 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:35.510054 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46525.4us
I20260709 13:09:35.467276 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:35.511516 27408 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.366333 29639 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.354943 29617 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:35.467836 29709 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.470875 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:35.517021 27337 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.335114 29831 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.496678 27415 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:35.432104 29621 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:09:35.396078 29729 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:35.501680 27339 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:35.457569 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:35.532363 27412 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.371987 29808 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
I20260709 13:09:35.490976 29761 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.464926 27163 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.445506 29834 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.341611 29640 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.512297 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:35.513504 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:35.490675 29824 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.540056 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:35.494987 28978 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.502141 29546 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:35.555817 27409 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 3.
I20260709 13:09:35.555961 28999 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:35.560300 27337 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:35.592450 27415 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:09:35.603803 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:35.531356 29617 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.571468 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:35.507328 29811 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:35.631512 27415 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:35.472682 29732 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.611068 27334 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:35.569787 27408 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:35.460163 27165 rpcz_store.cc:276] 0709 13:09:27.174191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.174332 (+   141us) service_pool.cc:224] Handling call
0709 13:09:28.919351 (+1745019us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54002b0110. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0d0b2 00007fbd88a86a89 00007fbd88a1eda6 00007fbd889f0088 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc
0709 13:09:35.341924 (+6422573us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:30.024707 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:30.025404 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:30.025457 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:09:30.025493 (+    36us) tablet.cc:662] Decoding operations
0709 13:09:30.027638 (+  2145us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:30.027733 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:30.027760 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:09:30.029383 (+  1623us) tablet.cc:701] Row locks acquired
0709 13:09:30.029469 (+    86us) write_op.cc:260] PREPARE: finished
0709 13:09:30.029632 (+   163us) write_op.cc:270] Start()
0709 13:09:30.029799 (+   167us) write_op.cc:276] Timestamp: P: 1783602570029564 usec, L: 0
0709 13:09:30.029821 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:30.113250 (+ 83429us) log.cc:844] Serialized 8335 byte log entry
0709 13:09:30.589237 (+475987us) op_driver.cc:464] REPLICATION: finished
0709 13:09:30.808451 (+219214us) write_op.cc:301] APPLY: starting
0709 13:09:30.826146 (+ 17695us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:30.883485 (+ 57339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:30.883617 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:31.172316 (+288699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:31.172874 (+   558us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:09:31.172954 (+    80us) write_op.cc:312] APPLY: finished
0709 13:09:31.173627 (+   673us) log.cc:844] Serialized 145 byte log entry
0709 13:09:31.196617 (+ 22990us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.233829 (+ 37212us) write_op.cc:454] Released schema lock
0709 13:09:31.276484 (+ 42655us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:31.377752 (+101268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:31.423584 (+ 45832us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37494,"reported_tablets":47,"spinlock_wait_cycles":48978048,"child_traces":[["op",{"apply.queue_time_us":143690,"apply.run_cpu_time_us":10077,"apply.run_wall_time_us":568149,"num_ops":21,"prepare.queue_time_us":40685,"prepare.run_cpu_time_us":41719,"prepare.run_wall_time_us":196744,"raft.queue_time_us":171285,"raft.run_cpu_time_us":16233,"raft.run_wall_time_us":164797,"replication_time_us":508528,"thread_start_us":297699,"threads_started":4,"wal-append.queue_time_us":133458,"wal-append.run_cpu_time_us":59952,"wal-append.run_wall_time_us":1927773}]]}
I20260709 13:09:35.625236 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:35.638264 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:35.639211 27339 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:35.658417 27339 raft_consensus.cc:2410] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:35.516875 29477 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:35.697960 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.026s	sys 0.039s
W20260709 13:09:35.698381 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.026s	sys 0.039s
W20260709 13:09:35.698695 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 771133us
I20260709 13:09:35.574827 29834 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:35.337984 29538 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.629881 27413 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:35.673417 27335 raft_consensus.cc:2410] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:35.518251 29709 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.680325 28978 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:35.695813 29650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.050s
I20260709 13:09:35.670302 29831 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:35.695612 29802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.048s
W20260709 13:09:35.714339 29650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.017s	sys 0.050s
I20260709 13:09:35.744138 29650 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:35.748202 29695 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:35.748903 29695 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:35.749372 29695 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.749782 29695 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.751951 29652 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:35.752781 29652 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.753281 29652 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.756036 29732 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:35.756647 29732 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:35.757212 29732 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.760355 29640 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:35.762682 29725 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.110s	user 0.009s	sys 0.001s
I20260709 13:09:35.763106 29725 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.765684 29725 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:35.734949 29802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.018s	sys 0.048s
W20260709 13:09:35.782332 27979 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.039s	sys 0.034s
W20260709 13:09:35.833266 27979 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.039s	sys 0.034s
W20260709 13:09:35.835523 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.015s	sys 0.003s
W20260709 13:09:35.836038 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.015s	sys 0.003s
W20260709 13:09:35.836694 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 534119us
I20260709 13:09:35.837670 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:35.554989 27163 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 4, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:35.853368 27163 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:35.688789 27265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.040s	sys 0.036s
W20260709 13:09:35.855355 27265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.040s	sys 0.036s
I20260709 13:09:35.614655 29737 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:35.591763 29836 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:09:35.517809 28943 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.633106 29625 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:35.868103 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.002s	sys 0.009s
W20260709 13:09:35.868459 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.002s	sys 0.009s
W20260709 13:09:35.868739 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 512384us
W20260709 13:09:35.867537 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.017s
W20260709 13:09:35.869661 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.005s	sys 0.017s
W20260709 13:09:35.870460 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.019s
W20260709 13:09:35.870764 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.019s
I20260709 13:09:35.869727 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:35.874159 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 515278us
I20260709 13:09:35.875808 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:35.876863 29756 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.877556 29756 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:35.878732 27978 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.009s
W20260709 13:09:35.879767 27978 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.011s	sys 0.009s
W20260709 13:09:35.880124 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 523795us
I20260709 13:09:35.882371 27335 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:35.884069 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.891717 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:35.893437 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:35.893771 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.872437 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 570341us
W20260709 13:09:35.904750 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.905249 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.905665 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.871037 29671 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.248s	user 0.009s	sys 0.004s
I20260709 13:09:35.915946 27414 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:09:35.921972 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.820048 29538 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:35.859731 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:35.763028 29477 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:35.877888 29778 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:35.686277 27412 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:35.955308 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:35.902410 29640 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:35.961454 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105633us
I20260709 13:09:35.962289 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:35.963548 28978 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:35.963994 28978 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:35.964365 28978 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.900065 29732 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:35.963140 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:35.978631 28999 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:35.979342 28999 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.979790 28999 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:35.983089 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.912592 28943 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:35.909101 29841 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:35.913697 29786 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:35.930335 29673 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:35.998210 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 476300us
I20260709 13:09:35.912876 29652 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:35.870085 29737 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.003475 28999 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:35.955766 29650 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.009755 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:35.995242 29719 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.014s
W20260709 13:09:36.020498 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.983892 29842 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.984036 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:36.027855 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.972337 29808 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.983707 29681 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.973492 29640 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.039069 28999 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.007777 29802 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:35.992599 29738 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:35.994503 29847 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:36.026729 29719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.014s
W20260709 13:09:36.065811 29437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.017s	sys 0.036s
I20260709 13:09:36.075790 28999 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.005762 29732 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.015329 29673 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.009974 29786 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:35.964681 29831 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:09:35.983776 29853 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:09:36.033102 29671 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.088114 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:36.070855 28978 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.019692 29846 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:09:36.079511 29847 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.103591 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:36.103890 29732 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.043628 29842 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:36.044360 29845 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.077930 29640 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.013644 29756 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.026783 29626 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:09:36.076659 29802 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:36.113945 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 220501us
I20260709 13:09:36.019155 29844 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
W20260709 13:09:36.090037 29437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.017s	sys 0.036s
I20260709 13:09:36.122151 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:36.033390 29746 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 13:09:36.169376 29864 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:09:36.169669 29746 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:36.170193 29746 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:36.170351 29840 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:09:36.171121 29746 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.172391 29746 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:36.173429 29546 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.000s
I20260709 13:09:36.173875 29546 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.153023 29617 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.179240 29617 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:36.179528 29839 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:09:36.179955 29617 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.181135 27416 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:36.181502 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1901) took 2014 ms. Trace:
I20260709 13:09:36.182317 29437 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:36.183260 29437 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:36.183699 29761 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.001s
I20260709 13:09:36.184279 29761 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:36.185715 29320 consensus_meta.cc:287] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.000s
I20260709 13:09:36.186024 29732 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:36.186754 29477 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.187911 29737 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.149194 29861 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.188733 29861 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.015554 29841 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.191344 29786 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.191936 29841 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.016492 29729 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:36.192418 29786 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.193101 29729 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:36.131237 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 252966us
I20260709 13:09:36.159384 29845 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.196626 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.197059 29845 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.198021 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.198155 29802 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.199541 29842 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.200817 29842 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:36.123711 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 114092us
I20260709 13:09:36.087239 29782 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:36.207223 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46022.7us
I20260709 13:09:36.032920 29650 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.107970 29673 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.150039 28978 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.146698 29847 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.077556 29808 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.077915 29681 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.086730 29738 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.113214 29857 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.083606 29538 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.139181 29671 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.175119 27336 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:36.203532 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.205675 29831 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.207391 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:36.145900 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.208369 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.207418 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.181903 27343 rpcz_store.cc:276] 0709 13:09:34.167014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.172510 (+  5496us) service_pool.cc:224] Handling call
0709 13:09:34.175658 (+  3148us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:34.176037 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:34.176065 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:34.757548 (+581483us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b2c0000e678. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:09:34.758251 (+   703us) log.cc:844] Serialized 52 byte log entry
0709 13:09:35.440492 (+682241us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:35.902978 (+462486us) log.cc:844] Serialized 14 byte log entry
0709 13:09:35.906555 (+  3577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.906650 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.181191 (+274541us) raft_consensus.cc:1685] finished
0709 13:09:36.181292 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.181440 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":631645,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":4989,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":167,"spinlock_wait_cycles":13140864,"thread_start_us":1129784,"threads_started":2,"wal-append.queue_time_us":1024991}
I20260709 13:09:36.228426 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:36.151491 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:36.223480 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:36.230167 28011 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.231113 28978 raft_consensus.cc:2764] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:36.231076 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.233182 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:36.233975 27343 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.234220 27308 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:36.187023 29761 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.180430 29617 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:36.221905 29811 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 13:09:36.191119 29861 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:36.213640 29663 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.737s	user 0.005s	sys 0.005s
I20260709 13:09:36.244767 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:36.253587 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.292801 27339 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:36.220774 29320 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:36.296546 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48354.1us
I20260709 13:09:36.221809 29846 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:36.303417 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 254307us
I20260709 13:09:36.306939 28978 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:36.308064 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68202.8us
I20260709 13:09:36.312100 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:36.210177 29766 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:36.314813 27343 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:36.236074 29782 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:36.344203 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.237524 29862 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:36.245100 29746 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:36.211385 29709 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.223042 29477 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 13:09:36.359992 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48014.6us
I20260709 13:09:36.215291 29834 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.366773 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:36.342698 29845 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:09:36.367261 29873 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.296128 29811 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.296316 29663 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:36.379639 29695 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
I20260709 13:09:36.237093 29538 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.381115 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.368207 29849 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:36.369050 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:36.383121 29719 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:36.384408 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 278) took 1042 ms. Trace:
I20260709 13:09:36.242372 29831 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.411928 27417 rpcz_store.cc:276] 0709 13:09:35.341783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.437421 (+ 95638us) service_pool.cc:224] Handling call
0709 13:09:35.437798 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.740020 (+302222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:36.019943 (+279923us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.219733 (+199790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:36.219817 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.219903 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.384162 (+164259us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54000e9554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:36.384209 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.384344 (+   135us) inbound_call.cc:177] Queueing success response
0709 13:09:36.393303 (+  8959us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b18000c6dc0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1
Metrics: {"mutex_wait_us":31456,"prepare.queue_time_us":481009,"prepare.run_wall_time_us":35,"raft.queue_time_us":89652,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":44304,"spinlock_wait_cycles":776826368,"thread_start_us":448278,"threads_started":2,"wal-append.queue_time_us":350870}
I20260709 13:09:36.241397 29639 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:09:36.311117 29846 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:36.375842 28008 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:36.398698 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:36.391557 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.430171 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.430508 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.431001 27343 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:36.431612 29863 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.431988 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.432137 29863 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:36.432277 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:36.432605 29863 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.432983 27268 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:36.433619 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.408890 27339 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.434970 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.435298 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:36.436000 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:36.436714 27343 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:36.437433 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.438373 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.411073 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:36.292552 29860 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:09:36.439459 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:36.440090 27268 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:36.412712 27340 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.440826 27343 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:36.417511 27263 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:09:36.376343 29824 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
I20260709 13:09:36.388736 29853 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.442562 29824 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:36.442668 29853 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.445446 29853 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.425436 27335 raft_consensus.cc:2368] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8.
I20260709 13:09:36.425606 27342 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:36.398299 29873 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:36.366556 29861 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.446537 29873 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.369246 28007 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:36.374790 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.408037 29761 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:36.448257 29761 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.448478 27338 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:36.448719 29761 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.449448 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.450086 27338 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:36.451718 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.452360 27264 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.452926 27263 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:36.458277 29761 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.441924 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.446586 29861 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.459491 29861 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.459749 27264 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:36.462499 27263 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:36.451036 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:36.464154 27338 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:36.467636 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.468307 27267 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.468396 27268 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.468127 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:36.388779 29767 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:36.470820 29767 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:36.471323 27339 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:36.471755 29767 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.473232 29767 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:36.473305 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.475397 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44973.9us
I20260709 13:09:36.476393 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:36.477103 27267 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:36.477219 29860 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.477738 29860 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.478101 29860 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.479450 27338 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:36.481606 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.482371 27263 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.486192 29860 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.487383 29873 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.371095 29802 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:36.295555 29856 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.166s
I20260709 13:09:36.411756 29725 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.492228 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:36.492884 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.530414 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:36.377624 29617 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:36.495887 27265 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:36.385372 29808 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:36.496384 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 330795us
W20260709 13:09:36.531538 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.385842 29738 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:36.498430 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 290106us
I20260709 13:09:36.499094 27343 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:36.386880 29681 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.490717 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.503908 27263 raft_consensus.cc:2410] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:36.509112 27268 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:36.370785 29671 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:36.532863 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 325499us
W20260709 13:09:36.534637 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.016s
W20260709 13:09:36.536535 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45887.2us
W20260709 13:09:36.542339 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.004s	sys 0.016s
I20260709 13:09:36.542656 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:36.490180 29846 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:36.547645 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.373699 29640 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:36.540000 27380 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.939s (SENT)
I20260709 13:09:36.418010 29695 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:36.543150 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 649748us
I20260709 13:09:36.531077 27336 raft_consensus.cc:2376] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6. Re-sending same reply.
I20260709 13:09:36.491228 29845 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:36.427697 29849 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:36.549712 27262 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:36.574034 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.368392 29862 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.551465 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:36.556596 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.387132 29782 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.468173 29861 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.586874 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.589318 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.576404 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:36.557461 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.579418 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.537943 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:36.546218 29843 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.552134 29671 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.497658 29847 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.713708 27416 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:36.595914 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 294232us
W20260709 13:09:36.860844 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 281555us
I20260709 13:09:36.648373 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:36.861559 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:36.673420 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.863592 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 295) took 1202 ms. Trace:
I20260709 13:09:36.863736 27413 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:36.864125 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:36.819891 28011 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.005s
I20260709 13:09:36.865175 28011 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:36.644331 27341 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:36.866689 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 328818us
W20260709 13:09:36.635145 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.551981 29617 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.862650 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:36.871707 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.613544 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.603021 28999 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:36.685534 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:36.877172 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.880847 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:36.890184 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.863994 27334 rpcz_store.cc:276] 0709 13:09:35.661296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.683696 (+ 22400us) service_pool.cc:224] Handling call
0709 13:09:35.736132 (+ 52436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.741032 (+  4900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.741573 (+   541us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.748163 (+  6590us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.990696 (+242533us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.304232 (+313536us) log.cc:844] Serialized 14 byte log entry
0709 13:09:36.602814 (+298582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.611908 (+  9094us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.611997 (+    89us) raft_consensus.cc:1685] finished
0709 13:09:36.612015 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.863536 (+251521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":326,"prepare.queue_time_us":168173,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":59879,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":40695,"thread_start_us":807586,"threads_started":3,"wal-append.queue_time_us":372724}
W20260709 13:09:36.892014 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 315678us
I20260709 13:09:36.648885 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:36.760215 29880 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:09:36.893057 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.894810 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.873816 29719 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:36.768342 29709 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.577090 29652 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.317s
I20260709 13:09:36.770792 29862 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.873934 29845 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.667320 29737 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:36.878841 29874 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:36.907720 27334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:36.643771 29870 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:36.912927 27334 raft_consensus.cc:606] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:36.904450 27343 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 7. Ops: []
I20260709 13:09:36.553092 29855 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.336s
I20260709 13:09:36.893625 29808 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:36.898679 27267 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:09:36.859540 29873 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.878448 29844 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:36.876143 29617 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.577256 29853 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.317s
I20260709 13:09:36.874002 29843 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:36.874125 29671 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:36.913297 27334 raft_consensus.cc:614] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:36.902542 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.916556 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.668798 29884 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:36.859535 29849 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:36.588976 28943 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.316s
I20260709 13:09:36.967092 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:36.901288 29709 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.874071 29856 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:09:36.901060 29719 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:37.008069 29899 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:09:37.008482 29719 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:09:37.010275 29882 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:09:36.893354 29746 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.011551 29746 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:36.971995 29844 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.916775 29870 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.977449 29617 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:36.908444 29845 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:36.979955 29843 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:37.014478 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 119220us
I20260709 13:09:36.968894 29834 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:36.901983 29766 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:09:36.965750 29663 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:36.974222 29808 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:36.919550 29811 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:37.019384 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 119003us
I20260709 13:09:37.027889 29844 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:36.972039 29874 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:37.028832 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 148076us
I20260709 13:09:36.980103 29671 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.066946 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:37.088395 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:36.984664 29884 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:36.977003 29873 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:36.987578 29538 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:37.013746 29737 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:36.906881 29863 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:37.118979 29842 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.915s	user 0.013s	sys 0.000s
I20260709 13:09:37.112480 29860 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.028674 29870 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.018390 29709 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.065158 29640 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:37.079922 29845 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:37.129927 29887 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 13:09:37.131668 29738 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:36.898605 29890 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:37.120292 29767 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.000s
W20260709 13:09:37.122865 29786 consensus_meta.cc:287] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.927s	user 0.005s	sys 0.006s
W20260709 13:09:37.124334 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57487.5us
I20260709 13:09:37.168761 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:37.134696 27267 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:37.173440 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.176301 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.177948 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.179402 29904 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:37.180184 29904 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:37.181408 29904 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:37.123078 29808 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.139791 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.184594 27410 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.187987 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 287) took 1687 ms. Trace:
I20260709 13:09:37.188536 27342 rpcz_store.cc:276] 0709 13:09:35.501030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.505240 (+  4210us) service_pool.cc:224] Handling call
0709 13:09:35.505617 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.446421 (+940804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.187632 (+741211us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540025c6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:37.187903 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115243904}
I20260709 13:09:37.132836 29889 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:09:37.147522 29874 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.115211 29650 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:37.135928 29893 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:09:37.128099 29884 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.160499 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:37.204006 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43584.5us
I20260709 13:09:37.206548 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:37.207417 29906 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:37.208187 29906 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:37.209411 29906 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.136827 29737 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:37.212423 29737 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.178905 27262 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:37.224990 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.139149 29842 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.142223 29695 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:37.231474 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:37.201833 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.233084 27415 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:37.234138 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:37.152165 29738 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.175091 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.239977 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:37.240980 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:37.133013 29873 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.160120 29861 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:37.251708 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:37.254457 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:37.248871 29650 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:37.269171 29650 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:37.270321 29900 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:09:37.265645 29767 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:37.226253 29709 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.273993 29671 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.274708 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:37.276180 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.276832 27267 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:37.277273 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.278455 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.278591 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:37.266405 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.281108 29650 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.281855 29650 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:37.255486 29888 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:09:37.282855 29650 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:37.283383 29650 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:37.163126 29890 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:37.284675 29890 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.285600 27267 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:37.283821 29845 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.285885 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1925) took 1056 ms. Trace:
I20260709 13:09:37.286396 27261 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:37.285600 29673 consensus_meta.cc:287] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.049s	user 0.008s	sys 0.000s
I20260709 13:09:37.285888 29671 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.287147 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 495) took 1379 ms. Trace:
I20260709 13:09:37.287456 29673 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.287662 28009 rpcz_store.cc:276] 0709 13:09:35.907441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.929839 (+ 22398us) service_pool.cc:224] Handling call
0709 13:09:36.108045 (+178206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.188805 (+ 80760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.188846 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.189895 (+  1049us) log.cc:844] Serialized 572 byte log entry
0709 13:09:36.496331 (+306436us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:36.532756 (+ 36425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.544259 (+ 11503us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.286919 (+742660us) raft_consensus.cc:1685] finished
0709 13:09:37.286938 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.287084 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239595,"threads_started":1,"wal-append.queue_time_us":516705}
I20260709 13:09:37.288885 29841 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:37.289290 29841 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:37.289515 29845 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:37.287753 29671 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:37.290427 29671 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:37.290156 29841 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.284370 29650 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.291455 29671 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.293053 29671 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:37.286316 27339 rpcz_store.cc:276] 0709 13:09:36.229575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.472542 (+242967us) service_pool.cc:224] Handling call
0709 13:09:36.472930 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.473643 (+   713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.473676 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.474273 (+   597us) log.cc:844] Serialized 52 byte log entry
0709 13:09:36.664423 (+190150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:36.664481 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.664579 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:37.285662 (+621083us) raft_consensus.cc:1685] finished
0709 13:09:37.285684 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:37.285828 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":189663,"threads_started":1,"wal-append.queue_time_us":804900}
I20260709 13:09:37.291934 29719 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.299867 27266 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:37.300539 29863 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:37.302824 29719 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:37.310657 29802 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.815s	user 0.005s	sys 0.002s
I20260709 13:09:37.311370 29695 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:37.311861 29695 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.312252 29695 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:37.322548 29846 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.765s	user 0.004s	sys 0.004s
W20260709 13:09:37.334296 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.279070 27268 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:37.344976 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:37.230556 29746 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:37.347146 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67001.3us
W20260709 13:09:37.351805 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 219477us
I20260709 13:09:37.166769 29729 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:09:37.252213 29738 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.166610 29538 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:09:37.251911 29894 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:37.242180 29847 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.266559 29786 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:37.229676 29842 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.704993 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1929) took 1474 ms. Trace:
I20260709 13:09:37.473835 27261 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:09:37.529960 27260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.004s
W20260709 13:09:37.757296 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.857247 27266 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.438580 27410 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:37.388916 27339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:37.420352 27263 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:37.880349 27339 raft_consensus.cc:606] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:37.521484 27336 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:09:37.716907 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.447489 28999 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.466101 27334 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:37.722041 28978 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.464608 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:37.489872 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.724473 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.472400 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.425849 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.883924 27408 raft_consensus.cc:2376] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5. Re-sending same reply.
I20260709 13:09:37.471835 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 296) took 1778 ms. Trace:
I20260709 13:09:37.756218 27268 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:37.884513 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1696) took 1234 ms. Trace:
I20260709 13:09:37.884966 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.883463 27416 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:37.881619 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:37.756407 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 393171us
I20260709 13:09:37.884238 27413 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
W20260709 13:09:37.606614 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.447100 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:37.883812 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.521184 27337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 293) took 1896 ms (client timeout 1760 ms). Trace:
I20260709 13:09:37.705508 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1159) took 1295 ms. Trace:
W20260709 13:09:37.486796 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 141892us
W20260709 13:09:37.530318 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 275970us
I20260709 13:09:37.882829 28978 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.465442 27335 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:09:37.900019 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:37.420300 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:37.521742 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 47857.1us
I20260709 13:09:37.880719 27339 raft_consensus.cc:614] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:37.708956 27409 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.885674 27340 rpcz_store.cc:276] 0709 13:09:35.693253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.693392 (+   139us) service_pool.cc:224] Handling call
0709 13:09:35.693689 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.440937 (+747248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.471613 (+1030676us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54001fb654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:37.471769 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653235968}
I20260709 13:09:37.421391 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1930) took 1190 ms. Trace:
I20260709 13:09:37.899307 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1711) took 1144 ms. Trace:
I20260709 13:09:37.895588 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:37.449335 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:37.500979 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.907333 27413 rpcz_store.cc:276] 0709 13:09:36.754849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.864463 (+109614us) service_pool.cc:224] Handling call
0709 13:09:37.472242 (+607779us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:37.899227 (+426985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11675008}
I20260709 13:09:37.702040 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.908535 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1692) took 1261 ms. Trace:
I20260709 13:09:37.908947 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.904834 27414 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:37.893759 27341 rpcz_store.cc:276] 0709 13:09:36.230516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.536720 (+306204us) service_pool.cc:224] Handling call
0709 13:09:36.537298 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.867676 (+330378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.704691 (+837015us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b54001685d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:37.704919 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117857664}
I20260709 13:09:37.909803 27413 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.908895 27409 rpcz_store.cc:276] 0709 13:09:36.646998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.647113 (+   115us) service_pool.cc:224] Handling call
0709 13:09:37.708396 (+1061283us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:37.708677 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.905771 (+197094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.908481 (+  2710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55432448}
I20260709 13:09:37.910177 27335 pending_rounds.cc:85] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 6
I20260709 13:09:37.910696 27335 pending_rounds.cc:107] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:37.911077 27335 raft_consensus.cc:2889] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:37.912060 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:37.912562 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:37.912797 27341 raft_consensus.cc:2376] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7. Re-sending same reply.
W20260709 13:09:37.877548 27260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.005s	sys 0.007s
W20260709 13:09:37.892457 27337 rpcz_store.cc:269] 0709 13:09:35.624820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.624975 (+   155us) service_pool.cc:224] Handling call
0709 13:09:37.520918 (+1895943us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:37.521088 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852833536}
I20260709 13:09:37.881592 27417 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:37.906942 27343 rpcz_store.cc:276] 0709 13:09:36.230737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.537008 (+306271us) service_pool.cc:224] Handling call
0709 13:09:36.540763 (+  3755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.913475 (+372712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.421091 (+507616us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002db254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:37.421319 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835761024}
I20260709 13:09:37.916201 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1716) took 1159 ms. Trace:
I20260709 13:09:37.916793 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:37.858126 29870 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.000s
I20260709 13:09:37.916728 27417 rpcz_store.cc:276] 0709 13:09:36.756654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.862768 (+106114us) service_pool.cc:224] Handling call
0709 13:09:37.716681 (+853913us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:37.916129 (+199448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12159360}
I20260709 13:09:37.908169 27342 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:37.881824 28999 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.934716 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1710) took 1180 ms. Trace:
I20260709 13:09:37.973309 27408 rpcz_store.cc:276] 0709 13:09:36.754616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.884717 (+1130101us) service_pool.cc:224] Handling call
0709 13:09:37.926657 (+ 41940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.924757 27266 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:37.976199 27413 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:37.850395 29808 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.667s	user 0.005s	sys 0.005s
I20260709 13:09:37.803655 29673 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.987890 28011 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:37.989831 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.990805 27417 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:37.907298 27265 rpcz_store.cc:276] 0709 13:09:36.410590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.410746 (+   156us) service_pool.cc:224] Handling call
0709 13:09:37.705244 (+1294498us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b54003d0254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:37.705424 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129123072}
I20260709 13:09:37.909858 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1691) took 1263 ms. Trace:
I20260709 13:09:37.992316 27414 rpcz_store.cc:276] 0709 13:09:36.646709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.649052 (+  2343us) service_pool.cc:224] Handling call
0709 13:09:37.420118 (+771066us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:37.909803 (+489685us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55265024}
I20260709 13:09:37.926939 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:37.918535 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1698) took 1212 ms. Trace:
W20260709 13:09:37.819844 29883 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.106s	user 0.006s	sys 0.000s
I20260709 13:09:37.942801 27343 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:37.689282 29844 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
W20260709 13:09:37.617843 29897 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:09:37.847931 29861 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:37.936686 27383 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:37.822072 29843 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.002s
W20260709 13:09:37.949302 27380 connection.cc:256] RPC call timeout handler was delayed by -1.6939809859999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:09:38.011711 27380 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.937s (SENT)
I20260709 13:09:38.012226 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.756534 29841 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:37.556356 28943 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:37.987471 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.021138 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:38.023260 27265 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:37.710714 29831 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:37.955729 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.026081 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:38.027892 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:37.466442 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.034519 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1167) took 1573 ms. Trace:
I20260709 13:09:38.035045 27264 rpcz_store.cc:276] 0709 13:09:36.461287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.462132 (+   845us) service_pool.cc:224] Handling call
0709 13:09:36.462532 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:36.463341 (+   809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.463383 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.463896 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.589977 (+126081us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:36.590032 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.590131 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:38.034276 (+1444145us) raft_consensus.cc:1685] finished
0709 13:09:38.034300 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:38.034458 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"thread_start_us":125632,"threads_started":1,"wal-append.queue_time_us":779676}
I20260709 13:09:38.037958 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:37.953176 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1737) took 1706 ms. Trace:
I20260709 13:09:38.009608 29861 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:37.918269 29890 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
I20260709 13:09:37.455180 29746 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.009846 29913 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.885090 27411 rpcz_store.cc:276] 0709 13:09:36.650113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.650247 (+   134us) service_pool.cc:224] Handling call
0709 13:09:37.425620 (+775373us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:37.884442 (+458822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54656256}
I20260709 13:09:37.977733 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.417634 29546 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:37.351565 29846 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:37.716149 29761 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.797668 29857 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:37.876668 29873 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:37.822001 29884 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 13:09:37.985203 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.056454 27408 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:38.057096 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1708) took 1302 ms. Trace:
I20260709 13:09:38.057495 27408 rpcz_store.cc:276] 0709 13:09:36.754182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.974344 (+1220162us) service_pool.cc:224] Handling call
0709 13:09:38.057025 (+ 82681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.950251 29911 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:37.994341 27416 rpcz_store.cc:276] 0709 13:09:36.705805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.427881 (+722076us) service_pool.cc:224] Handling call
0709 13:09:37.918473 (+490592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:37.926894 29729 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.996119 28978 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.382939 29778 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.581s
I20260709 13:09:37.571197 29871 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.385s
I20260709 13:09:38.004818 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.063038 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:38.066149 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:37.986881 29808 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.008071 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.008831 28999 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:37.476838 29847 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.068053 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.067968 29847 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.068637 27416 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:38.069099 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1717) took 1155 ms. Trace:
I20260709 13:09:38.069379 27416 rpcz_store.cc:276] 0709 13:09:36.913401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.058885 (+1145484us) service_pool.cc:224] Handling call
0709 13:09:38.069044 (+ 10159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.070044 29847 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.070307 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:38.070890 27416 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:37.927090 29625 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:09:38.015064 27380 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:38.015975 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1718) took 1102 ms. Trace:
I20260709 13:09:38.072118 27414 rpcz_store.cc:276] 0709 13:09:36.913704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.993284 (+1079580us) service_pool.cc:224] Handling call
0709 13:09:38.015885 (+ 22601us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:38.072441 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57501.4us
I20260709 13:09:38.073145 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.073935 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1701) took 1359 ms. Trace:
I20260709 13:09:38.074244 27414 rpcz_store.cc:276] 0709 13:09:36.714482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.072883 (+1358401us) service_pool.cc:224] Handling call
0709 13:09:38.073878 (+   995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.005759 29844 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.464576 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.025358 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:37.668671 29834 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.604234 29709 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:38.029721 27266 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:38.034317 27267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.002s	sys 0.013s
I20260709 13:09:38.039402 27336 rpcz_store.cc:276] 0709 13:09:36.246799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.669744 (+422945us) service_pool.cc:224] Handling call
0709 13:09:37.521115 (+851371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.881274 (+360159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:37.952931 (+ 71657us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540032ffd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:37.953103 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514145024}
I20260709 13:09:37.464576 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.017138 29843 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:37.985471 29870 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.039014 27264 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:38.041436 29890 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.042266 29746 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.094365 28013 raft_consensus.cc:2368] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:38.098285 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:38.045337 29617 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.951s	user 0.010s	sys 0.002s
I20260709 13:09:38.045179 29861 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.046388 27412 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
W20260709 13:09:38.106781 27412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1690) took 1460 ms (client timeout 1639 ms). Trace:
I20260709 13:09:38.047732 29842 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.016722 29737 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.016650 28943 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.024487 29650 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.059787 28978 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:37.995978 29874 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.015s
I20260709 13:09:38.067327 27408 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:38.067524 28999 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:09:38.013772 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 77208.8us
I20260709 13:09:38.075317 27380 leader_election.cc:400] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8.
I20260709 13:09:38.075117 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:38.086328 27267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.002s	sys 0.013s
I20260709 13:09:37.828266 29851 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:38.081785 28010 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:38.089494 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:38.043637 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:38.094444 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:38.095155 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:38.065016 29546 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:38.092425 27261 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:38.075070 29909 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:38.100720 28009 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:38.100883 29846 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:38.102540 29746 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:38.103217 28015 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:38.735630 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:38.736969 27337 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:38.104449 29890 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:38.090993 28007 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:38.107403 27412 rpcz_store.cc:269] 0709 13:09:36.646426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.646543 (+   117us) service_pool.cc:224] Handling call
0709 13:09:37.701779 (+1055236us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:38.106703 (+404924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55748992}
I20260709 13:09:38.757839 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:38.114073 27259 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:38.126112 27266 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:38.126763 27380 leader_election.cc:403] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:38.127424 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:38.126072 28978 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.130805 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 285) took 1222 ms. Trace:
I20260709 13:09:38.759768 27408 rpcz_store.cc:276] 0709 13:09:36.908268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.058320 (+1150052us) service_pool.cc:224] Handling call
0709 13:09:38.129153 (+ 70833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.131403 28999 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:38.084826 29868 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:38.131544 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1713) took 1376 ms. Trace:
I20260709 13:09:38.760665 27414 rpcz_store.cc:276] 0709 13:09:36.755500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.074867 (+1319367us) service_pool.cc:224] Handling call
0709 13:09:38.131480 (+ 56613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.078963 29729 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.762389 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 380) took 1315 ms. Trace:
W20260709 13:09:38.133014 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.019s
I20260709 13:09:38.762840 28007 rpcz_store.cc:276] 0709 13:09:37.446562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.453427 (+  6865us) service_pool.cc:224] Handling call
0709 13:09:38.762293 (+1308866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44160}
W20260709 13:09:38.763415 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.011s	sys 0.019s
W20260709 13:09:38.763903 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.31286e+06us
I20260709 13:09:38.764987 28978 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.144302 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:38.128086 29874 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.016s
I20260709 13:09:38.125669 29861 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:38.151371 29914 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:09:38.767702 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.768929 27414 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:38.769483 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1712) took 2014 ms. Trace:
I20260709 13:09:38.769917 27414 rpcz_store.cc:276] 0709 13:09:36.755082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.767286 (+2012204us) service_pool.cc:224] Handling call
0709 13:09:38.769407 (+  2121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.088940 29834 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.117043 28943 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.772707 29729 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:38.131157 29851 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:38.774080 29851 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.775520 29851 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:38.778571 28943 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.778892 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:38.147673 29546 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.780056 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1252) took 1431 ms. Trace:
I20260709 13:09:38.780581 28943 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:38.780534 27414 rpcz_store.cc:276] 0709 13:09:37.348830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.770857 (+1422027us) service_pool.cc:224] Handling call
0709 13:09:38.779976 (+  9119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.781280 29546 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.154945 27416 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:38.374433 29849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.040s	sys 0.060s
I20260709 13:09:38.460603 29761 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.138352 29650 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.510073 29843 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:38.587042 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.015s	sys 0.030s
I20260709 13:09:38.782651 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:38.782334 29761 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:38.783114 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.015s	sys 0.030s
I20260709 13:09:38.783308 27414 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:38.783524 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 883561us
W20260709 13:09:38.569029 29869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.049s	sys 0.102s
I20260709 13:09:38.796691 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.797739 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1707) took 2043 ms. Trace:
W20260709 13:09:38.723423 29786 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.333s	user 0.018s	sys 0.004s
W20260709 13:09:38.727197 29918 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.692s	user 0.001s	sys 0.011s
I20260709 13:09:38.728503 29870 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:38.091251 29709 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:38.524688 27342 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.011s	sys 0.019s
I20260709 13:09:38.111577 29617 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.075963 29884 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.054912 29913 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.733907 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:38.735874 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:38.738217 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:38.828929 27340 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 3.
W20260709 13:09:38.758857 29841 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.736s	user 0.000s	sys 0.017s
I20260709 13:09:38.795498 29761 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:38.883406 29927 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:38.884088 29808 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.745512 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:38.748255 28011 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:39.087056 29922 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.264s	user 0.002s	sys 0.010s
W20260709 13:09:38.450420 27233 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.013s	sys 0.027s
W20260709 13:09:39.270256 27233 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.014s	sys 0.028s
W20260709 13:09:38.525321 27260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.027s	sys 0.091s
W20260709 13:09:38.525152 27263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.003s	sys 0.007s
W20260709 13:09:39.272075 27263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.003s	sys 0.013s
W20260709 13:09:38.740808 27265 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.005s
I20260709 13:09:39.274123 27265 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:39.086320 27980 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 2.177s (SENT) [suppressed 39 similar messages]
W20260709 13:09:39.275033 27265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1178) took 1255 ms (client timeout 1546 ms). Trace:
W20260709 13:09:39.275588 27265 rpcz_store.cc:269] 0709 13:09:38.019431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.020841 (+  1410us) service_pool.cc:224] Handling call
0709 13:09:39.274876 (+1254035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:38.745090 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.224534 27264 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:38.790767 27413 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:39.279444 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1180) took 1259 ms. Trace:
I20260709 13:09:39.279904 27264 rpcz_store.cc:276] 0709 13:09:38.020052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.094150 (+ 74098us) service_pool.cc:224] Handling call
0709 13:09:39.279180 (+1185030us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540024c7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.279387 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516355968}
W20260709 13:09:39.280957 27413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1705) took 2527 ms (client timeout 2138 ms). Trace:
W20260709 13:09:39.281459 27413 rpcz_store.cc:269] 0709 13:09:36.753518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.977403 (+1223885us) service_pool.cc:224] Handling call
0709 13:09:39.280407 (+1303004us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540036ae54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.280602 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636971776}
I20260709 13:09:39.282433 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1179) took 1262 ms. Trace:
I20260709 13:09:39.278746 27163 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 128) took 10164 ms. Trace:
I20260709 13:09:38.828231 27335 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:39.283821 29546 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.284528 29546 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:39.285056 29546 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:38.740206 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:38.739377 27337 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:38.782075 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1257) took 1176 ms. Trace:
I20260709 13:09:39.113248 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:39.235968 27338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.006s	sys 0.015s
I20260709 13:09:38.830225 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:38.818859 27342 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.011s	sys 0.025s
W20260709 13:09:39.312064 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 1.18455e+06us
W20260709 13:09:39.313575 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.314529 29437 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.226684 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.092238 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 499) took 1197 ms. Trace:
I20260709 13:09:39.087147 27409 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:39.089740 27411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1240) took 1964 ms (client timeout 2201 ms). Trace:
I20260709 13:09:39.317720 28013 rpcz_store.cc:276] 0709 13:09:37.894471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.895307 (+   836us) service_pool.cc:224] Handling call
0709 13:09:39.092010 (+1196703us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540050fd54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.092170 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428580096}
I20260709 13:09:39.318351 29861 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:39.114713 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 348) took 2892 ms. Trace:
I20260709 13:09:39.318864 29861 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:39.319389 28015 rpcz_store.cc:276] 0709 13:09:36.222302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.236699 (+ 14397us) service_pool.cc:224] Handling call
0709 13:09:36.895607 (+658908us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:36.895843 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.740266 (+1844423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.114385 (+374119us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000311d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.114636 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778510464}
W20260709 13:09:39.320295 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.320393 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.086654 29709 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.321915 28007 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:39.322350 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.238523 27417 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:39.322878 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.099968 29778 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.323901 29778 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:39.098621 29782 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.324935 29906 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.325555 29782 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:38.064473 29857 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:39.315248 27338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.007s	sys 0.016s
I20260709 13:09:39.326009 29906 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.315155 29437 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.326742 27161 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:39.327915 29437 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.329195 29906 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.329370 29857 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:39.091877 27412 raft_consensus.cc:2410] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:38.795804 29869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.058s	sys 0.157s
I20260709 13:09:38.760968 28999 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:39.332767 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.332592 29756 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:39.333791 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.334398 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.333693 29756 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.772845 29834 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:38.735610 29847 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.759068 29738 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.367s	user 0.011s	sys 0.010s
I20260709 13:09:39.336839 29738 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:38.749559 29746 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.338968 27262 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:39.338809 29909 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:39.340070 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:39.339944 29746 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.340427 29909 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:39.340691 29617 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:39.340955 29909 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:39.125264 29650 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:38.828624 29786 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:39.180320 29884 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:39.101696 29695 consensus_meta.cc:287] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.789s	user 0.009s	sys 0.022s
I20260709 13:09:38.752137 29844 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:38.782143 29849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.041s	sys 0.060s
I20260709 13:09:39.314777 27416 rpcz_store.cc:276] 0709 13:09:37.605993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.070073 (+464080us) service_pool.cc:224] Handling call
0709 13:09:38.782012 (+711939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.343915 29695 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:38.798130 27408 rpcz_store.cc:276] 0709 13:09:36.753967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.786505 (+2032538us) service_pool.cc:224] Handling call
0709 13:09:38.797668 (+ 11163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.231925 27268 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: []
W20260709 13:09:39.085517 27978 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.531s (SENT)
I20260709 13:09:39.090054 29912 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:38.749215 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.247989 29926 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.249222 29930 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.899750 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.100994 29936 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:38.751416 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1948) took 1615 ms. Trace:
I20260709 13:09:39.250267 29933 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.525815 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.265043 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.006s
I20260709 13:09:39.231034 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 277) took 2142 ms. Trace:
I20260709 13:09:39.282900 27264 rpcz_store.cc:276] 0709 13:09:38.019731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.281051 (+1261320us) service_pool.cc:224] Handling call
0709 13:09:39.281584 (+   533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.281950 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.281975 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.282035 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:39.282112 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.282197 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.282340 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.271088 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:39.271075 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.37841e+06us
W20260709 13:09:39.279065 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 533968us
I20260709 13:09:39.346108 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.355322 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.344285 29909 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:39.316212 27260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.037s	sys 0.166s
W20260709 13:09:39.348709 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 263105us
I20260709 13:09:39.286221 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:39.317772 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 279) took 2179 ms. Trace:
I20260709 13:09:39.360186 27265 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:39.318691 27411 rpcz_store.cc:269] 0709 13:09:37.125725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.131989 (+1006264us) service_pool.cc:224] Handling call
0709 13:09:38.881470 (+749481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.349154 29912 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:39.361042 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.362100 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.362721 29709 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.363330 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1256) took 1810 ms. Trace:
I20260709 13:09:39.324769 29737 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.363831 29709 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.325711 29870 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8.
I20260709 13:09:39.364374 29709 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.336685 29847 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.350062 27341 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.350301 29930 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.366539 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:39.367149 27341 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:39.367322 29847 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.094808 27414 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:39.368193 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.368333 29930 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:39.368707 27414 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1247) took 2220 ms (client timeout 2357 ms). Trace:
I20260709 13:09:39.362903 29912 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.303201 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 358) took 1257 ms. Trace:
I20260709 13:09:39.353510 29834 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:39.347252 27410 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:39.369282 27414 rpcz_store.cc:269] 0709 13:09:37.148158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.781592 (+1633434us) service_pool.cc:224] Handling call
0709 13:09:39.368470 (+586878us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.352029 29933 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.351701 27261 rpcz_store.cc:276] 0709 13:09:37.135676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.917796 (+782120us) service_pool.cc:224] Handling call
0709 13:09:37.983623 (+ 65827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.145889 (+162266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:38.751140 (+605251us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540032a854. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:38.751358 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249658112}
W20260709 13:09:39.352147 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.007s
I20260709 13:09:39.372195 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.369737 28011 rpcz_store.cc:276] 0709 13:09:38.045756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.130433 (+ 84677us) service_pool.cc:224] Handling call
0709 13:09:38.747905 (+617472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.288994 (+541089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.302650 (+ 13656us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b540012fcd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.302920 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1419166592}
I20260709 13:09:39.348759 29782 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.345744 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.373812 29933 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:39.374289 29782 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.374714 27416 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:39.375351 27416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1706) took 2621 ms (client timeout 2915 ms). Trace:
I20260709 13:09:39.351234 27339 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.364367 29737 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.346331 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.376783 27337 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.376994 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.377995 27339 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.378135 29737 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.360760 29844 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.370879 29834 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:39.364884 29709 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.320926 29861 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.315433 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.370347 29912 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.354876 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 284) took 1314 ms. Trace:
I20260709 13:09:39.390437 29834 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.347102 29695 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.360850 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.382946 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:39.392222 27335 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.392977 29673 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:39.393819 29673 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:39.381994 27231 leader_election.cc:336] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.569s (SENT)
I20260709 13:09:39.394753 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:39.354274 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.349819 29926 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.396775 27340 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.379081 29844 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:39.353693 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83135.4us
I20260709 13:09:39.368920 27341 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.363832 27411 rpcz_store.cc:276] 0709 13:09:37.552586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.361661 (+1809075us) service_pool.cc:224] Handling call
0709 13:09:39.363239 (+  1578us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:39.390465 27413 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1714) took 2634 ms (client timeout 2804 ms). Trace:
W20260709 13:09:39.400269 27413 rpcz_store.cc:269] 0709 13:09:36.755932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.282915 (+2526983us) service_pool.cc:224] Handling call
0709 13:09:39.390374 (+107459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.137352 29913 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:39.400447 27416 rpcz_store.cc:269] 0709 13:09:36.753737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.345135 (+2591398us) service_pool.cc:224] Handling call
0709 13:09:39.375270 (+ 30135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.390950 27264 rpcz_store.cc:276] 0709 13:09:38.040709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.353190 (+1312481us) service_pool.cc:224] Handling call
0709 13:09:39.353753 (+   563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.354239 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.354269 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.354335 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:39.354506 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.354605 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.354800 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.379017 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.352191 27259 rpcz_store.cc:276] 0709 13:09:37.088857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.120084 (+ 31227us) service_pool.cc:224] Handling call
0709 13:09:37.129998 (+  9914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:38.758647 (+1628649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.230182 (+471535us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54001f8bd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.230729 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262666496}
I20260709 13:09:39.406567 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 285) took 1307 ms. Trace:
I20260709 13:09:39.407140 27261 rpcz_store.cc:276] 0709 13:09:38.097149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.395556 (+1298407us) service_pool.cc:224] Handling call
0709 13:09:39.396096 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.396460 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.396500 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.404337 (+  7837us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:39.404412 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.404514 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.404671 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.400992 29909 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.349478 29738 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:39.382694 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 503) took 1485 ms (client timeout 1944 ms). Trace:
I20260709 13:09:39.350529 29756 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:39.348003 29746 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.417017 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.418663 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 286) took 1309 ms. Trace:
W20260709 13:09:39.421247 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.420332 27266 rpcz_store.cc:276] 0709 13:09:38.106621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.225426 (+1118805us) service_pool.cc:224] Handling call
0709 13:09:39.415759 (+190333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.424484 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 271) took 2508 ms. Trace:
I20260709 13:09:39.424975 27260 rpcz_store.cc:276] 0709 13:09:36.916508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.917070 (+   562us) service_pool.cc:224] Handling call
0709 13:09:36.917445 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:36.917834 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:36.917872 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:36.981922 (+ 64050us) log.cc:844] Serialized 52 byte log entry
0709 13:09:37.913510 (+931588us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:39.358023 (+1444513us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.424008 (+ 65985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.424117 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.424202 (+    85us) raft_consensus.cc:1685] finished
0709 13:09:39.424215 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.424434 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67119,"prepare.queue_time_us":837304,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":906,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":51758,"thread_start_us":2294225,"threads_started":2,"wal-append.queue_time_us":914846}
I20260709 13:09:39.424435 29808 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.427636 29808 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.432557 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.441124 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.442227 28011 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:39.442945 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1945) took 2311 ms. Trace:
I20260709 13:09:39.443562 27262 rpcz_store.cc:276] 0709 13:09:37.131343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.703006 (+571663us) service_pool.cc:224] Handling call
0709 13:09:37.703540 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.339658 (+1636118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.442577 (+102919us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540024b3d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.442860 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3759820544}
I20260709 13:09:39.445091 29737 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:39.449958 29778 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.451251 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.452054 29870 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.452905 29870 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:39.453051 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.435420 27416 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:39.464063 27340 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:39.456373 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.467475 27337 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:09:39.446946 27412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1243) took 2320 ms (client timeout 2220 ms). Trace:
I20260709 13:09:39.468741 28011 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:39.468830 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 86934.2us
I20260709 13:09:39.469554 29834 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.360368 27267 rpcz_store.cc:276] 0709 13:09:37.124951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.286280 (+161329us) service_pool.cc:224] Handling call
0709 13:09:37.286662 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:37.368910 (+ 82248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:37.368956 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:37.405083 (+ 36127us) log.cc:844] Serialized 26 byte log entry
0709 13:09:38.126550 (+721467us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:38.126596 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.232086 (+1105490us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b54001d97d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.232214 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.251247 (+ 19033us) raft_consensus.cc:1685] finished
0709 13:09:39.251264 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.304043 (+ 52779us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152047488,"thread_start_us":599673,"threads_started":1,"wal-append.queue_time_us":1380788}
W20260709 13:09:39.473161 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 90406.2us
I20260709 13:09:39.473331 27341 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:39.431600 29808 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:39.417703 27161 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 9, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 9 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:39.471441 27412 rpcz_store.cc:269] 0709 13:09:37.126240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.757556 (+1631316us) service_pool.cc:224] Handling call
0709 13:09:39.446579 (+689023us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000ada54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.446755 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765966720}
W20260709 13:09:39.478670 27409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1703) took 2763 ms (client timeout 2084 ms). Trace:
I20260709 13:09:39.476878 29857 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.411114 28006 rpcz_store.cc:269] 0709 13:09:37.896918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.918497 (+ 21579us) service_pool.cc:224] Handling call
0709 13:09:39.113108 (+1194611us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:09:39.382392 (+269284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66449280}
W20260709 13:09:39.479146 27409 rpcz_store.cc:269] 0709 13:09:36.715115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.928077 (+1212962us) service_pool.cc:224] Handling call
0709 13:09:39.478322 (+1550245us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54003c1c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.478495 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007289216}
W20260709 13:09:39.492615 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.492514 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.489967 27413 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:39.494614 27339 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 3: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:39.488534 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.489653 27411 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.395015 29673 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.490249 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.479156 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 300) took 2030 ms. Trace:
I20260709 13:09:39.495043 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1697) took 2844 ms. Trace:
I20260709 13:09:39.506083 27413 rpcz_store.cc:276] 0709 13:09:36.650460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.452660 (+2802200us) service_pool.cc:224] Handling call
0709 13:09:39.494966 (+ 42306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.502974 29873 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.506918 27262 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.489485 29761 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.483434 29926 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.474246 29861 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.512049 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.513441 27341 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.514763 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:39.516215 27341 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:39.517314 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.44252e+06us
I20260709 13:09:39.518337 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 283) took 1487 ms. Trace:
I20260709 13:09:39.519495 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.521337 27265 rpcz_store.cc:276] 0709 13:09:38.030728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.315542 (+1284814us) service_pool.cc:224] Handling call
0709 13:09:39.359880 (+ 44338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.517878 (+157998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.517913 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.517977 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.518023 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.518112 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.518253 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.522284 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:39.526103 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.481909 29778 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:39.531837 27231 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.639s (SENT)
I20260709 13:09:39.480319 27161 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:09:39.283540 27163 rpcz_store.cc:276] 0709 13:09:29.114385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.114680 (+   295us) service_pool.cc:224] Handling call
0709 13:09:39.278339 (+10163659us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:36.376671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:36.377240 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:36.377276 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:09:36.377293 (+    17us) tablet.cc:662] Decoding operations
0709 13:09:36.378054 (+   761us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:36.378121 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:36.378147 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:09:36.378646 (+   499us) tablet.cc:701] Row locks acquired
0709 13:09:36.378664 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:36.378790 (+   126us) write_op.cc:270] Start()
0709 13:09:36.378897 (+   107us) write_op.cc:276] Timestamp: P: 1783602576378749 usec, L: 0
0709 13:09:36.378918 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:09:36.495439 (+116521us) log.cc:844] Serialized 2144 byte log entry
0709 13:09:37.559241 (+1063802us) op_driver.cc:464] REPLICATION: finished
0709 13:09:37.801279 (+242038us) write_op.cc:301] APPLY: starting
0709 13:09:37.801497 (+   218us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:37.801737 (+   240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:37.801941 (+   204us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:37.802848 (+   907us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:37.805598 (+  2750us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:09:37.805647 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:37.808590 (+  2943us) log.cc:844] Serialized 47 byte log entry
0709 13:09:37.809649 (+  1059us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:37.809796 (+   147us) write_op.cc:454] Released schema lock
0709 13:09:37.809861 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:37.890026 (+ 80165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:37.917881 (+ 27855us) write_op.cc:454] Released schema lock
0709 13:09:38.783363 (+865482us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2e32a 00007fbd82bb3f14 00007fbd82bb3ec3 00007fbd82bb3e38 00007fbd82bb3df3 00007fbd82bb30dc 00007fbd82bdce16 00007fbd82bc4cbb 00007fbd82baf39d 00007fbd82bb2d75
Metrics: {"mutex_wait_us":389241,"reported_tablets":23,"spinlock_wait_cycles":786816,"child_traces":[["op",{"apply.queue_time_us":205117,"apply.run_cpu_time_us":3507,"apply.run_wall_time_us":9104,"num_ops":5,"prepare.queue_time_us":332490,"prepare.run_cpu_time_us":11780,"prepare.run_wall_time_us":212957,"raft.queue_time_us":373386,"raft.run_cpu_time_us":12884,"raft.run_wall_time_us":1374346,"replication_time_us":1097706,"spinlock_wait_cycles":38400256,"thread_start_us":538745,"threads_started":4,"wal-append.queue_time_us":351928,"wal-append.run_cpu_time_us":28100,"wal-append.run_wall_time_us":1975880}]]}
I20260709 13:09:39.505511 27338 rpcz_store.cc:276] 0709 13:09:37.448460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.448803 (+   343us) service_pool.cc:224] Handling call
0709 13:09:37.943979 (+495176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:38.105387 (+161408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:38.105421 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:38.112041 (+  6620us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.327208 (+1215167us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.327308 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.470087 (+142779us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000514d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.470134 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.470200 (+    66us) raft_consensus.cc:1685] finished
0709 13:09:39.470211 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.479077 (+  8866us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2133,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":6736,"spinlock_wait_cycles":370298240,"thread_start_us":1047123,"threads_started":1,"wal-append.queue_time_us":1111403}
I20260709 13:09:39.539327 27415 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 4.
I20260709 13:09:39.539420 27338 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:39.553817 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1951) took 2417 ms. Trace:
I20260709 13:09:39.552893 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.479681 29857 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.540745 29834 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:39.559675 29650 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:39.560673 27338 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:39.561335 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 147552us
I20260709 13:09:39.567747 27411 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 13:09:39.574349 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.556325 27268 rpcz_store.cc:276] 0709 13:09:37.136349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.917858 (+781509us) service_pool.cc:224] Handling call
0709 13:09:37.918147 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.346426 (+1428279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.528295 (+181869us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001f86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.553749 (+ 25454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019846400}
I20260709 13:09:39.507983 29761 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.553272 27412 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:39.455107 29870 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.581528 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:39.557047 27417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1237) took 2432 ms (client timeout 1820 ms). Trace:
I20260709 13:09:39.581321 27335 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:39.587322 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1699) took 2869 ms. Trace:
I20260709 13:09:39.587806 27411 rpcz_store.cc:276] 0709 13:09:36.713863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.523676 (+2809813us) service_pool.cc:224] Handling call
0709 13:09:39.546846 (+ 23170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.582884 (+ 36038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.583061 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:39.585515 27417 rpcz_store.cc:269] 0709 13:09:37.125105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.025061 (+899956us) service_pool.cc:224] Handling call
0709 13:09:39.550772 (+1525711us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000ad554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.556960 (+  6188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665475840}
I20260709 13:09:39.578680 28943 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.593441 27416 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:39.594086 27410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1241) took 2468 ms (client timeout 1617 ms). Trace:
I20260709 13:09:39.598658 27161 catalog_manager.cc:5697] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 2 to 3, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 3 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.600661 27161 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 4, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 4 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.602515 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 389016us
I20260709 13:09:39.603219 29650 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.603722 29650 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:39.604283 29756 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:39.604176 29936 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:09:39.604813 29650 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.605751 29936 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:39.606318 29650 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:39.608826 29944 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:39.609843 29808 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:39.611088 29808 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.611524 29808 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:39.604183 29746 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:09:39.557535 29926 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:09:39.618062 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.618697 27337 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.582010 29834 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:39.619293 29939 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:09:39.619428 29834 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:39.620832 27417 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:09:39.622411 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 287) took 2713 ms. Trace:
I20260709 13:09:39.623703 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 281) took 2195 ms. Trace:
I20260709 13:09:39.624085 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 303) took 2167 ms. Trace:
I20260709 13:09:39.606288 29936 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:39.624171 27417 rpcz_store.cc:276] 0709 13:09:36.908844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.619949 (+2711105us) service_pool.cc:224] Handling call
0709 13:09:39.620568 (+   619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.622052 (+  1484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.622322 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.626260 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:39.608700 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:39.557886 29844 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:39.630813 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 51441.7us
W20260709 13:09:39.595674 27410 rpcz_store.cc:269] 0709 13:09:37.125909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.881374 (+755465us) service_pool.cc:224] Handling call
0709 13:09:39.579223 (+1697849us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400086e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.593966 (+ 14743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3344311040}
I20260709 13:09:39.624554 27342 rpcz_store.cc:276] 0709 13:09:37.456645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.002722 (+546077us) service_pool.cc:224] Handling call
0709 13:09:38.003125 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.313139 (+1310014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.313213 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.314071 (+   858us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.545787 (+231716us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.545820 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.555823 (+ 10003us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.623728 (+ 67905us) raft_consensus.cc:1685] finished
0709 13:09:39.623747 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.623917 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67078,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1540400,"threads_started":2,"wal-append.queue_time_us":307277}
W20260709 13:09:39.645135 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48836.8us
W20260709 13:09:39.651075 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.651089 28943 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.652791 29761 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.654429 28943 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.651763 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.655385 29870 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.656752 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.658499 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.662293 27267 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 2. Current term is 3. Ops: []
I20260709 13:09:39.650331 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.624218 27263 rpcz_store.cc:276] 0709 13:09:37.428459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.950018 (+521559us) service_pool.cc:224] Handling call
0709 13:09:37.952627 (+  2609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:37.952926 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:39.272875 (+1319949us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.541759 (+268884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.554458 (+ 12699us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:39.583866 (+ 29408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.596140 (+ 12274us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.623634 (+ 27494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25600,"prepare.queue_time_us":798077,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":16213,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"thread_start_us":1507593,"threads_started":2,"wal-append.queue_time_us":308857}
I20260709 13:09:39.648561 29746 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:39.672009 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:39.672540 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 91758.6us
I20260709 13:09:39.672206 29873 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:39.673830 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.674715 29737 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.675731 29737 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:39.675794 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.667866 28999 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:39.639741 29709 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.681950 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.674630 29873 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:39.682472 27341 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.668064 29933 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:39.649348 29546 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.680080 29738 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.688859 29437 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.686769 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:39.683883 29746 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:39.670413 29926 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:39.693663 29936 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.694278 29746 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.689711 27161 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 4, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 4 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.696826 27415 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1244) took 2570 ms (client timeout 1533 ms). Trace:
W20260709 13:09:39.697367 27415 rpcz_store.cc:269] 0709 13:09:37.126409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.234090 (+107681us) service_pool.cc:224] Handling call
0709 13:09:39.696539 (+2462449us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54000f1c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.696725 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4746646784}
I20260709 13:09:39.697844 27161 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 6 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.701733 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 93211.6us
I20260709 13:09:39.688732 29738 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.704427 29782 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:39.706044 29738 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.698788 29761 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:39.707043 29756 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:39.707396 29761 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:39.707646 29756 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:39.707919 29761 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.709053 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.708876 29756 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.710533 29756 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:39.710304 29849 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:39.701275 28999 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:39.711539 29849 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.711668 28999 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.712021 29849 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:39.714058 29847 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:39.714314 29849 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.716267 29849 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.716734 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.717628 27416 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:39.719138 29936 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:39.715976 29808 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.720472 29808 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.723495 27408 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:39.724720 27408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1255) took 2202 ms (client timeout 2213 ms). Trace:
W20260709 13:09:39.725163 27408 rpcz_store.cc:269] 0709 13:09:37.522567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.345544 (+1822977us) service_pool.cc:224] Handling call
0709 13:09:39.724503 (+378959us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54003a4b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:39.724629 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844965120}
I20260709 13:09:39.726106 29695 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:39.726557 29695 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:39.726752 27408 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:39.727738 27336 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:39.729759 27308 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:39.730801 29933 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:39.731088 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.731473 29933 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:39.732745 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.733292 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.742687 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:39.685418 29873 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.749286 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1245) took 2603 ms. Trace:
I20260709 13:09:39.750310 27408 rpcz_store.cc:276] 0709 13:09:37.138088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.725999 (+2587911us) service_pool.cc:224] Handling call
0709 13:09:39.726315 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.736151 (+  9836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.740933 (+  4782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.763420 29933 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.766551 29437 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:39.760849 29873 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:39.767504 29945 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:09:39.767700 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 93990.6us
W20260709 13:09:39.781436 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.772522 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.763494 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 290) took 2848 ms. Trace:
I20260709 13:09:39.783494 27416 rpcz_store.cc:276] 0709 13:09:36.915442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.718527 (+2803085us) service_pool.cc:224] Handling call
0709 13:09:39.718961 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.760636 (+ 41675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.760676 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.763147 (+  2471us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:39.763220 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.763285 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.763416 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.787621 27413 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:39.789088 27415 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:39.789544 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:39.771780 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:39.791641 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.797955 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.798760 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:39.800814 27262 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.801152 27261 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:39.784052 29746 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.804111 28943 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.772126 29926 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:39.771387 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.808964 27265 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:39.809262 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.809990 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.817116 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.818969 28943 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.816038 27266 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:39.821008 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.828752 29786 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.829064 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.829267 27416 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:09:39.829943 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 286) took 2910 ms. Trace:
I20260709 13:09:39.829806 27259 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.831998 27380 leader_election.cc:400] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:39.832424 27380 leader_election.cc:403] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:09:39.835700 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 75050.9us
I20260709 13:09:39.829802 27416 pending_rounds.cc:85] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 1
I20260709 13:09:39.806464 29857 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:39.838570 27260 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:39.838744 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.848901 27268 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:39.818373 29738 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:39.768625 29695 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.816413 29437 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.876106 28011 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:09:39.830331 27412 rpcz_store.cc:276] 0709 13:09:36.908564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.588235 (+2679671us) service_pool.cc:224] Handling call
0709 13:09:39.644791 (+ 56556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.667005 (+ 22214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.667048 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.699318 (+ 32270us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.807219 (+107901us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.807278 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.807454 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:39.815526 (+  8072us) raft_consensus.cc:1685] finished
0709 13:09:39.815550 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.819011 (+  3461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7434,"raft.queue_time_us":16303,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":15093,"thread_start_us":99598,"threads_started":1,"wal-append.queue_time_us":106210}
I20260709 13:09:39.853309 28943 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:39.868561 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 302) took 2412 ms. Trace:
I20260709 13:09:39.873023 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1249) took 2722 ms. Trace:
I20260709 13:09:39.871079 27259 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:39.878019 27415 rpcz_store.cc:276] 0709 13:09:37.148793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.870102 (+2721309us) service_pool.cc:224] Handling call
0709 13:09:39.870499 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.870748 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.870782 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.870848 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:39.870927 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.870982 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.871083 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.880846 27265 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:39.838047 27416 pending_rounds.cc:107] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:09:39.882673 27416 raft_consensus.cc:2889] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.885669 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.886831 27263 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:39.887705 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.874396 29834 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.888437 27161 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 4, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 4 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.891752 29886 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:39.892036 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1246) took 2744 ms. Trace:
I20260709 13:09:39.892472 27416 rpcz_store.cc:276] 0709 13:09:37.147756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.802807 (+2655051us) service_pool.cc:224] Handling call
0709 13:09:39.828826 (+ 26019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.891727 (+ 62901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.891967 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.892926 29617 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.893432 29617 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.895432 29846 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.896237 29950 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:09:39.897084 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 93142.1us
W20260709 13:09:39.899843 27380 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.501s (SENT)
W20260709 13:09:39.900928 27380 leader_election.cc:336] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.501s (SENT)
I20260709 13:09:39.901319 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:39.902621 27380 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.543s (SENT)
I20260709 13:09:39.903400 29909 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4.
I20260709 13:09:39.903736 29709 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:39.904765 27413 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:39.905521 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1248) took 2757 ms. Trace:
I20260709 13:09:39.905813 27413 rpcz_store.cc:276] 0709 13:09:37.148493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.805618 (+2657125us) service_pool.cc:224] Handling call
0709 13:09:39.885565 (+ 79947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.905234 (+ 19669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.905457 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:39.906299 28014 pending_rounds.cc:85] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Aborting all ops after (but not including) 5
I20260709 13:09:39.906121 27266 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:39.896003 29846 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:39.916596 27414 raft_consensus.cc:2410] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:39.915225 27261 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:39.876456 29738 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.876286 29870 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:39.923977 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.877557 27334 rpcz_store.cc:276] 0709 13:09:37.456352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:37.963500 (+507148us) service_pool.cc:224] Handling call
0709 13:09:38.001528 (+ 38028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.234500 (+1232972us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:39.288617 (+ 54117us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.581164 (+292547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.581212 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:39.581258 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.868167 (+286909us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540014c3d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:39.868208 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:39.868397 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7143,"prepare.queue_time_us":171138,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":32384,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4010,"spinlock_wait_cycles":2833565056,"thread_start_us":293651,"threads_started":2,"wal-append.queue_time_us":372839}
W20260709 13:09:39.915203 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 115449us
I20260709 13:09:39.923748 27262 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:39.930882 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 199925us
I20260709 13:09:39.904232 29909 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:39.931841 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:39.936563 27341 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:39.936592 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.903914 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.935590 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:39.934201 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:39.940084 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:39.906704 28014 pending_rounds.cc:107] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 13:09:39.941182 27265 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:39.943224 28014 raft_consensus.cc:2917] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 13:09:39.941356 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.947726 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.949860 27415 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:39.943675 28014 raft_consensus.cc:2889] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.923513 29738 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:39.956398 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53804.2us
I20260709 13:09:39.957396 27259 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.958326 27410 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:39.958905 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:39.959673 28011 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:39.960738 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:39.959324 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 110492us
I20260709 13:09:39.963857 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.965867 27412 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:39.966620 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1250) took 2804 ms. Trace:
I20260709 13:09:39.967033 27412 rpcz_store.cc:276] 0709 13:09:37.161926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.890000 (+2728074us) service_pool.cc:224] Handling call
0709 13:09:39.956666 (+ 66666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.966346 (+  9680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.966552 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:39.968828 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 258242us
I20260709 13:09:39.922906 29437 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:39.952888 29709 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:39.973202 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:39.974766 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 152174us
I20260709 13:09:39.974445 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.972298 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.977605 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.978169 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.971541 27264 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:39.974411 27416 raft_consensus.cc:2376] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4. Re-sending same reply.
I20260709 13:09:39.965194 29695 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:39.992527 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:39.993898 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.992566 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.994035 27415 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:39.994542 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.997114 27259 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:39.973835 29868 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.000449 27413 raft_consensus.cc:2368] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:39.998469 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:39.995944 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:39.963207 29870 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.001417 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:39.973565 29617 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:40.002276 27410 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:39.963553 29909 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.003693 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:40.005537 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.008365 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:40.009466 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:40.016762 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:39.987908 29709 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:40.004453 29956 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:09:40.030929 29965 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:09:40.051779 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55922.1us
I20260709 13:09:40.016592 29861 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.017627 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:40.070825 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.032305 29962 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.052809 27416 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:40.010147 27415 raft_consensus.cc:2376] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4. Re-sending same reply.
W20260709 13:09:40.054280 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.051383 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.057233 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 294) took 2109 ms. Trace:
I20260709 13:09:40.065819 27265 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:40.074667 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.073063 27268 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:40.076944 27414 rpcz_store.cc:276] 0709 13:09:37.947689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.371848 (+1424159us) service_pool.cc:224] Handling call
0709 13:09:40.030514 (+658666us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54000e9a54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:40.057160 (+ 26646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232091904}
I20260709 13:09:40.081656 29844 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:09:40.088980 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.082051 29437 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:40.083434 29546 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:40.102756 27412 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:40.099496 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.083326 29968 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:09:40.070400 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:40.084771 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:40.085161 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1709) took 3320 ms. Trace:
I20260709 13:09:40.085431 27263 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:40.077428 27410 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:40.114148 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1253) took 2726 ms. Trace:
I20260709 13:09:40.114552 27410 rpcz_store.cc:276] 0709 13:09:37.387901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.010473 (+2622572us) service_pool.cc:224] Handling call
0709 13:09:40.060083 (+ 49610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.113895 (+ 53812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.114094 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.088936 29909 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.093168 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:40.076982 27264 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:40.094893 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 95758.6us
W20260709 13:09:40.095021 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 99664.8us
I20260709 13:09:40.091337 29861 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.100836 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 289) took 3185 ms. Trace:
I20260709 13:09:40.102242 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:40.102466 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 288) took 3193 ms. Trace:
I20260709 13:09:40.115775 29930 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.117116 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.118085 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 293) took 2174 ms. Trace:
I20260709 13:09:40.119684 27413 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 4: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:40.119736 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 157316us
I20260709 13:09:40.119060 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.125864 27414 rpcz_store.cc:276] 0709 13:09:37.943580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.116997 (+2173417us) service_pool.cc:224] Handling call
0709 13:09:40.117415 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.117636 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.117660 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.117717 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:40.117771 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.117849 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.117989 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.099153 29958 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.109025 29886 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.112615 27409 rpcz_store.cc:276] 0709 13:09:36.754405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.518895 (+2764490us) service_pool.cc:224] Handling call
0709 13:09:39.582575 (+ 63680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:39.607100 (+ 24525us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:39.686463 (+ 79363us) log.cc:844] Serialized 14 byte log entry
0709 13:09:39.956726 (+270263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:39.956798 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:39.956890 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.956997 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.042959 (+ 85962us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b1800041e00. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4
0709 13:09:40.074535 (+ 31576us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b540035b950. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:40.074724 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140844,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":74,"raft.queue_time_us":124,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4434,"spinlock_wait_cycles":149407232,"thread_start_us":257401,"threads_started":2,"wal-append.queue_time_us":307431}
I20260709 13:09:40.121479 27411 rpcz_store.cc:276] 0709 13:09:36.909098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.638914 (+2729816us) service_pool.cc:224] Handling call
0709 13:09:39.667114 (+ 28200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.700773 (+ 33659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.700797 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.760961 (+ 60164us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.933977 (+173016us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.934013 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.934076 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.102253 (+168177us) raft_consensus.cc:1685] finished
0709 13:09:40.102272 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.102411 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17758,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":111370,"threads_started":1,"wal-append.queue_time_us":252165}
I20260709 13:09:40.074255 29761 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.120926 27417 rpcz_store.cc:276] 0709 13:09:36.914992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.649542 (+2734550us) service_pool.cc:224] Handling call
0709 13:09:39.685704 (+ 36162us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.736551 (+ 50847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.736596 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:39.750430 (+ 13834us) log.cc:844] Serialized 26 byte log entry
0709 13:09:39.933022 (+182592us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:39.933061 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:39.933125 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.100571 (+167446us) raft_consensus.cc:1685] finished
0709 13:09:40.100597 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.100750 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":36168,"thread_start_us":130453,"threads_started":1,"wal-append.queue_time_us":145889}
I20260709 13:09:40.128742 27415 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:09:40.143779 27380 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.602s (SENT)
I20260709 13:09:40.150122 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:40.120724 29650 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:40.152948 28007 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:09:40.155339 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 102826us
I20260709 13:09:40.155903 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 292) took 2221 ms. Trace:
I20260709 13:09:40.146492 29778 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:09:40.156774 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:40.157949 27380 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.791s (SENT)
I20260709 13:09:40.128871 29930 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.159009 27409 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:40.159464 29909 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.159682 29904 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:40.160128 29437 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:40.128454 29846 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.164207 27261 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:40.174576 27383 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.164522 27264 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:09:40.174055 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 55100.2us
I20260709 13:09:40.169029 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 291) took 2248 ms. Trace:
I20260709 13:09:40.120992 29834 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.182988 27261 pending_rounds.cc:85] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 2
I20260709 13:09:40.194906 27261 pending_rounds.cc:107] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:40.185496 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1258) took 2253 ms. Trace:
I20260709 13:09:40.183296 27410 rpcz_store.cc:276] 0709 13:09:37.934638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.115273 (+2180635us) service_pool.cc:224] Handling call
0709 13:09:40.155433 (+ 40160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.155601 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.155624 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.155660 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:40.155700 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.155747 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.155843 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:40.194355 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44545.8us
I20260709 13:09:40.129027 29958 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.195495 27261 raft_consensus.cc:2889] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:40.208814 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.267408 27412 rpcz_store.cc:276] 0709 13:09:37.932078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.114065 (+2181987us) service_pool.cc:224] Handling call
0709 13:09:40.151748 (+ 37683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.166394 (+ 14646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.166438 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.185068 (+ 18630us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:40.185132 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.185204 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.185414 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.182404 27409 pending_rounds.cc:85] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 6
I20260709 13:09:40.274904 27409 pending_rounds.cc:107] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:40.276854 27409 raft_consensus.cc:2889] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:40.171155 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 54184.1us
I20260709 13:09:40.150032 29870 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:40.185150 27416 rpcz_store.cc:276] 0709 13:09:37.920201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.094583 (+2174382us) service_pool.cc:224] Handling call
0709 13:09:40.143753 (+ 49170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.166751 (+ 22998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:40.166799 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.166870 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:40.166930 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.167022 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.168933 (+  1911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.172840 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:40.167716 29756 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:40.283676 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 109213us
I20260709 13:09:40.171443 29546 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.175220 29868 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.113s
I20260709 13:09:40.185035 29930 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:40.289256 27231 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 3.017s (SENT)
I20260709 13:09:40.292534 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:40.290104 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 132188us
I20260709 13:09:40.295329 27410 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:40.295694 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 296) took 2278 ms. Trace:
I20260709 13:09:40.297380 27413 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:40.297202 27409 rpcz_store.cc:276] 0709 13:09:38.017659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.144424 (+2126765us) service_pool.cc:224] Handling call
0709 13:09:40.158584 (+ 14160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.283759 (+125175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.295477 (+ 11718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.298514 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 295) took 2298 ms. Trace:
I20260709 13:09:40.298939 27413 rpcz_store.cc:276] 0709 13:09:38.000467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.129990 (+2129523us) service_pool.cc:224] Handling call
0709 13:09:40.290033 (+160043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.298209 (+  8176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.298455 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:40.300242 27412 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:40.181655 29650 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:40.174906 29786 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:09:40.289819 27416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49638
I20260709 13:09:40.310299 27416 raft_consensus.cc:606] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:09:40.310642 27416 raft_consensus.cc:614] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:40.182606 29904 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:40.274946 29958 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.301803 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.179422 29861 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:40.288823 29617 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:40.289016 29847 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.316407 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:40.319609 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.814s (SENT)
I20260709 13:09:40.319729 29437 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:40.320201 29437 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.321256 29437 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.322614 29437 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.323365 27408 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:40.325933 27342 pending_rounds.cc:85] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 5
I20260709 13:09:40.326344 27342 pending_rounds.cc:107] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:09:40.326627 27342 raft_consensus.cc:2889] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.321746 29761 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:40.277469 29738 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.177359 29873 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.311097 29650 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:40.326503 29846 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:40.343067 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 47829.8us
I20260709 13:09:40.311563 29808 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.345293 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.314707 29870 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:09:40.317188 29617 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.194420 29709 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:40.438881 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84951.7us
I20260709 13:09:40.499890 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:40.315435 29546 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:40.312826 29904 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.356124 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:40.512091 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 222901us
W20260709 13:09:40.483384 27380 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.969s (SENT)
I20260709 13:09:40.514189 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:40.525895 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:40.507037 29617 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.460661 29761 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.412715 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:40.529781 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 202023us
I20260709 13:09:40.512408 29546 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:40.506572 29846 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:40.538403 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 223545us
I20260709 13:09:40.343333 29909 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.205s
I20260709 13:09:40.531801 29761 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:40.533926 29786 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:40.537437 27383 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.540964 29847 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:40.541865 29761 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.543625 29847 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.544086 29847 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.545810 27334 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:09:40.549834 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.550400 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.550724 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.551014 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.552280 29756 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:40.535717 29861 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.536194 29546 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:40.556783 29969 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:09:40.558485 29844 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:40.558380 29761 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.554876 29968 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:09:40.563030 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:40.564306 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 80981.3us
I20260709 13:09:40.564992 28943 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:40.565137 29786 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.568194 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:40.569172 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:40.569558 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.562357 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:40.575901 29834 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:40.576340 29834 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:40.576707 29834 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:40.579403 28943 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.579748 29786 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.580389 28943 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.583925 29967 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:40.588881 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.083s (SENT)
I20260709 13:09:40.589401 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:40.566794 29778 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:09:40.555037 29930 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.584050 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.604797 27334 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:09:40.613976 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 49007.4us
I20260709 13:09:40.616750 28999 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:40.617743 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 307994us
I20260709 13:09:40.605886 29869 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:40.630316 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.635430 28943 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:40.616544 29861 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.640127 28943 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.605947 29958 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.623641 29968 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:09:40.663393 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 79444.3us
I20260709 13:09:40.661389 28943 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:40.665853 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 124797us
I20260709 13:09:40.649042 29709 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:40.670037 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.673666 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:40.677654 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:40.658435 29738 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:40.667011 29909 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.700090 29909 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.701709 29958 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.662854 29873 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.645817 29870 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:40.691115 29617 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.691237 29546 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:40.692472 29972 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.576s	user 0.006s	sys 0.000s
I20260709 13:09:40.692991 29847 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.693655 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:40.702479 29958 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:40.698634 29967 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:40.699499 29930 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:40.715135 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1254) took 3299 ms. Trace:
I20260709 13:09:40.673316 29709 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.718704 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:40.693257 29961 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:40.757874 28011 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.637785 29846 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.702570 29909 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:40.767720 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49712.1us
I20260709 13:09:40.753602 27415 rpcz_store.cc:276] 0709 13:09:37.416217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.072234 (+2656017us) service_pool.cc:224] Handling call
0709 13:09:40.114157 (+ 41923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:40.149007 (+ 34850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.714982 (+565975us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b54003c1c50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:40.715088 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19070848}
I20260709 13:09:40.714146 29808 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.720956 28007 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:40.771258 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61602.5us
I20260709 13:09:40.760355 29709 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.753336 29695 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.721553 29869 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:40.760533 29961 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:40.773937 29976 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.334s	user 0.011s	sys 0.000s
I20260709 13:09:40.719481 29650 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.717876 29834 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:40.772754 29958 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:40.793365 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 177650us
I20260709 13:09:40.795441 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 364) took 1070 ms. Trace:
I20260709 13:09:40.780777 29761 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.782662 29868 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:40.795998 28014 rpcz_store.cc:276] 0709 13:09:39.724910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:39.726030 (+  1120us) service_pool.cc:224] Handling call
0709 13:09:39.905702 (+179672us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:39.905941 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:39.993002 (+ 87061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:39.993041 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:40.003205 (+ 10164us) log.cc:844] Serialized 26 byte log entry
0709 13:09:40.106218 (+103013us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:40.106255 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.106327 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:40.691453 (+585126us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:40.795134 (+103681us) raft_consensus.cc:1685] finished
0709 13:09:40.795187 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:40.795361 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23638656,"thread_start_us":49813,"threads_started":1,"wal-append.queue_time_us":98411}
I20260709 13:09:40.794673 28943 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:09:40.788384 29869 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.804843 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:40.809489 28011 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:40.816851 28943 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:40.817338 28943 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.817580 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:40.820974 29983 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:09:40.822803 29984 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:09:40.827005 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.827833 27261 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:40.829171 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.828076 28943 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.829840 27267 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:40.830520 28943 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:40.831411 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:40.830884 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.819299 29861 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.832815 27263 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:40.841285 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.842392 27265 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:40.813772 29846 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:40.805711 29868 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:40.794286 29695 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:40.799949 29930 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:09:40.813232 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:40.855646 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.859499 27266 raft_consensus.cc:2410] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:40.860069 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:40.870280 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52780.7us
I20260709 13:09:40.871091 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.834033 29961 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:40.874800 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 101382us
I20260709 13:09:40.883414 29834 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.884387 29834 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.937068 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:40.940317 27263 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:09:40.950628 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 119319us
I20260709 13:09:40.945789 27263 pending_rounds.cc:85] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
I20260709 13:09:40.952931 27263 pending_rounds.cc:107] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:09:40.953315 27263 raft_consensus.cc:2889] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.956753 27383 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.963639 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:40.970781 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 150092us
I20260709 13:09:40.888201 29990 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:40.958978 29967 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:40.956208 29808 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:40.977525 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.976226 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:40.964494 29909 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:40.958122 29991 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:40.968663 29786 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:40.986402 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 323365us
I20260709 13:09:40.969043 29546 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:40.984614 29617 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:40.995922 29437 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:40.996399 29437 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.974530 29990 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:41.000465 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.978454 29861 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:41.014307 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:40.984612 29808 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:41.021010 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 76056us
I20260709 13:09:40.996235 29650 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:40.989056 29786 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.006150 29437 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:40.975672 29868 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:41.033185 29992 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:09:41.034109 29995 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:41.009152 29990 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:41.010370 29930 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:41.038399 29993 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:09:40.971843 29958 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.041213 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.041999 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.042671 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.044189 28999 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:41.045061 27264 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:09:41.045044 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 68898us
I20260709 13:09:41.012329 29991 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:41.047820 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.037362 29808 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:41.050896 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48249.4us
W20260709 13:09:41.051242 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51848.7us
I20260709 13:09:41.028225 29861 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:41.054090 27266 raft_consensus.cc:2410] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:41.054580 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:41.061635 28943 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:41.058282 27263 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:41.045630 29786 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.062723 28943 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:41.048782 29967 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:41.067596 28943 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.070422 27263 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:41.071288 30005 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:09:41.072002 29991 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.073007 29977 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.073187 29869 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.073587 29977 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.049333 28007 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:41.057459 29868 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:41.052074 29930 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:41.079561 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:41.080166 29930 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.081138 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:41.081956 29650 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:41.082666 29650 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:41.055402 29546 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:09:41.029479 29904 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.085158 29695 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:41.086263 29904 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:41.087548 27268 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:41.081279 29930 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.090883 27265 raft_consensus.cc:2393] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:41.092994 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83624.2us
I20260709 13:09:41.095033 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.100706 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.092119 29909 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.111299 27263 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:41.111799 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.067337 29617 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:09:41.115630 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.116858 27266 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:41.122552 30005 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:41.120064 29909 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.124599 29861 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.125563 29909 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:41.126528 27264 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:41.127511 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:41.127560 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:41.128329 27262 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:41.129504 29437 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.131402 29808 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.132745 30006 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:09:41.142254 27262 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:41.143509 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.156726 28999 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.156800 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:41.144742 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:41.147249 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.158263 27264 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:41.148059 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:41.150496 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.161053 29909 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.161581 29909 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.152122 30008 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.163379 30008 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.152930 29977 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:41.153502 29869 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:41.165645 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:41.165795 29909 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:41.166303 27412 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:41.157423 28999 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.179425 30005 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:41.179968 30005 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:41.180771 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65592.2us
I20260709 13:09:41.182224 28999 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:41.185878 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 156925us
I20260709 13:09:41.189448 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:41.190102 27268 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.200680 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:41.200917 27334 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:41.205724 27265 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:41.207223 27265 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:09:41.219635 28943 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.220405 28943 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.221542 29650 raft_consensus.cc:2764] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:09:41.222741 27264 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:41.228721 28999 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:09:41.231804 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.234453 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.240828 28999 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:41.241384 28999 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:41.189694 29967 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.250887 29936 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:41.252040 29936 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:41.252396 29936 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:41.265776 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.186971 27412 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:41.242430 28999 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.318883 27268 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:41.321609 30008 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:41.325711 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:41.344082 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:41.383936 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 130433us
I20260709 13:09:41.390499 28999 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.253840 29650 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.405720 27231 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.600s (SENT)
W20260709 13:09:41.411211 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.416536 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.416780 27341 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:41.319658 29936 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.417927 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:41.406467 29869 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.439736 29869 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.346293 30005 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.426168 29437 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:41.441651 29709 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.003s
I20260709 13:09:41.442437 29869 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:41.444258 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:41.445094 27336 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:41.444932 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:41.446134 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:41.438030 28943 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:41.439081 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.456700 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.457262 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.468103 28943 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.442256 29709 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:41.486205 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 341461us
I20260709 13:09:41.415594 29844 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:41.476367 28943 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.503391 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:41.504323 27342 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:41.469223 29999 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:41.517031 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.461882 29650 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:41.628856 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:41.607662 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.096138 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.096506 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.096676 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.097023 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.098836 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:42.099418 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:42.092154 27267 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:41.933578 28943 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:42.103850 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:42.119341 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:41.532394 29844 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:42.123000 29709 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:42.123957 29844 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:41.618404 30021 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:41.713060 29873 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:42.121459 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.122490 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:41.625543 29990 consensus_meta.cc:287] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:09:42.123031 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:42.122570 29808 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:42.123070 27342 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:42.091639 30005 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:41.747202 30010 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:42.127931 27411 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:42.128918 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.120615 27412 raft_consensus.cc:2410] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:42.130074 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.130908 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:42.131757 27339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
W20260709 13:09:42.132097 27214 auto_rebalancer.cc:893] Removing replace marker failed: Replica d02eb2355bc54e7f8c13a30c33793d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:42.137369 27339 raft_consensus.cc:606] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:42.137506 27214 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:09:42.137751 27339 raft_consensus.cc:614] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:42.132764 27336 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:42.138288 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:41.545749 30008 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.093077 29936 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:41.579003 30013 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.133850 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:42.132977 29873 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:42.138566 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:42.151065 27412 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.138749 27415 raft_consensus.cc:2410] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:09:42.140555 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:42.153072 27416 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.140592 27266 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:42.142297 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:42.137844 27214 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:09:42.158970 27336 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:42.161387 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:41.574465 29786 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.136070 30010 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:42.142861 29980 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.176162 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:42.180488 27411 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.175498 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 309) took 1290 ms. Trace:
I20260709 13:09:42.182102 27267 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:42.183586 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.183081 27412 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:42.185822 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.178457 30010 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:41.542639 29999 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.181393 27408 rpcz_store.cc:276] 0709 13:09:40.876336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.883396 (+  7060us) service_pool.cc:224] Handling call
0709 13:09:40.883924 (+   528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:40.955391 (+ 71467us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:40.967889 (+ 12498us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.180309 (+212420us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18000c67c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:09:41.466313 (+286004us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:41.483413 (+ 17100us) log.cc:844] Serialized 52 byte log entry
0709 13:09:41.483628 (+   215us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:41.483667 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.483755 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.155888 (+672133us) raft_consensus.cc:1685] finished
0709 13:09:42.166040 (+ 10152us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.166207 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61133,"prepare.queue_time_us":18164,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":68773,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":7737,"spinlock_wait_cycles":24253696,"thread_start_us":285694,"threads_started":1,"wal-append.queue_time_us":1149761}
I20260709 13:09:42.191082 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:42.192235 27412 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:42.189486 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 87978.3us
I20260709 13:09:42.193586 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.192317 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.135468 29990 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.201869 27339 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:42.202916 27341 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:42.251943 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.264401 27335 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:42.264755 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.160478 30013 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.265503 27414 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:09:42.265828 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.266541 27267 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.275264 27340 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:42.275816 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.276680 27266 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:42.277280 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1985) took 1129 ms. Trace:
I20260709 13:09:42.277613 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.278267 27266 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.277845 27260 rpcz_store.cc:276] 0709 13:09:41.147621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.391336 (+243715us) service_pool.cc:224] Handling call
0709 13:09:41.424744 (+ 33408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.445585 (+ 20841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.445622 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.446144 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.579850 (+133706us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:41.579912 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.580008 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.277061 (+697053us) raft_consensus.cc:1685] finished
0709 13:09:42.277081 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.277220 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20436,"raft.queue_time_us":44234,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2996,"thread_start_us":133242,"threads_started":1,"wal-append.queue_time_us":829083}
I20260709 13:09:42.288251 27411 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:42.290715 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.154862 30008 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.278110 29673 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.278896 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:42.285625 30010 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.298261 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.299779 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:42.298624 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.301918 27339 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:09:42.302314 27408 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:09:42.302884 27231 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.824s (SENT)
I20260709 13:09:42.305697 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.309101 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 366) took 1717 ms. Trace:
I20260709 13:09:42.312273 27411 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:42.309717 28015 rpcz_store.cc:276] 0709 13:09:40.591764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.591899 (+   135us) service_pool.cc:224] Handling call
0709 13:09:40.624251 (+ 32352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:40.628410 (+  4159us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:40.711232 (+ 82822us) log.cc:844] Serialized 14 byte log entry
0709 13:09:40.721176 (+  9944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:40.721227 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:40.721273 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:40.988518 (+267245us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b1800345280. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419
0709 13:09:42.308779 (+1320261us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:42.308848 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.309026 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147869,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1599,"raft.queue_time_us":114,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":85521664,"thread_start_us":73532,"threads_started":1}
I20260709 13:09:42.304772 28014 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:42.321981 29873 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.323477 29849 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.324115 29849 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.326283 29849 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.327147 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.327848 27340 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:42.328564 29786 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.296520 29808 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:42.332072 29808 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.336665 29999 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:42.337424 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.338002 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.338335 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.338840 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53087.1us
I20260709 13:09:42.339856 27233 leader_election.cc:400] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:42.340185 27233 leader_election.cc:403] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:42.339968 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:42.342067 29437 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.342185 27233 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.342742 29437 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.314356 29980 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:42.343845 29980 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:42.344271 29980 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.345181 29437 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:42.345784 29437 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.346082 29990 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:42.348023 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45189.8us
I20260709 13:09:42.332612 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 305) took 1095 ms. Trace:
I20260709 13:09:42.348717 27264 rpcz_store.cc:276] 0709 13:09:41.237089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.331640 (+1094551us) service_pool.cc:224] Handling call
0709 13:09:42.332011 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.332222 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.332253 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:42.332310 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:42.332346 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.332403 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.332528 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:42.349727 27231 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.749s (SENT)
I20260709 13:09:42.346220 29437 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.350179 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.351485 29873 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:42.350190 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.353062 27264 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:42.361848 28011 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
W20260709 13:09:42.364147 27231 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.854s (SENT)
I20260709 13:09:42.365155 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.366212 27262 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:42.382141 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.383080 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1989) took 1214 ms. Trace:
I20260709 13:09:42.384044 27261 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:42.365666 29786 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.386663 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.386945 29786 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:42.388335 30024 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:42.388605 29961 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.367266 27264 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:42.354117 29999 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.383569 27262 rpcz_store.cc:276] 0709 13:09:41.168188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.353579 (+1185391us) service_pool.cc:224] Handling call
0709 13:09:42.365189 (+ 11610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.382698 (+ 17509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.382996 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.383435 29990 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.365646 29437 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:42.390386 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 966170us
I20260709 13:09:42.307278 29673 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.402038 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:42.389390 30026 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:09:42.411989 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.412714 27261 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:42.412959 27340 raft_consensus.cc:2410] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:42.409178 27262 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:42.381115 29873 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.384485 29997 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.429064 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64979.2us
W20260709 13:09:42.430860 27231 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.937s (SENT)
I20260709 13:09:42.431320 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.432534 27267 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:42.413899 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71831.5us
I20260709 13:09:42.429019 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.435761 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.441056 28943 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.441562 28943 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.443601 27334 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:42.444734 27231 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.961s (SENT)
I20260709 13:09:42.445196 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.440060 27264 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:42.446199 27339 raft_consensus.cc:2368] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8.
W20260709 13:09:42.447265 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.447551 27341 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:42.447633 27335 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:42.438315 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.413528 30020 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.465190 27262 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:42.397502 29990 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.450671 29999 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.482762 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.486665 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:42.487282 27264 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.488802 27341 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:42.492388 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:42.496145 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.496337 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.497002 27335 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:42.496963 27262 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:42.439821 30033 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.499257 27265 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:42.497458 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.500226 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1991) took 1054 ms. Trace:
I20260709 13:09:42.500599 27339 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:42.500746 27265 rpcz_store.cc:276] 0709 13:09:41.446071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.498499 (+1052428us) service_pool.cc:224] Handling call
0709 13:09:42.498795 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:42.499895 (+  1100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.500150 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.502599 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.502997 29990 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.503751 29990 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:42.500247 27341 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.504393 29990 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.511941 29990 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:42.514014 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.514797 27265 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:42.520982 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:42.523494 28943 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.524224 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.525377 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.526607 27339 raft_consensus.cc:2410] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:42.483470 29786 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.437793 29997 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.533073 27337 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:42.534351 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.534578 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.535837 27339 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:42.499127 29873 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.538658 27341 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:42.538437 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.499912 29650 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:42.546862 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.548493 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.550382 27408 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:42.550859 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.552173 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.552994 28011 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:42.555568 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106887us
I20260709 13:09:42.557928 27341 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:42.552755 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:42.566219 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.566852 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.568336 28943 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:42.568285 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.569000 28943 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.569469 28943 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:42.569690 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 124971us
W20260709 13:09:42.570498 27231 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.040s (SENT)
I20260709 13:09:42.571117 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.571524 27411 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:09:42.571928 27411 pending_rounds.cc:85] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 2
I20260709 13:09:42.572170 27411 pending_rounds.cc:107] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:09:42.568671 27383 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.572466 27411 raft_consensus.cc:2889] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:42.573166 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:42.573361 27380 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.593s (SENT)
I20260709 13:09:42.574025 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:42.574528 27339 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:42.541918 29786 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.581073 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.575007 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.499989 30020 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.577594 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.584762 27341 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:42.570679 30034 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:42.586232 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.620666 27267 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:42.621098 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.590821 27416 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:42.561034 29834 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.545744 30013 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:42.561898 29437 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.638494 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.639107 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.560391 30005 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.640559 27264 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:42.643309 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63064.1us
W20260709 13:09:42.668762 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.669090 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.564239 30038 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:42.647956 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.571362 30032 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:42.572434 29990 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.575577 29709 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:42.655803 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.647094 27265 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:42.572635 29967 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.564128 29988 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.665822 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.583894 29958 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:42.583722 29977 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:09:42.673714 28011 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:42.767751 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 120189us
I20260709 13:09:42.769304 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.771821 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.773329 27264 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:42.771872 27343 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:42.764395 30043 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:42.669523 29999 raft_consensus.cc:2764] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:09:42.763828 30039 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:42.774922 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 204453us
I20260709 13:09:42.784034 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:42.791863 27231 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.231s (SENT)
I20260709 13:09:42.778544 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.674338 30013 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.111s
W20260709 13:09:42.793977 27231 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.328s (SENT)
I20260709 13:09:42.680919 30032 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.673496 30038 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.807485 30032 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.807605 30038 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.665807 29834 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.788061 29988 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.775602 29786 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:42.767351 29958 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.752315 29847 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:42.807705 30041 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.774796 30046 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:42.798631 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.795929 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.813942 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.666574 29437 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.817866 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:42.820979 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 247533us
I20260709 13:09:42.775784 29709 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:42.824036 27334 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:42.824716 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.815878 29673 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:42.826721 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:42.827255 28943 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:42.810266 30036 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:09:42.828500 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 159486us
I20260709 13:09:42.812740 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1198) took 1270 ms. Trace:
I20260709 13:09:42.870493 27343 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
W20260709 13:09:42.834447 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.813766 29849 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.836273 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 262909us
I20260709 13:09:42.790412 30047 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:42.923755 30047 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.924083 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 54091.5us
I20260709 13:09:42.924284 30047 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.924901 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.681154 30005 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.826133 29958 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.926081 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:42.928793 29967 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:42.929232 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 135280us
I20260709 13:09:42.929822 29847 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.930316 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.931252 27343 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:42.932209 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.901975 28943 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:42.873718 27341 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:42.874749 28014 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:42.933420 27339 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 3.
I20260709 13:09:42.898181 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.934072 27334 raft_consensus.cc:2376] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7. Re-sending same reply.
I20260709 13:09:42.934170 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:42.833245 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.934763 27267 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:42.898890 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.818318 30044 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.898918 30052 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:42.900391 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 311203us
W20260709 13:09:42.824965 27266 consensus_meta.cc:287] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 13:09:42.939635 27262 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:42.935889 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.940014 27266 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:42.940696 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1205) took 1312 ms. Trace:
I20260709 13:09:42.941072 27266 rpcz_store.cc:276] 0709 13:09:41.628041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.277349 (+649308us) service_pool.cc:224] Handling call
0709 13:09:42.940622 (+663273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:42.941392 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:42.938572 27231 leader_election.cc:336] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.139s (SENT)
W20260709 13:09:42.875855 30045 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:42.873594 29437 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:42.940083 27262 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:42.934177 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:42.898737 29808 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:42.836716 30041 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.944481 28943 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:42.952713 28943 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:42.949700 27380 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.835s (SENT)
I20260709 13:09:42.953063 28943 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:42.898772 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:42.870123 30051 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:42.899718 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.942360 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:42.899390 27260 rpcz_store.cc:276] 0709 13:09:41.542433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.280273 (+737840us) service_pool.cc:224] Handling call
0709 13:09:42.293205 (+ 12932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.319185 (+ 25980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.319242 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.371236 (+ 51994us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.576911 (+205675us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:42.576984 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.577071 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.812469 (+235398us) raft_consensus.cc:1685] finished
0709 13:09:42.812492 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.812670 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3014,"raft.queue_time_us":20354,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"spinlock_wait_cycles":1920,"thread_start_us":140890,"threads_started":1,"wal-append.queue_time_us":367637}
I20260709 13:09:42.838907 29786 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:42.952219 27262 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.963774 27262 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:42.952956 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.965591 27334 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:42.899271 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.960073 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:42.941113 29673 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:09:42.945259 29988 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:42.966948 27336 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:42.946616 29869 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:42.972828 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:42.974740 27380 leader_election.cc:336] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.865s (SENT)
I20260709 13:09:42.983703 27334 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.974562 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:42.961133 30010 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.004s
I20260709 13:09:42.948804 30053 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:42.980156 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:42.979997 28943 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:42.982263 28012 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:42.947290 29849 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:42.982859 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:42.992944 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:42.993594 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:43.017670 27408 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:42.948333 29997 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:43.007593 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 47646.8us
I20260709 13:09:43.016414 27336 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:42.996520 27334 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
W20260709 13:09:42.998647 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60107.3us
I20260709 13:09:43.018090 27338 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:09:43.018522 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 118118us
I20260709 13:09:43.025633 27417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76061244738f450fb409cb866212c235"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:09:43.026007 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:43.026695 27417 raft_consensus.cc:606] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:43.027083 27417 raft_consensus.cc:614] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:43.027540 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:42.968631 30049 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:42.973223 29673 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.032747 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:43.029376 27231 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.063s (SENT)
I20260709 13:09:42.993893 30044 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:42.945879 30052 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:43.031559 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 95744.2us
I20260709 13:09:42.975978 29967 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:42.981787 29869 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.009658 29988 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:43.033864 28943 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:43.034545 27231 leader_election.cc:336] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.246s (SENT)
W20260709 13:09:43.022962 29936 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.000s
I20260709 13:09:43.037218 28006 raft_consensus.cc:2410] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:42.982090 30013 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:09:43.020651 29990 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:43.071120 29990 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.071616 29990 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:43.072746 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1979) took 1949 ms. Trace:
I20260709 13:09:42.997123 30034 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:09:43.073158 27263 rpcz_store.cc:276] 0709 13:09:41.123787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.156344 (+ 32557us) service_pool.cc:224] Handling call
0709 13:09:41.181270 (+ 24926us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:41.201886 (+ 20616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.201919 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:41.240043 (+ 38124us) log.cc:844] Serialized 52 byte log entry
0709 13:09:42.816236 (+1576193us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b180038e8a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:42.964379 (+148143us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:42.964438 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.964524 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.072421 (+107897us) raft_consensus.cc:1685] finished
0709 13:09:43.072442 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.072680 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1311,"raft.queue_time_us":21576,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9412,"spinlock_wait_cycles":10089216,"thread_start_us":147927,"threads_started":1,"wal-append.queue_time_us":1797397}
I20260709 13:09:43.020295 30056 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.037053 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.017879 30053 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:43.020933 30051 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.051344 29869 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:43.041208 27262 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:43.041431 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76387.5us
W20260709 13:09:43.088260 27380 leader_election.cc:336] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.944s (SENT)
I20260709 13:09:43.088794 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:43.042203 30049 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:43.042071 29967 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.032557 30033 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:43.035683 30020 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:43.047566 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:43.027048 30046 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:09:43.041231 30050 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:09:43.069092 30010 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.035506 29673 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.044673 30057 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:43.079774 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.079596 30056 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.076459 29912 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:43.085287 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:43.107947 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 437839us
I20260709 13:09:43.017850 29709 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.106618 30033 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:43.100536 29988 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:43.112040 30033 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.109354 29912 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:43.093333 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 56395.7us
I20260709 13:09:43.114274 27260 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:43.094143 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.080247 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.115674 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:43.105715 27380 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.949s (SENT)
I20260709 13:09:43.073173 30008 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:43.105016 27342 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:43.040094 29786 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.109934 27337 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:43.116542 27411 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:43.035894 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.077462 30032 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:43.117203 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78490.9us
W20260709 13:09:43.172700 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 138173us
W20260709 13:09:43.174082 27231 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.529s (SENT)
I20260709 13:09:43.174487 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:43.187861 30062 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:09:43.107204 29936 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:09:43.107534 30010 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.096342 30051 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.110121 30056 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.221015 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:43.196419 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:43.187918 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 82252.3us
W20260709 13:09:43.319142 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 145071us
W20260709 13:09:43.370673 27380 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.016s (SENT)
I20260709 13:09:43.214434 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 1987) took 2064 ms. Trace:
I20260709 13:09:43.234496 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:43.195822 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.109843 29834 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:43.371667 27231 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.804s (SENT)
I20260709 13:09:43.387960 27337 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:43.391507 27340 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:43.391535 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:43.371428 27268 rpcz_store.cc:276] 0709 13:09:41.150299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.794731 (+1644432us) service_pool.cc:224] Handling call
0709 13:09:42.795018 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.818614 (+ 23596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.818636 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.828508 (+  9872us) log.cc:844] Serialized 26 byte log entry
0709 13:09:42.950058 (+121550us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:42.950118 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.950212 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.214171 (+263959us) raft_consensus.cc:1685] finished
0709 13:09:43.214193 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.214369 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14724,"raft.queue_time_us":20087,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4336,"thread_start_us":113197,"threads_started":1,"wal-append.queue_time_us":157111}
W20260709 13:09:43.393872 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 268412us
W20260709 13:09:43.320127 30067 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:43.172291 30044 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:43.188958 30013 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.426085 27336 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:43.318437 28007 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:43.425137 27342 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:43.251181 30065 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:43.429740 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59084.9us
W20260709 13:09:43.429760 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.430462 27380 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.037s (SENT)
I20260709 13:09:43.431056 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:43.211738 29650 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:43.433283 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:43.390561 29988 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.212059 30057 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:43.275404 30041 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:43.259492 30069 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.344900 30052 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:43.443900 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:43.441515 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 220561us
W20260709 13:09:43.441838 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 268121us
I20260709 13:09:43.446664 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:43.447306 27268 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:43.439539 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:43.450147 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 52421.7us
I20260709 13:09:43.220268 30008 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.217s
I20260709 13:09:43.455132 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.244108 30058 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.209s
I20260709 13:09:43.251623 30047 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:43.452919 29980 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.106s	user 0.009s	sys 0.005s
I20260709 13:09:43.463739 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:43.395748 29437 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.452121 30020 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.188576 29912 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.466442 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:43.488106 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:43.489706 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:43.490826 27417 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:43.434373 30013 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.492106 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:43.494063 27342 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:43.490836 29997 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:09:43.495504 30068 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.485177 29980 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.274431 30049 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.245524 30053 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:43.444383 30057 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.444319 30065 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:43.890866 27231 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.541s (SENT)
I20260709 13:09:43.929708 27410 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:43.930210 27231 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.564s (SENT)
I20260709 13:09:43.532217 27340 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:43.569543 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.554760 27342 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:43.932067 27339 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
W20260709 13:09:43.640786 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.932693 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:43.931507 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 360659us
W20260709 13:09:43.535820 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 47773.7us
I20260709 13:09:43.496726 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:43.537122 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:43.949234 27413 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:43.948371 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.959400 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.948987 27415 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
W20260709 13:09:43.985510 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 555020us
W20260709 13:09:43.618848 29990 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.001s
I20260709 13:09:43.994756 29990 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.000684 29990 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:44.002883 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54193.1us
I20260709 13:09:44.003973 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:44.005484 27380 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.742s (SENT)
W20260709 13:09:43.547148 30038 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.004s
W20260709 13:09:44.007066 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.095s (SENT)
I20260709 13:09:44.008206 27259 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:43.536729 30073 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.536397 30058 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:43.490278 30069 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.000762 29967 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.010130 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.028748 27339 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:44.029943 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:43.536258 30010 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:43.887998 30047 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:43.520097 29912 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:43.517374 29834 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.508885 30052 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.508s
I20260709 13:09:44.010860 30072 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:43.544359 29437 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:43.546074 29869 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:43.958860 30044 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.009927 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:44.067499 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:43.493489 30020 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.030923 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.009910 30038 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:44.156769 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.697s (SENT) [suppressed 53 similar messages]
I20260709 13:09:44.300056 27339 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 3.
I20260709 13:09:44.299916 27342 raft_consensus.cc:2376] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
W20260709 13:09:44.300683 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 143963us
I20260709 13:09:44.064195 29990 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.143970 27231 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.861s (SENT)
W20260709 13:09:44.300884 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 291086us
I20260709 13:09:44.306128 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.236605 30029 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.186564 30013 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.026053 30058 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.184548 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.046s	sys 0.102s
I20260709 13:09:44.308871 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:44.311331 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 167427us
I20260709 13:09:44.311875 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:44.150241 30070 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:44.312613 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:43.993556 30065 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:43.543569 30051 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:44.113714 29961 raft_consensus.cc:670] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:09:44.313649 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.063s	sys 0.144s
I20260709 13:09:44.315037 27342 raft_consensus.cc:2376] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7. Re-sending same reply.
I20260709 13:09:44.193703 30055 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:44.315989 27380 leader_election.cc:336] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.856s (SENT)
I20260709 13:09:44.253902 29869 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:44.150363 30077 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.150573 30066 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.220337 29936 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.332086 30020 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.332258 29936 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.305112 30044 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.315317 30058 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.069706 29967 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.339031 29980 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.317622 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:44.305203 29437 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:44.340032 29980 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:44.340225 29437 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:44.340559 29980 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:44.340734 29437 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.336494 30077 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.341601 30077 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.315685 30029 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.316298 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:44.193869 30071 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.321632 30033 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:44.344075 30033 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.344445 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 311) took 2025 ms. Trace:
I20260709 13:09:44.344988 27261 rpcz_store.cc:276] 0709 13:09:42.319585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.413604 (+ 94019us) service_pool.cc:224] Handling call
0709 13:09:42.436444 (+ 22840us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:42.569702 (+133258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.569741 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:42.570195 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:09:43.083288 (+513093us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:43.083651 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.083727 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:44.344207 (+1260480us) raft_consensus.cc:1685] finished
0709 13:09:44.344225 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.344391 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42839,"raft.queue_time_us":40670,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8636,"thread_start_us":508535,"threads_started":2,"wal-append.queue_time_us":590236}
I20260709 13:09:44.346608 30033 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.340121 30038 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:44.194022 30075 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.343575 30071 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.348487 30071 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.334952 29936 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.134512 30072 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.349278 29437 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.351591 30072 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:44.352962 29673 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.237s	user 0.010s	sys 0.000s
I20260709 13:09:44.353464 29673 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.327461 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:44.318653 30047 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:44.354522 27342 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.354740 28014 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:44.355624 30075 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.356134 30075 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.356505 30075 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.357069 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 392) took 1335 ms. Trace:
I20260709 13:09:44.357432 28014 rpcz_store.cc:276] 0709 13:09:43.021979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.022146 (+   167us) service_pool.cc:224] Handling call
0709 13:09:44.356867 (+1334721us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400601654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:44.357008 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038437760}
I20260709 13:09:44.354632 30047 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:44.360242 30047 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.362709 27342 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:44.363786 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:44.365342 27341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1979) took 1594 ms (client timeout 1692 ms). Trace:
W20260709 13:09:44.365947 27293 heartbeater.cc:646] Failed to heartbeat to 127.25.139.190:43657 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.139.190:43657 timed out after 15.000s (SENT)
W20260709 13:09:44.365804 27341 rpcz_store.cc:269] 0709 13:09:42.771247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.771453 (+   206us) service_pool.cc:224] Handling call
0709 13:09:44.365125 (+1593672us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400039dd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:44.365251 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231682944}
I20260709 13:09:44.367270 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.367758 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:44.368024 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 336) took 1251 ms. Trace:
I20260709 13:09:44.368341 30057 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.368608 30051 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:44.368862 30077 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:44.370416 28007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 390) took 2102 ms (client timeout 1690 ms). Trace:
W20260709 13:09:44.370939 28007 rpcz_store.cc:269] 0709 13:09:42.267777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.278594 (+ 10817us) service_pool.cc:224] Handling call
0709 13:09:44.370198 (+2091604us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b540060ead4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:44.370325 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792962304}
W20260709 13:09:44.374219 29958 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.448s	user 0.006s	sys 0.006s
I20260709 13:09:44.374969 27261 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:44.376484 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.377203 27260 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.112579 29834 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.380092 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.380395 29834 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.380897 27266 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:44.344398 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.251434 30068 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.398067 30068 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.311255 29990 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.399371 27268 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:44.400218 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:44.400890 27266 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:44.403841 30029 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:44.404758 30087 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:44.405337 27260 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:44.364465 27342 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.411855 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:44.412674 27268 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:44.213397 30079 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.320s
I20260709 13:09:44.414939 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.033778 30073 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.415760 27268 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.326908 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:44.324908 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 828826us
I20260709 13:09:44.368376 27341 rpcz_store.cc:276] 0709 13:09:43.116464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.366977 (+1250513us) service_pool.cc:224] Handling call
0709 13:09:44.367970 (+   993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:44.350685 27339 raft_consensus.cc:2410] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:44.388275 29999 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:44.391505 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:44.391767 30056 consensus_meta.cc:287] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.995s	user 0.008s	sys 0.002s
W20260709 13:09:44.392051 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.323297 30088 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.395395 30081 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.428920 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:44.423123 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.430178 27265 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.374704 29958 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.326787 30055 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.425486 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:44.428076 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104606us
I20260709 13:09:44.429215 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:44.423413 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.439978 27341 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.440056 27339 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
W20260709 13:09:44.434597 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.434859 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 118904us
I20260709 13:09:44.353804 29437 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:44.442843 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.509204 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:44.508263 27380 leader_election.cc:336] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.876s (SENT)
W20260709 13:09:44.441833 27231 leader_election.cc:336] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.978s (SENT)
W20260709 13:09:44.511668 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69896us
I20260709 13:09:44.479518 27342 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:44.514911 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:44.514662 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:44.516000 27342 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:44.421250 30077 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:44.519910 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:44.447465 29673 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:44.524083 27268 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:44.527091 27341 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:44.527681 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:44.528658 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:44.442873 30055 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:44.504880 30072 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:44.532843 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 3.132s (SENT)
I20260709 13:09:44.534336 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:44.534410 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:44.432713 30044 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.534850 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.534382 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:44.536633 27268 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.539044 27265 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:44.512075 30052 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.426319 29999 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.540033 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.337550 30066 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.539912 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:44.546386 30049 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.546654 30077 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.553244 27339 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:44.556859 27342 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:44.540922 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.549642 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.429725 30056 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.552729 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:44.547364 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:44.558401 27265 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.551069 27268 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:44.539739 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:44.541772 29844 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.560321 27261 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:44.561009 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:44.561491 28943 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.565686 28943 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:44.566448 28943 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.542094 29936 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:44.562471 27341 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:44.552037 29808 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:44.568691 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:44.571409 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:44.570423 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:44.569327 29936 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.571800 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:44.432969 30088 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.589519 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 391) took 1664 ms. Trace:
I20260709 13:09:44.436019 30081 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.589967 28012 rpcz_store.cc:276] 0709 13:09:42.924785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.940526 (+ 15741us) service_pool.cc:224] Handling call
0709 13:09:42.943754 (+  3228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.016135 (+ 72381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.589261 (+1573126us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b540006d6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:44.589453 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87819008}
I20260709 13:09:44.579873 29673 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.580345 30072 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:44.608955 30072 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.609553 30072 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:44.581060 30085 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 13:09:44.581699 30089 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:09:44.582597 30068 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.574575 29437 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:44.584050 29958 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.550716 30052 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.578276 29844 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:44.598392 29673 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.651958 29673 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.655539 29437 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:44.588807 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:44.587781 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.097462 27413 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:44.620728 30073 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.648895 30088 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.657449 30081 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:44.617642 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 512) took 2330 ms (client timeout 2533 ms). Trace:
W20260709 13:09:45.105177 28006 rpcz_store.cc:269] 0709 13:09:42.288723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.296177 (+  7454us) service_pool.cc:224] Handling call
0709 13:09:44.617295 (+2321118us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54005deb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:44.617536 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629787904}
I20260709 13:09:44.656615 29437 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:44.659665 29912 consensus_meta.cc:287] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 13:09:44.658233 29967 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.578907 29936 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.571291 29808 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.268628 29808 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:44.650864 29844 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.668552 29673 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.277727 30088 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.278198 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:44.652014 29999 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.596074 30033 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:44.660667 30052 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.649657 30056 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:44.649474 30058 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.312464 30058 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:44.661281 30069 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 13:09:45.314642 30069 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.606527 30071 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.680069 30075 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.704586 30072 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:44.814724 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.323904 27408 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.324934 30075 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:45.325007 30072 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:45.325752 30071 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:44.834167 30103 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.835554 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.332229 27411 raft_consensus.cc:2368] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
I20260709 13:09:45.331990 30103 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.333382 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.334165 30103 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:44.855327 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:44.880127 30055 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.334692 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.335527 27411 raft_consensus.cc:2368] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:45.336407 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:44.952297 27339 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:45.337014 27411 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.337654 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.338419 27339 raft_consensus.cc:2368] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:44.967849 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.340008 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.341147 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.341831 27414 raft_consensus.cc:2368] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:45.342566 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:44.975291 30005 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:44.976903 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.344673 27306 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.690s (SENT)
I20260709 13:09:45.345116 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:45.345250 29808 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:44.990018 27261 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:44.999346 30064 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:45.347338 30064 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:45.348309 30064 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.349603 30064 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.002297 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.002794 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.013725 30092 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:45.017982 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 324) took 1553 ms. Trace:
I20260709 13:09:45.025990 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.046219 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 312) took 2681 ms. Trace:
W20260709 13:09:45.058667 27340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1998) took 1871 ms (client timeout 1876 ms). Trace:
I20260709 13:09:45.062052 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:45.352401 27342 raft_consensus.cc:2368] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6.
W20260709 13:09:45.353340 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 291381us
I20260709 13:09:45.086547 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.352703 27259 rpcz_store.cc:276] 0709 13:09:42.365295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.425588 (+ 60293us) service_pool.cc:224] Handling call
0709 13:09:42.436026 (+ 10438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.008639 (+1572613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.045903 (+1037264us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540031f6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:45.046135 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3615152000}
I20260709 13:09:45.354092 27410 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:45.087146 27265 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
I20260709 13:09:45.354409 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.126600 27413 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:45.355798 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.356065 27414 raft_consensus.cc:2368] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
W20260709 13:09:45.134430 29988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.001s	sys 0.005s
I20260709 13:09:45.138554 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 318) took 1696 ms. Trace:
W20260709 13:09:45.149935 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.157691 28943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.025s
W20260709 13:09:45.363657 28943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.006s	sys 0.025s
I20260709 13:09:45.354694 27265 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:45.365432 28943 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.161600 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1289) took 2077 ms. Trace:
I20260709 13:09:45.353351 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:45.163014 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.006s	sys 0.008s
I20260709 13:09:45.352381 27263 rpcz_store.cc:276] 0709 13:09:43.464821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.464971 (+   150us) service_pool.cc:224] Handling call
0709 13:09:43.486541 (+ 21570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.889166 (+402625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:43.889212 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:43.958961 (+ 69749us) log.cc:844] Serialized 26 byte log entry
0709 13:09:44.210228 (+251267us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:44.210286 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.210403 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.017734 (+807331us) raft_consensus.cc:1685] finished
0709 13:09:45.017754 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.017912 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2052,"raft.queue_time_us":402838,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":63744,"thread_start_us":250825,"threads_started":1,"wal-append.queue_time_us":345490}
I20260709 13:09:45.184084 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.188962 30032 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:45.193351 27336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1990) took 2164 ms (client timeout 2006 ms). Trace:
I20260709 13:09:45.197132 29849 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.205363 30066 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:45.216765 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.217417 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.001s	sys 0.004s
W20260709 13:09:45.368578 27336 rpcz_store.cc:269] 0709 13:09:43.028987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.035649 (+  6662us) service_pool.cc:224] Handling call
0709 13:09:45.193084 (+2157435us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b540021e654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.193246 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584908672}
W20260709 13:09:45.370736 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.002s	sys 0.004s
I20260709 13:09:45.361658 27416 rpcz_store.cc:276] 0709 13:09:43.442716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.442846 (+   130us) service_pool.cc:224] Handling call
0709 13:09:43.457469 (+ 14623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:44.007727 (+550258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.007771 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.007828 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:44.007892 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.138278 (+1130386us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000bd6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:45.138340 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.138494 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1264878464}
W20260709 13:09:45.229846 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.236655 30084 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.930s	user 0.003s	sys 0.000s
I20260709 13:09:45.371237 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:45.371608 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.243681 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 127359us
I20260709 13:09:45.246069 30078 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:45.247432 29847 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.375499 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.375799 29847 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.260890 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 323) took 1772 ms. Trace:
I20260709 13:09:45.376693 27412 rpcz_store.cc:276] 0709 13:09:43.487974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.488925 (+   951us) service_pool.cc:224] Handling call
0709 13:09:43.489241 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.489779 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:43.491773 (+  1994us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.153624 (+1661851us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b180007ffc0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:09:45.259727 (+106103us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.260244 (+   517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:45.260314 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:45.260375 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.260455 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.260607 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23907,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":209,"raft.queue_time_us":225,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":223,"spinlock_wait_cycles":11925248,"thread_start_us":104980,"threads_started":2,"wal-append.queue_time_us":1743824}
I20260709 13:09:45.378067 29847 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.278287 30088 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.280076 30073 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.280435 30057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.030s	sys 0.028s
I20260709 13:09:45.280586 30046 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:45.280793 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.280988 29650 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:45.282635 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.282943 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.283525 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.283535 29673 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:45.284068 27338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1949) took 3102 ms (client timeout 1835 ms). Trace:
I20260709 13:09:45.287689 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:45.288316 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.303231 30033 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.315796 27409 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:45.331086 27408 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:44.932061 30068 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.352730 27341 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:45.072314 29990 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:45.356549 27339 raft_consensus.cc:2376] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:45.357802 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.330194 29936 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.393025 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:45.352784 27340 rpcz_store.cc:269] 0709 13:09:43.187184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.402167 (+214983us) service_pool.cc:224] Handling call
0709 13:09:45.058432 (+1656265us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b54002d9e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.058595 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189438848}
I20260709 13:09:45.386922 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:45.367552 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.007s	sys 0.008s
I20260709 13:09:45.482050 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:45.369513 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.545s (SENT)
I20260709 13:09:45.366878 27417 rpcz_store.cc:276] 0709 13:09:43.083856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.094720 (+ 10864us) service_pool.cc:224] Handling call
0709 13:09:43.097357 (+  2637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:43.491241 (+393884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.161166 (+1669925us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54003c1254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:45.161504 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904319872}
I20260709 13:09:45.389703 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.359812 27411 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:09:45.220978 30047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.008s	sys 0.020s
I20260709 13:09:45.241350 30083 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:45.371245 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 850596us
I20260709 13:09:45.372525 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:45.372197 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.366868 30005 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:09:45.373721 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.373349 27164 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 5 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:09:45.374733 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.366539 30072 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:45.361763 29967 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:45.510536 30103 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:45.361588 29988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.002s	sys 0.006s
I20260709 13:09:45.379776 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:45.554392 30103 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:45.555663 27161 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 210) took 16170 ms (client timeout 15000 ms). Trace:
W20260709 13:09:45.556305 27334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 1991) took 2519 ms (client timeout 2533 ms). Trace:
I20260709 13:09:45.477320 29844 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.556756 27334 rpcz_store.cc:269] 0709 13:09:43.036715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.036834 (+   119us) service_pool.cc:224] Handling call
0709 13:09:45.556113 (+2519279us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b540025c1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.556247 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5692863360}
I20260709 13:09:45.557653 30033 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.557987 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.389341 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.558718 28011 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:45.380365 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.500078 27414 raft_consensus.cc:2368] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:45.559505 27261 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:09:45.369916 30092 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:45.381220 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.374984 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:45.336652 30055 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.372174 30071 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:45.376648 30006 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:45.380750 30075 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:45.375535 30078 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.492748 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2007) took 2004 ms. Trace:
I20260709 13:09:45.456794 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.392078 27260 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:45.368793 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.493932 27262 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.366040 28943 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.219684 30053 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.494143 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:45.494668 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 125187us
I20260709 13:09:45.577883 27341 rpcz_store.cc:276] 0709 13:09:43.488689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.574789 (+1086100us) service_pool.cc:224] Handling call
0709 13:09:45.492680 (+917891us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:45.581619 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.692s (SENT)
I20260709 13:09:45.495796 27412 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.386643 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:45.394096 27338 rpcz_store.cc:269] 0709 13:09:42.181677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:42.189100 (+  7423us) service_pool.cc:224] Handling call
0709 13:09:45.283847 (+3094747us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54001fc554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.284002 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711775104}
I20260709 13:09:45.503695 27336 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:09:45.394706 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 107084us
I20260709 13:09:45.395823 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.511335 29999 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.540045 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2012) took 1118 ms. Trace:
I20260709 13:09:45.542204 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2004) took 2114 ms. Trace:
I20260709 13:09:45.539422 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:45.518151 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.544198 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1739) took 1022 ms. Trace:
I20260709 13:09:45.587989 27409 rpcz_store.cc:276] 0709 13:09:44.521493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.521601 (+   108us) service_pool.cc:224] Handling call
0709 13:09:45.544044 (+1022443us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540027cc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.544145 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792579328}
W20260709 13:09:45.588466 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.545419 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:45.550102 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.589573 27411 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:45.389906 30044 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:45.547434 30072 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.600690 30072 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.552699 27164 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.551656 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.559530 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.546515 30051 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.562105 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.565119 28011 pending_rounds.cc:85] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Aborting all ops after (but not including) 6
I20260709 13:09:45.508526 30068 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:45.556092 27161 rpcz_store.cc:269] 0709 13:09:29.376165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:29.376507 (+   342us) service_pool.cc:224] Handling call
0709 13:09:45.546762 (+16170255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:40.294271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:40.314310 (+ 20039us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:40.314365 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:09:40.316179 (+  1814us) tablet.cc:662] Decoding operations
0709 13:09:40.349111 (+ 32932us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:40.349238 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:40.349288 (+    50us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:09:40.350374 (+  1086us) tablet.cc:701] Row locks acquired
0709 13:09:40.350448 (+    74us) write_op.cc:260] PREPARE: finished
0709 13:09:40.350678 (+   230us) write_op.cc:270] Start()
0709 13:09:40.350857 (+   179us) write_op.cc:276] Timestamp: P: 1783602580350595 usec, L: 0
0709 13:09:40.350887 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:09:40.439465 (+ 88578us) log.cc:844] Serialized 3336 byte log entry
0709 13:09:40.690957 (+251492us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd7fb270ac 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b
0709 13:09:42.003709 (+1312752us) op_driver.cc:464] REPLICATION: finished
0709 13:09:42.365230 (+361521us) write_op.cc:301] APPLY: starting
0709 13:09:42.383505 (+ 18275us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:42.442441 (+ 58936us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:42.482836 (+ 40395us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:42.940336 (+457500us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:43.037579 (+ 97243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:09:43.044212 (+  6633us) write_op.cc:312] APPLY: finished
0709 13:09:43.044556 (+   344us) log.cc:844] Serialized 65 byte log entry
0709 13:09:43.086852 (+ 42296us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:43.095623 (+  8771us) write_op.cc:454] Released schema lock
0709 13:09:43.105722 (+ 10099us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:43.320788 (+215066us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:43.343728 (+ 22940us) write_op.cc:454] Released schema lock
0709 13:09:43.377066 (+ 33338us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18001f53a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
Metrics: {"mutex_wait_us":226931,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":256835,"apply.run_cpu_time_us":6401,"apply.run_wall_time_us":883219,"num_ops":8,"prepare.queue_time_us":300368,"prepare.run_cpu_time_us":40292,"prepare.run_wall_time_us":556791,"raft.queue_time_us":638723,"raft.run_cpu_time_us":21685,"raft.run_wall_time_us":400313,"replication_time_us":1603094,"spinlock_wait_cycles":44031232,"thread_start_us":748838,"threads_started":4,"wal-append.queue_time_us":764993,"wal-append.run_cpu_time_us":34702,"wal-append.run_wall_time_us":2496452}]]}
I20260709 13:09:45.611824 27268 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:45.612224 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.604254 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.613412 27417 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:45.615432 27262 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:45.619381 28011 pending_rounds.cc:107] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:09:45.619719 28011 raft_consensus.cc:2889] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:45.621366 27413 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:45.622246 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 76933.3us
I20260709 13:09:45.623004 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:45.605189 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.389660 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.559634 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1749) took 1019 ms. Trace:
I20260709 13:09:45.570691 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.571674 27410 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
W20260709 13:09:45.395010 30057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.031s	sys 0.029s
W20260709 13:09:45.499925 30047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.118s	user 0.008s	sys 0.021s
W20260709 13:09:45.573321 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 198406us
I20260709 13:09:45.573812 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1743) took 1040 ms. Trace:
I20260709 13:09:45.632992 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:45.648732 27415 rpcz_store.cc:276] 0709 13:09:44.533775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.369897 (+836122us) service_pool.cc:224] Handling call
0709 13:09:45.573734 (+203837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16256}
I20260709 13:09:45.394038 30073 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.541038 29990 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:45.576195 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.385712 30058 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:45.423859 29650 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:45.477521 30088 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.477191 29808 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.578505 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.580942 27408 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:45.582933 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:45.584412 27265 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.667881 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.539423 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.668608 27408 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:09:45.582513 27261 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 4.
I20260709 13:09:45.669766 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.670307 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.590515 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.586434 27264 rpcz_store.cc:276] 0709 13:09:44.422020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.422140 (+   120us) service_pool.cc:224] Handling call
0709 13:09:44.437001 (+ 14861us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:44.505448 (+ 68447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:44.505495 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:44.531981 (+ 26486us) log.cc:844] Serialized 52 byte log entry
0709 13:09:45.493924 (+961943us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:45.539288 (+ 45364us) log.cc:844] Serialized 14 byte log entry
0709 13:09:45.539610 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:45.539710 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:45.539758 (+    48us) raft_consensus.cc:1685] finished
0709 13:09:45.539778 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:45.539955 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109,"prepare.queue_time_us":6174,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":70556,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":54924,"thread_start_us":935511,"threads_started":1,"wal-append.queue_time_us":131530}
I20260709 13:09:45.586493 27335 rpcz_store.cc:276] 0709 13:09:43.429934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.370500 (+1940566us) service_pool.cc:224] Handling call
0709 13:09:45.542140 (+171640us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.671847 27341 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.592911 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1748) took 1057 ms. Trace:
I20260709 13:09:45.672750 27411 rpcz_store.cc:276] 0709 13:09:44.535332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.549027 (+1013695us) service_pool.cc:224] Handling call
0709 13:09:45.592849 (+ 43822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.594120 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.594564 30103 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.595664 29936 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.597134 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.675774 28012 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:45.676065 27259 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:45.676446 27266 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:45.572671 30083 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.391080 30046 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.578047 29673 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:45.687704 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.599887 30044 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.553179 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.624444 27416 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:45.625051 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1755) took 1080 ms. Trace:
I20260709 13:09:45.698300 27410 rpcz_store.cc:276] 0709 13:09:44.544554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.086249 (+541695us) service_pool.cc:224] Handling call
0709 13:09:45.624994 (+538745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.625335 27414 rpcz_store.cc:276] 0709 13:09:44.540005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.357577 (+817572us) service_pool.cc:224] Handling call
0709 13:09:45.559575 (+201998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.632303 30051 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.699936 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.630218 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1773) took 1077 ms. Trace:
I20260709 13:09:45.631039 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.631341 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1774) took 1059 ms. Trace:
I20260709 13:09:45.701674 27334 rpcz_store.cc:276] 0709 13:09:44.572331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.559116 (+986785us) service_pool.cc:224] Handling call
0709 13:09:45.631276 (+ 72160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.702934 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.703673 27334 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:45.704732 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.705441 27334 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:45.557423 29844 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.655305 30071 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:09:45.632918 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.633100 30049 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:45.633682 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.721614 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.634318 28943 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:45.639547 30078 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.640719 29786 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:45.641096 28007 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:45.580796 30075 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:45.641775 30092 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:45.575549 30034 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:09:45.591241 30006 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:45.642534 27336 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:45.659677 30058 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.591259 29988 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.643607 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.645030 30068 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.645465 27267 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:45.646384 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:45.653143 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:45.653803 27339 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.742236 29988 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:45.746146 28009 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:45.654719 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69518.4us
W20260709 13:09:45.662024 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 79434us
I20260709 13:09:45.585809 27342 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:45.665705 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.598752 27412 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:45.677707 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:45.681666 27231 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.777s (SENT)
I20260709 13:09:45.680521 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.686779 27263 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:45.679103 27164 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:45.690505 27197 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3f80 after lost signal to thread 26161
I20260709 13:09:45.690649 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.691519 28010 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:09:45.692394 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.659814 30056 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:45.697126 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:45.713954 27341 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:45.630918 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.701054 27343 rpcz_store.cc:276] 0709 13:09:44.552816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.395326 (+842510us) service_pool.cc:224] Handling call
0709 13:09:45.630141 (+234815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.706452 27338 raft_consensus.cc:2376] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:45.716296 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.716584 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:45.695653 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:45.722167 27260 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 4: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:45.722198 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:45.723022 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.598529 30081 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:09:45.724787 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:45.725443 27268 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:45.725323 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.728474 27265 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:45.728700 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:45.732551 27259 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:09:45.692462 29673 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.715328 30046 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:45.734798 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 339) took 1424 ms. Trace:
I20260709 13:09:45.606204 29999 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:45.660480 29990 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:46.017424 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 364338us
I20260709 13:09:46.017658 27413 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:45.952911 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2020) took 1118 ms. Trace:
I20260709 13:09:46.018700 27266 rpcz_store.cc:276] 0709 13:09:44.834442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:44.855018 (+ 20576us) service_pool.cc:224] Handling call
0709 13:09:45.952658 (+1097640us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54001b8ad4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:45.952827 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784922368}
W20260709 13:09:46.019400 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 337755us
W20260709 13:09:45.801966 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.020234 27411 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:45.855639 27337 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:09:45.777508 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.022301 27334 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.021450 27262 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:09:46.023447 27197 debug-util.cc:398] Leaking SignalData structure 0x7b080004e940 after lost signal to thread 27200
I20260709 13:09:46.020246 27336 rpcz_store.cc:276] 0709 13:09:44.310764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.372308 (+1061544us) service_pool.cc:224] Handling call
0709 13:09:45.734733 (+362425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:45.788151 27339 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:46.025194 27261 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.025723 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.026360 27336 raft_consensus.cc:2376] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4. Re-sending same reply.
I20260709 13:09:46.018263 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:45.982384 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:45.833318 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.027801 27410 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:46.028012 27409 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:46.028129 27416 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:09:45.890712 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.021225 27231 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.796s (SENT)
W20260709 13:09:46.041908 27231 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.912s (SENT)
I20260709 13:09:46.029592 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1767) took 1844 ms. Trace:
I20260709 13:09:46.042520 27342 rpcz_store.cc:276] 0709 13:09:44.185078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.353732 (+1168654us) service_pool.cc:224] Handling call
0709 13:09:46.029516 (+675784us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.042901 27231 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.139s (SENT)
W20260709 13:09:46.024719 27197 debug-util.cc:398] Leaking SignalData structure 0x7b08003692c0 after lost signal to thread 27292
I20260709 13:09:46.043704 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.028162 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:46.044716 27197 debug-util.cc:398] Leaking SignalData structure 0x7b080035fce0 after lost signal to thread 27367
W20260709 13:09:46.045087 27197 debug-util.cc:398] Leaking SignalData structure 0x7b080037fbc0 after lost signal to thread 27368
I20260709 13:09:46.045043 28943 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:45.741679 30055 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:46.044876 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.045856 28943 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.046365 27336 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:46.046447 27197 debug-util.cc:398] Leaking SignalData structure 0x7b0800378be0 after lost signal to thread 27441
I20260709 13:09:46.047362 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:46.047781 27197 debug-util.cc:398] Leaking SignalData structure 0x7b080024a220 after lost signal to thread 28039
I20260709 13:09:46.046653 28943 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:46.048208 27197 debug-util.cc:398] Leaking SignalData structure 0x7b080003dd20 after lost signal to thread 29709
I20260709 13:09:46.048267 27336 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:46.045858 30055 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:46.050571 30055 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:46.051232 27231 leader_election.cc:336] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.500s (SENT)
I20260709 13:09:46.051313 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:46.049496 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:46.052340 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.054232 27340 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:46.054738 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1764) took 2015 ms. Trace:
W20260709 13:09:45.747978 27309 connection.cc:256] RPC call timeout handler was delayed by -3.1507427750000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:09:46.055560 27309 connection.cc:256] RPC call timeout handler was delayed by -3.0985427750000554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:09:46.055981 27309 connection.cc:256] RPC call timeout handler was delayed by -2.8816427750000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:09:46.056509 27309 connection.cc:256] RPC call timeout handler was delayed by -2.8168427750000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:09:46.055583 27412 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.057534 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1754) took 1513 ms. Trace:
I20260709 13:09:46.057914 27412 rpcz_store.cc:276] 0709 13:09:44.544402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.055096 (+1510694us) service_pool.cc:224] Handling call
0709 13:09:46.055426 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.057271 (+  1845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.057485 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.055267 27340 rpcz_store.cc:276] 0709 13:09:44.039861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.681314 (+1641453us) service_pool.cc:224] Handling call
0709 13:09:46.054687 (+373373us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.056906 27309 connection.cc:256] RPC call timeout handler was delayed by -2.7970427750000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 13:09:46.059131 27309 connection.cc:256] RPC call timeout handler was delayed by -2.7583427750000737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 13:09:46.059548 27309 connection.cc:256] RPC call timeout handler was delayed by -2.6206427750000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:09:46.059612 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 335779us
W20260709 13:09:46.059963 27309 connection.cc:256] RPC call timeout handler was delayed by -2.609842775000061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 13:09:46.060267 27309 connection.cc:256] RPC call timeout handler was delayed by -2.5972427750000406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:09:46.060572 27309 connection.cc:256] RPC call timeout handler was delayed by -2.5567427750000888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:09:46.060459 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:46.061203 27309 connection.cc:256] RPC call timeout handler was delayed by -2.5288427750000437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 13:09:46.061282 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:46.061560 27309 connection.cc:256] RPC call timeout handler was delayed by -2.513542775000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 13:09:46.061854 27309 connection.cc:256] RPC call timeout handler was delayed by -2.4919427750000978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
W20260709 13:09:46.062173 27309 connection.cc:256] RPC call timeout handler was delayed by -2.3821427750000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2363s for a response
W20260709 13:09:46.062460 27309 connection.cc:256] RPC call timeout handler was delayed by -1.6972427750000634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3124s for a response
W20260709 13:09:46.062733 27309 connection.cc:256] RPC call timeout handler was delayed by -1.5127427750001061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33290000000000003s for a response
I20260709 13:09:46.055936 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.063694 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.063764 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1778) took 1475 ms. Trace:
I20260709 13:09:46.051733 30055 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:45.734366 30092 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:46.066658 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.087375 27416 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:46.065106 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:46.089702 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.838686 30118 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:46.053911 30069 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:46.070089 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.091599 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:46.091684 27337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2003) took 2702 ms (client timeout 1697 ms). Trace:
I20260709 13:09:46.093523 27410 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:46.094694 27411 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:46.094882 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.064320 27339 rpcz_store.cc:276] 0709 13:09:44.588616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.055707 (+1467091us) service_pool.cc:224] Handling call
0709 13:09:46.063713 (+  8006us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.090859 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 395285us
I20260709 13:09:46.097961 27343 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.095981 27334 raft_consensus.cc:2376] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:46.096042 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.098814 27338 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.095436 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.099310 27341 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:45.741248 30117 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:46.095933 27337 rpcz_store.cc:269] 0709 13:09:43.389164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.426538 (+ 37374us) service_pool.cc:224] Handling call
0709 13:09:46.091474 (+2664936us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400229a54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.091616 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5528407424}
I20260709 13:09:46.100852 27415 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:45.773070 30049 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:45.847608 30075 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.141712 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.142359 27334 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.798645 29988 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.145795 27261 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:46.010165 30051 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:45.846043 30044 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.969889 30078 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:46.138356 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:45.772415 30034 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.139611 27164 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.135360 30122 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:45.844643 30073 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.053826 30010 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.029119 30053 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.028738 29673 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.106194 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.217222 27417 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:46.147459 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.117404 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:46.101734 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46736.9us
I20260709 13:09:46.152077 29849 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.173965 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.218885 27233 leader_election.cc:400] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:46.219240 27233 leader_election.cc:403] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:46.219303 27337 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:46.220569 27233 leader_election.cc:400] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:46.219983 27164 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.222121 27164 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 4 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.093093 30056 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.223905 30056 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:46.147847 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 84215.8us
I20260709 13:09:46.226748 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.148681 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.228609 27339 raft_consensus.cc:2368] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 3. Current term is 4.
I20260709 13:09:46.149052 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.149549 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.219985 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1766) took 2072 ms. Trace:
I20260709 13:09:46.150853 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.230214 27338 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:46.151054 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:46.230715 27259 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.232093 27335 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.229585 27341 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.018992 30083 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:45.849159 30058 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:46.137012 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1759) took 1591 ms. Trace:
I20260709 13:09:46.170583 27409 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:46.247828 27415 rpcz_store.cc:276] 0709 13:09:44.545168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.055902 (+1510734us) service_pool.cc:224] Handling call
0709 13:09:46.100508 (+ 44606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.136751 (+ 36243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.136955 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.181753 27266 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.249511 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:46.250356 27266 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:46.090493 29886 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.183964 27267 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:46.155479 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:46.100240 29847 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.135591 29967 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:45.741498 30006 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.086067 30068 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.143448 30030 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:46.212435 27334 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:09:46.066459 29786 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:09:46.166493 27413 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:46.125262 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.331108 27342 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:46.331614 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1782) took 1083 ms. Trace:
I20260709 13:09:46.240737 30073 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.331955 27342 rpcz_store.cc:276] 0709 13:09:45.248501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.052769 (+804268us) service_pool.cc:224] Handling call
0709 13:09:46.331557 (+278788us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.332806 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:46.333204 27414 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:46.235690 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.229609 27337 rpcz_store.cc:276] 0709 13:09:44.148103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.144255 (+1996152us) service_pool.cc:224] Handling call
0709 13:09:46.219904 (+ 75649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.250563 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:46.334681 27265 raft_consensus.cc:2410] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:46.252004 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:46.335253 27268 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:09:46.260401 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 166369us
I20260709 13:09:46.163331 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.262274 27164 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 5 to 6, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 6 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.181202 30078 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:46.270835 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:46.250802 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 157393us
I20260709 13:09:46.274821 27417 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:46.275581 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67906.5us
I20260709 13:09:46.344311 27341 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:46.283370 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:46.283298 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 222898us
I20260709 13:09:46.343888 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.260627 29886 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:46.214054 30032 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:46.226994 30010 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.289965 27416 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:46.296881 27410 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:46.297037 27338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:46.365615 27338 raft_consensus.cc:606] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:46.366127 27338 raft_consensus.cc:614] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.298013 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:46.367237 27339 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.144101 30117 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.306099 27409 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:09:46.317896 27231 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.968s (SENT)
I20260709 13:09:46.369540 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.320418 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 335) took 1038 ms. Trace:
I20260709 13:09:46.321982 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 333) took 1040 ms. Trace:
I20260709 13:09:46.327863 27263 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:46.337338 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.371389 27260 rpcz_store.cc:276] 0709 13:09:45.281737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.265757 (+984020us) service_pool.cc:224] Handling call
0709 13:09:46.321299 (+ 55542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.321549 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.321586 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.321643 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.321695 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.321760 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.321905 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.257031 30122 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:46.328552 30030 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.276400 29847 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:46.284133 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 57464.9us
I20260709 13:09:46.387254 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.278549 30069 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.347100 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.206290 30034 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.278257 30121 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:46.315927 30066 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:09:46.406543 27335 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:46.360935 27334 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:46.297523 29967 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:46.362299 27337 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:46.407444 27337 pending_rounds.cc:85] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 2
I20260709 13:09:46.407785 27337 pending_rounds.cc:107] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:46.408085 27337 raft_consensus.cc:2889] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.408982 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2001) took 3220 ms. Trace:
I20260709 13:09:46.409358 27337 rpcz_store.cc:276] 0709 13:09:43.188204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.340472 (+3152268us) service_pool.cc:224] Handling call
0709 13:09:46.361860 (+ 21388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.408629 (+ 46769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.408915 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.231264 30053 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.417127 30053 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.370633 27264 rpcz_store.cc:276] 0709 13:09:45.282214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.269850 (+987636us) service_pool.cc:224] Handling call
0709 13:09:46.319634 (+ 49784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.319900 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.319940 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.320006 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:46.320065 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.320163 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.320331 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.418764 27264 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:46.418823 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71797.9us
I20260709 13:09:46.419523 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1212) took 1031 ms. Trace:
I20260709 13:09:46.419378 28943 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:46.420433 30128 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.420691 29967 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.420030 27264 rpcz_store.cc:276] 0709 13:09:45.388059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.418129 (+1030070us) service_pool.cc:224] Handling call
0709 13:09:46.418580 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.419291 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.419469 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.422049 28943 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:46.422605 28943 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.422081 30128 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.374984 29849 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:46.424674 30128 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.425176 29849 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.425760 30117 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.427630 30122 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.430648 27264 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:46.431913 29999 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.431914 27264 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:46.434581 27264 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:46.434978 29990 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.435338 27264 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.436389 27264 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.437338 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:46.438032 27340 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:09:46.438179 30123 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:09:46.438659 30032 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:46.439885 30124 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:09:46.396375 29847 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:46.442638 30072 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.841s	user 0.010s	sys 0.000s
I20260709 13:09:46.449421 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.389283 30030 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.352803 30083 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:09:46.381472 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:46.382328 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 10) took 1118 ms. Trace:
I20260709 13:09:46.342067 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:46.387708 27342 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:46.457577 27338 rpcz_store.cc:276] 0709 13:09:45.248181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.233647 (+985466us) service_pool.cc:224] Handling call
0709 13:09:46.366631 (+132984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.458230 27342 pending_rounds.cc:85] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 3
I20260709 13:09:46.458503 27342 pending_rounds.cc:107] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:46.458781 27342 raft_consensus.cc:2889] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.390178 27341 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:46.358333 29886 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.399674 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.288298 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 325) took 1008 ms. Trace:
I20260709 13:09:46.381865 30044 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.410959 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 1996) took 3300 ms. Trace:
I20260709 13:09:46.461937 28943 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.467562 27334 rpcz_store.cc:276] 0709 13:09:43.110248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.339688 (+3229440us) service_pool.cc:224] Handling call
0709 13:09:46.360455 (+ 20767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.410636 (+ 50181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.410892 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.414615 27336 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:46.419855 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.374338 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1209) took 1023 ms. Trace:
I20260709 13:09:46.469425 27263 rpcz_store.cc:276] 0709 13:09:45.350986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.281882 (+930896us) service_pool.cc:224] Handling call
0709 13:09:46.327606 (+ 45724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.374082 (+ 46476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.374277 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.374997 30058 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:46.481036 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 99649.3us
I20260709 13:09:46.482074 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:46.459102 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:46.382972 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65137.6us
I20260709 13:09:46.459649 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2002) took 3110 ms. Trace:
W20260709 13:09:46.483911 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.484067 27264 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:46.484143 27341 rpcz_store.cc:276] 0709 13:09:43.349244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.345242 (+2995998us) service_pool.cc:224] Handling call
0709 13:09:46.385110 (+ 39868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.459381 (+ 74271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.459591 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.371138 27268 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:46.336140 30068 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.355746 30046 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.463814 27267 rpcz_store.cc:276] 0709 13:09:45.279500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.280508 (+  1008us) service_pool.cc:224] Handling call
0709 13:09:46.288046 (+1007538us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54001f8bd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.288211 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584312576}
I20260709 13:09:46.495674 27259 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:46.465518 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2000) took 3277 ms. Trace:
I20260709 13:09:46.496655 27342 rpcz_store.cc:276] 0709 13:09:43.187912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.340141 (+3152229us) service_pool.cc:224] Handling call
0709 13:09:46.374529 (+ 34388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.465236 (+ 90707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.465457 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:46.466915 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47802.7us
I20260709 13:09:46.477623 27339 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:09:46.500809 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81028.8us
I20260709 13:09:46.406278 30047 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:46.508244 27337 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:46.508330 27262 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.512661 27337 pending_rounds.cc:85] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 3
I20260709 13:09:46.414891 30034 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.509613 28943 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.513352 27337 pending_rounds.cc:107] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:46.518357 27337 raft_consensus.cc:2889] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:46.520080 27259 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:46.464383 29999 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.455885 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.522738 27341 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:46.524330 27340 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.480687 30053 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:46.529623 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2010) took 3001 ms. Trace:
I20260709 13:09:46.528117 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 340) took 2206 ms. Trace:
I20260709 13:09:46.480378 30121 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.554948 27412 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:46.527951 27265 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:09:46.538386 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.508133 30051 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.561538 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1789) took 1311 ms. Trace:
W20260709 13:09:46.562768 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50190.3us
I20260709 13:09:46.516263 30052 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:46.563292 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.559223 27337 rpcz_store.cc:276] 0709 13:09:43.528686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.463863 (+2935177us) service_pool.cc:224] Handling call
0709 13:09:46.507889 (+ 44026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.529300 (+ 21411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.529555 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.557904 27338 rpcz_store.cc:276] 0709 13:09:44.321893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.496497 (+2174604us) service_pool.cc:224] Handling call
0709 13:09:46.526515 (+ 30018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.526743 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.526791 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.526856 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.526926 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.527003 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.528041 (+  1038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.580669 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 337) took 1291 ms. Trace:
I20260709 13:09:46.581228 27266 rpcz_store.cc:276] 0709 13:09:45.291296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.277096 (+985800us) service_pool.cc:224] Handling call
0709 13:09:46.277528 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.277776 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:46.500806 (+223030us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.580164 (+ 79358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.580235 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.580308 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.580417 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.580596 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":245491,"threads_started":2}
I20260709 13:09:46.580678 27338 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:46.562465 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1802) took 1247 ms. Trace:
W20260709 13:09:46.571287 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 184126us
I20260709 13:09:46.509197 30130 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:46.585588 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.513039 29936 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:46.586606 27340 rpcz_store.cc:276] 0709 13:09:45.314873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.495827 (+1180954us) service_pool.cc:224] Handling call
0709 13:09:46.524169 (+ 28342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.560825 (+ 36656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.562398 (+  1573us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.591001 27259 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.587436 27341 rpcz_store.cc:276] 0709 13:09:45.250491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.485179 (+1234688us) service_pool.cc:224] Handling call
0709 13:09:46.522576 (+ 37397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.560780 (+ 38204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.561464 (+   684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:46.464708 30072 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.558156 30126 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.512661 30066 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:09:46.557222 30053 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:46.555680 30092 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:46.508023 30058 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.512378 30046 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.621397 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.622071 27409 raft_consensus.cc:2376] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5. Re-sending same reply.
I20260709 13:09:46.622401 30046 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.571874 30047 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:46.626031 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.614428 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.584072 30069 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.616760 29844 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.598138 30034 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.617825 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1768) took 2404 ms. Trace:
I20260709 13:09:46.591517 30129 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:09:46.583032 30051 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.558598 29999 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.619305 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 330) took 1245 ms. Trace:
I20260709 13:09:46.680755 27414 rpcz_store.cc:276] 0709 13:09:45.374033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.065725 (+691692us) service_pool.cc:224] Handling call
0709 13:09:46.332971 (+267246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.333621 (+   650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.619081 (+285460us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400317c50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.619241 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613860736}
I20260709 13:09:46.620213 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1779) took 2031 ms. Trace:
I20260709 13:09:46.613933 30053 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:46.583669 30052 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:46.648483 27380 connection.cc:256] RPC call timeout handler was delayed by -1.2558315080000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
I20260709 13:09:46.626766 27409 raft_consensus.cc:2376] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6. Re-sending same reply.
I20260709 13:09:46.439951 30032 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.664443 27335 rpcz_store.cc:276] 0709 13:09:44.214044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.232931 (+2018887us) service_pool.cc:224] Handling call
0709 13:09:46.617568 (+384637us) spinlock_profiling.cc:243] Waited 60.8 ms on lock 0x7b5400229a54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.617757 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139881344}
I20260709 13:09:46.592087 30081 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:46.608422 30130 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:46.683694 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 75362.7us
I20260709 13:09:46.694291 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.683362 27336 rpcz_store.cc:276] 0709 13:09:44.588912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.064867 (+1475955us) service_pool.cc:224] Handling call
0709 13:09:46.620037 (+555170us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54001fd454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.620156 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":749360384}
I20260709 13:09:46.637171 27411 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.512109 30078 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.683043 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:46.698040 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1015242739999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:09:46.684000 27417 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:46.610450 29936 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:46.700700 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.703581 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.703891 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 343) took 2281 ms. Trace:
I20260709 13:09:46.704306 27409 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:46.705065 27334 rpcz_store.cc:276] 0709 13:09:44.422186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.468641 (+2046455us) service_pool.cc:224] Handling call
0709 13:09:46.512607 (+ 43966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.512801 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:46.611830 (+ 99029us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.702575 (+ 90745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.702979 (+   404us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:46.703076 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.703259 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.703760 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":147467,"threads_started":2}
I20260709 13:09:46.706200 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.679963 30142 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.689834 30052 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.614984 30126 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.708878 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.709079 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.657287 30092 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.713495 29936 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.719597 30051 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:46.722762 27233 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 3.251s (SENT)
I20260709 13:09:46.729447 30068 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.730324 29673 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.731244 30047 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.733106 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.734889 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.736050 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1747) took 2201 ms. Trace:
I20260709 13:09:46.736255 29437 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.739362 30130 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.740496 30058 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.741595 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.742779 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:46.705355 30034 raft_consensus.cc:2764] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:46.708014 30078 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:46.757313 27408 rpcz_store.cc:276] 0709 13:09:44.535021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.057963 (+1522942us) service_pool.cc:224] Handling call
0709 13:09:46.085767 (+ 27804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.351745 (+265978us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:46.351774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.351816 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:46.351850 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.351911 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.735807 (+383896us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b54000e9050. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.735975 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43150,"raft.queue_time_us":123181,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13843,"spinlock_wait_cycles":63261568,"thread_start_us":250240,"threads_started":1}
I20260709 13:09:46.741392 30151 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.762307 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.697463 30081 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.711758 30121 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:46.787837 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46337.2us
W20260709 13:09:46.788067 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45417.7us
I20260709 13:09:46.791725 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.788118 27414 raft_consensus.cc:2376] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8. Re-sending same reply.
W20260709 13:09:46.788707 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65958.8us
W20260709 13:09:46.789024 27380 leader_election.cc:336] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.536s (SENT)
I20260709 13:09:46.792840 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.792977 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.795130 27410 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:46.797288 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.797405 28015 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:46.799537 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:46.807492 27380 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.710s (SENT)
I20260709 13:09:46.791370 30142 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:46.803884 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.824019 27410 raft_consensus.cc:2368] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:46.824141 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.824904 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:46.825424 27410 raft_consensus.cc:2376] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6. Re-sending same reply.
I20260709 13:09:46.826078 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.790537 30071 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:46.826664 27410 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:46.828112 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.830027 30121 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.829936 30127 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:46.830534 30081 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.833539 30030 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.835525 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2022) took 1118 ms. Trace:
I20260709 13:09:46.836093 29967 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.837263 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.838034 30121 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.840371 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.841596 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.842478 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.842859 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.843436 27342 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:46.843355 27414 raft_consensus.cc:2376] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7. Re-sending same reply.
W20260709 13:09:46.830336 30137 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:09:46.835990 27263 rpcz_store.cc:276] 0709 13:09:45.717733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.470526 (+752793us) service_pool.cc:224] Handling call
0709 13:09:46.497364 (+ 26838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.580901 (+ 83537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.581015 (+   114us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.601886 (+ 20871us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.692360 (+ 90474us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:46.692427 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.692528 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.835285 (+142757us) raft_consensus.cc:1685] finished
0709 13:09:46.835310 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.835463 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5554,"raft.queue_time_us":15042,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8225,"thread_start_us":86571,"threads_started":2,"wal-append.queue_time_us":114701}
I20260709 13:09:46.847282 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.800488 29849 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.799891 30073 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:46.851606 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.852546 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.800415 29988 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.852185 30034 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.866274 30010 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.840389 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:46.872836 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.028s	sys 0.040s
W20260709 13:09:46.873399 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.028s	sys 0.040s
W20260709 13:09:46.874117 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 603342us
I20260709 13:09:46.878237 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1301) took 1272 ms. Trace:
I20260709 13:09:46.793779 29847 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.882091 29847 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.882956 27343 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.847937 30121 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:46.884491 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1798) took 1570 ms. Trace:
I20260709 13:09:46.884855 27343 rpcz_store.cc:276] 0709 13:09:45.313765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.129334 (+815569us) service_pool.cc:224] Handling call
0709 13:09:46.884302 (+754968us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b540021d754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:46.884435 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529441024}
I20260709 13:09:46.887502 30046 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.888151 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.888091 30046 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.889582 30081 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.889685 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.890092 30081 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:46.890409 27413 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:46.890544 30081 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.846094 30151 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:09:46.892079 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 397) took 1286 ms. Trace:
I20260709 13:09:46.892253 30151 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:46.892812 30151 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:46.896410 30072 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.897003 27233 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.897137 30046 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:46.828549 30071 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.878659 27412 rpcz_store.cc:276] 0709 13:09:45.606036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.258825 (+652789us) service_pool.cc:224] Handling call
0709 13:09:46.259222 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.558862 (+299640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.877976 (+319114us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400087d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:46.878171 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679527808}
I20260709 13:09:46.866947 30010 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:46.858355 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:46.899416 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2023) took 1181 ms. Trace:
I20260709 13:09:46.892469 28015 rpcz_store.cc:276] 0709 13:09:45.605595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:45.609813 (+  4218us) service_pool.cc:224] Handling call
0709 13:09:45.610264 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.822966 (+1212702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.891880 (+ 68914us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540050fd54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:46.892027 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729750912}
I20260709 13:09:46.904783 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:46.907588 30152 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.911478 30152 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.907056 30144 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:09:46.909350 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2026) took 1190 ms. Trace:
I20260709 13:09:46.906965 30071 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:46.915942 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.915468 27414 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:46.911834 30152 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.846731 30142 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:46.916473 27267 rpcz_store.cc:276] 0709 13:09:45.718735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.496010 (+777275us) service_pool.cc:224] Handling call
0709 13:09:46.496325 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.509091 (+ 12766us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:46.607241 (+ 98150us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.772816 (+165575us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.881827 (+109011us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180037c4e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:09:46.882044 (+   217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.882122 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:46.882197 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.909026 (+ 26829us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54001b7bd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:46.909099 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.909253 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111357,"prepare.queue_time_us":197939,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":114728,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":2926,"spinlock_wait_cycles":92784640,"thread_start_us":199319,"threads_started":2,"wal-append.queue_time_us":238847}
I20260709 13:09:46.922317 27261 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:46.910758 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:46.924220 30055 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.000s
I20260709 13:09:46.909139 27268 rpcz_store.cc:276] 0709 13:09:45.718038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.485975 (+767937us) service_pool.cc:224] Handling call
0709 13:09:46.486283 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:46.503293 (+ 17010us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:46.677226 (+173933us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.770265 (+ 93039us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:46.770761 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:09:46.770893 (+   132us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:46.770929 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.771003 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:46.899208 (+128205us) raft_consensus.cc:1685] finished
0709 13:09:46.899226 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.899358 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112149,"prepare.queue_time_us":199830,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":18496,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":24505,"thread_start_us":217107,"threads_started":2,"wal-append.queue_time_us":202676}
I20260709 13:09:46.847360 29967 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:46.826860 29886 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:46.875057 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:46.944613 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69666.6us
I20260709 13:09:46.948998 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 339) took 1567 ms. Trace:
I20260709 13:09:46.899066 29849 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:46.949942 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:46.924808 30073 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:46.973284 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.976744 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:46.949589 27260 rpcz_store.cc:276] 0709 13:09:45.381535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.372888 (+991353us) service_pool.cc:224] Handling call
0709 13:09:46.393571 (+ 20683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.393856 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:46.517268 (+123412us) log.cc:844] Serialized 14 byte log entry
0709 13:09:46.948578 (+431310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:46.948626 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:46.948693 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:46.948755 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:46.948880 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18046,"prepare.queue_time_us":300961,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":83,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5228,"thread_start_us":553963,"threads_started":2}
I20260709 13:09:46.957049 30034 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:46.987401 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 140228us
I20260709 13:09:46.964184 30046 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:46.957978 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.984531 28006 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:46.989411 27309 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.958310 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:46.979259 30144 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:46.949966 30121 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:46.979516 30068 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:46.964370 29847 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:09:46.986738 28009 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:46.993275 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:46.997048 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.997787 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:46.979666 29988 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:09:46.980460 29967 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:09:47.008460 30046 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:47.009670 30046 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:46.976282 30142 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:09:47.015982 30142 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:09:47.018528 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 211054us
W20260709 13:09:47.018800 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.023588 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.783s (SENT)
W20260709 13:09:47.034400 27380 leader_election.cc:336] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.222s (SENT)
I20260709 13:09:47.026216 30068 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.992946 30083 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:09:47.037454 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:47.040514 30151 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.041611 30034 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:47.062065 28007 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:09:47.061528 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63880.1us
I20260709 13:09:47.064471 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:47.042507 29886 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:47.044134 27380 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.238s (SENT)
W20260709 13:09:47.052520 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 100892us
I20260709 13:09:47.052862 30168 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.036118 29673 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.036230 30167 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:47.073639 27380 leader_election.cc:336] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.298s (SENT)
I20260709 13:09:47.078106 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:47.079617 27341 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:47.051587 30068 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:47.080207 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:47.094214 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.591s (SENT)
I20260709 13:09:47.094753 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.032338 29849 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.093940 30068 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.086125 30138 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.098754 30167 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:47.081315 30092 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.099856 30151 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.100371 30030 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:47.118656 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54275us
I20260709 13:09:47.081871 30053 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.102052 30073 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:47.122929 27336 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:47.104959 30083 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:47.098645 30144 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:47.124084 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.124830 30144 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.125428 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.126605 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.127435 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.127661 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.128345 27338 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:47.128916 30053 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:47.129626 30081 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.131444 27339 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:47.133492 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 354) took 1082 ms. Trace:
I20260709 13:09:47.133941 27339 rpcz_store.cc:276] 0709 13:09:46.050846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.500449 (+449603us) service_pool.cc:224] Handling call
0709 13:09:46.526202 (+ 25753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:47.131972 (+605770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.133176 (+  1204us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54000703d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:47.133413 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391352192}
I20260709 13:09:47.140534 30117 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:47.141173 30117 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:47.108661 30052 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.145129 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 352) took 1116 ms. Trace:
I20260709 13:09:47.145869 27342 rpcz_store.cc:276] 0709 13:09:46.028806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.512182 (+483376us) service_pool.cc:224] Handling call
0709 13:09:46.565014 (+ 52832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.844040 (+279026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.144816 (+300776us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b5400260054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:47.145047 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639851904}
I20260709 13:09:47.148191 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2024) took 1429 ms. Trace:
I20260709 13:09:47.148720 27264 rpcz_store.cc:276] 0709 13:09:45.718273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.487683 (+769410us) service_pool.cc:224] Handling call
0709 13:09:46.488133 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:46.627351 (+139218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:46.627699 (+   348us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:46.668633 (+ 40934us) log.cc:844] Serialized 52 byte log entry
0709 13:09:46.754344 (+ 85711us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:46.754390 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.147662 (+393272us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540011e9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:47.147730 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:47.147786 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:47.147800 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:47.148115 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53454,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7682,"spinlock_wait_cycles":310546688,"thread_start_us":47957,"threads_started":1,"wal-append.queue_time_us":146343}
I20260709 13:09:47.150854 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.152338 28008 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:47.142241 30117 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.154402 30117 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.155216 30083 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:47.155648 29999 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.156265 30083 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.157608 30083 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.145232 30052 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:47.128280 27335 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:47.146064 27409 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:47.166203 30170 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:47.167243 30044 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:47.167996 30173 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:09:47.168797 30081 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:47.168853 27261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2031) took 1332 ms (client timeout 1712 ms). Trace:
I20260709 13:09:47.106048 29673 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:09:47.170622 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:47.204275 30173 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:47.112391 29988 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.205124 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.159586 29990 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:47.188078 27380 leader_election.cc:336] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.639s (SENT)
I20260709 13:09:47.205786 29990 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:47.206459 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.206763 29990 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.207551 30173 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:47.207974 29990 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.208132 30173 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:47.209383 30173 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.183018 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:47.188730 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 206940us
I20260709 13:09:47.196255 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.169865 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1305) took 1505 ms. Trace:
W20260709 13:09:47.204507 30044 raft_consensus.cc:1068] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:47.202922 27261 rpcz_store.cc:269] 0709 13:09:45.837062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.153120 (+316058us) service_pool.cc:224] Handling call
0709 13:09:47.168669 (+1015549us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540024b3d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:47.168780 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482011904}
I20260709 13:09:47.211156 30173 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:47.214725 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.214952 29988 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:47.215340 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.114012 30167 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:47.214191 27380 leader_election.cc:336] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.697s (SENT)
I20260709 13:09:47.207150 27339 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:47.211470 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.222865 27342 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:47.268857 27335 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.260383 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:47.270331 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56175.3us
I20260709 13:09:47.212195 27336 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:47.217010 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.278987 27338 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.213271 27411 rpcz_store.cc:276] 0709 13:09:45.664609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.268631 (+604022us) service_pool.cc:224] Handling call
0709 13:09:46.268966 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.696225 (+427259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.169622 (+473397us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54000be0d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:47.169806 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846168960}
I20260709 13:09:47.213076 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.115825 30121 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:47.280969 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.288389 27334 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.290740 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.256592 30010 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.256413 30052 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.292940 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.298900 27342 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.293350 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.295071 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.299872 27336 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.174814 30071 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.305424 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1210) took 1947 ms. Trace:
I20260709 13:09:47.305825 27262 rpcz_store.cc:276] 0709 13:09:45.357624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.354267 (+996643us) service_pool.cc:224] Handling call
0709 13:09:46.485638 (+131371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.512828 (+ 27190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:47.305211 (+792383us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001b99d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:47.305360 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242011520}
I20260709 13:09:47.295694 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.300041 27339 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:47.310094 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:47.285446 30047 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.215592 29988 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.322371 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.314374 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:47.313670 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.317119 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.326102 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.327064 27334 raft_consensus.cc:2376] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:47.328272 27339 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.340144 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.341010 27339 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.345788 30034 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:47.346490 30034 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:47.347735 30034 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.351086 30126 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.351832 30010 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:47.341887 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.352988 27339 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:09:47.353048 30163 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.315s	user 0.004s	sys 0.000s
I20260709 13:09:47.353904 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.355500 30129 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:47.356120 27261 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:47.357115 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:47.358503 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.984s (SENT)
I20260709 13:09:47.362422 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.363257 27340 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:47.319850 30152 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.364171 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.364713 27340 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:47.365548 30056 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:47.365952 30152 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.367348 30056 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:47.367486 30121 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.355506 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.321130 30177 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:47.371562 27262 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:47.371825 30177 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:47.373981 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.374390 30055 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.374495 30177 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.374892 30055 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:47.323693 30049 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:09:47.321179 30138 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:47.377562 30010 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.377998 30138 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:47.378247 30010 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.379271 30138 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.381364 30010 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.321224 30072 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:09:47.352185 30034 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.389460 27339 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:09:47.389762 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 194502us
I20260709 13:09:47.389739 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.391052 27334 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:47.391680 27231 leader_election.cc:336] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.831s (SENT)
I20260709 13:09:47.386714 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.392809 27262 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:47.393676 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:47.397217 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 420534us
I20260709 13:09:47.398372 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:47.400925 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.401669 27266 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:47.402654 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.396577 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.403705 27259 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 4.
I20260709 13:09:47.405545 27263 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:47.409145 27340 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:47.410454 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.410619 27262 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:47.411791 27342 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:47.411995 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.413879 27340 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.413924 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.415246 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:47.415135 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.416136 27340 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.416535 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.417974 27335 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.419569 27981 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:47.419945 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:47.416898 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.422421 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.312403 30052 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.423152 27340 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:09:47.424355 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.425071 27340 raft_consensus.cc:2376] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6. Re-sending same reply.
I20260709 13:09:47.418692 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.428604 27335 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.428632 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.429356 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.429913 27262 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:47.426404 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.431756 27263 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:47.431833 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.432670 27342 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:47.433772 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.434041 27263 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:47.434823 27342 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.435866 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.436923 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.438349 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.439409 27340 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:47.430927 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:47.444104 27309 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52492 dropped due to backpressure: service queue is full with 50 items
I20260709 13:09:47.444536 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:47.446110 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.450562 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.450928 27265 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:09:47.451951 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.452957 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.453547 27335 raft_consensus.cc:2376] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:47.454332 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.454504 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:47.427963 28010 raft_consensus.cc:2368] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9.
I20260709 13:09:47.455510 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.499137 27336 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:47.496703 27340 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.507386 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.499814 27341 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:47.428304 30152 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:47.326680 30073 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:47.528680 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.455265 30130 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:47.552105 27268 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:09:47.552834 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 191837us
I20260709 13:09:47.553882 27268 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:47.554554 27380 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.006s (SENT)
I20260709 13:09:47.557396 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:47.427732 30177 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:09:47.500310 29999 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.504595 30044 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.501505 30055 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.444422 27309 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:52492 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2040)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2032)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2048)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2066)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2041)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2047)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2055)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2067)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2063)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1813)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 11)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2044)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 364)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2049)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2051)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2064)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2070)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2071)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2074)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2078)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1810)
I20260709 13:09:47.562791 27268 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:47.449527 29786 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:09:47.455050 30006 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:09:47.456969 30129 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 13:09:47.335923 30167 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.556973 30049 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:47.582297 30049 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.582726 30049 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.586246 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.547315 30130 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:47.613929 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.697674 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.622038 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 176704us
I20260709 13:09:47.720203 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:47.720322 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 132949us
I20260709 13:09:47.721438 27260 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:47.772544 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:47.717851 30130 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:47.784626 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.786119 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:47.788069 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.570899 29999 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.572911 30044 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.795704 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.814033 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.814515 27341 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:47.814754 27336 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:47.815798 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.816491 27336 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:47.817291 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.817868 27336 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:47.778091 30167 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.820447 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.823483 27334 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.824177 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.824819 27336 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:47.825680 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.826134 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:47.826757 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.827699 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:47.813410 30068 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.003s
I20260709 13:09:47.770375 30126 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:09:47.849542 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 106455us
I20260709 13:09:47.812844 30010 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:47.855494 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.861645 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.862396 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.862879 27341 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:47.795519 30092 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.821091 30121 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:47.847882 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.866915 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1773) took 1261 ms. Trace:
I20260709 13:09:47.876158 27409 rpcz_store.cc:276] 0709 13:09:46.605139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.708824 (+103685us) service_pool.cc:224] Handling call
0709 13:09:47.866490 (+1157666us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540015b154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:47.866814 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":997304576}
I20260709 13:09:47.775353 29673 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:09:47.869379 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.884928 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:47.888723 30177 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:47.796274 30030 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:09:47.889340 30177 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:47.892120 30173 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.677s	user 0.001s	sys 0.009s
I20260709 13:09:47.860440 30117 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:09:47.893065 27259 raft_consensus.cc:2410] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:47.895493 30052 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:47.896175 30052 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:47.896548 30052 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.896911 30052 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:47.841586 30071 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:47.909996 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:47.872917 30181 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.315s	user 0.000s	sys 0.000s
I20260709 13:09:47.903623 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.884951 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.925338 27340 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:47.913540 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.914341 27334 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:47.856931 30068 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:47.927425 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.932271 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:47.935531 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.937561 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:47.937718 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:47.938156 27415 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:47.935645 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.998554 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.875546 30056 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:47.841084 30179 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.110s
I20260709 13:09:47.897693 29988 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.003887 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:47.872713 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 4b44d9e3827f45eabce8235344e58d0f: Illegal state: Replica d02eb2355bc54e7f8c13a30c33793d95 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:48.006037 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.019361 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.020045 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.020298 27343 raft_consensus.cc:2410] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:09:48.020650 27417 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:48.021224 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.022315 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.002794 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.008620 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.944947 27341 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:48.013132 30073 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.938836 30121 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:09:47.939635 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:47.956548 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:47.939670 27413 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:48.013957 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:47.940045 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:47.887037 30144 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:47.882261 30092 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.030628 27417 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:48.030925 27410 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:48.061875 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.031155 27334 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.025048 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.066354 27340 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:48.069480 27417 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:09:48.042778 30190 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:09:48.040335 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.025446 27341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:48.023152 27343 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:09:48.053457 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.106246 27341 raft_consensus.cc:606] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:48.106654 27411 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:48.106719 27341 raft_consensus.cc:614] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:48.049635 27338 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.000s
I20260709 13:09:48.107515 27334 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:48.107909 27338 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:48.106297 27412 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:47.883529 30047 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:09:48.058306 27415 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:48.108892 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:48.026481 30188 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.248s	user 0.000s	sys 0.000s
I20260709 13:09:48.035629 27336 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:48.088395 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.115952 27417 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:48.026989 29999 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.042039 30092 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.043718 30173 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:48.096796 29990 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.002s
I20260709 13:09:48.024263 30044 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:48.099552 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 384942us
I20260709 13:09:48.025736 29886 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:09:48.101923 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 225188us
I20260709 13:09:48.152293 27338 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:09:48.025602 30122 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:09:48.026847 30126 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:09:48.161613 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.105312 27410 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:48.162693 27410 pending_rounds.cc:85] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 7
I20260709 13:09:48.162942 27410 pending_rounds.cc:107] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:09:48.163190 27410 raft_consensus.cc:2889] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.077769 30177 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.165119 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.113615 27343 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:48.114832 27416 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:09:48.036715 30144 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:48.077322 30183 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.529s	user 0.002s	sys 0.000s
I20260709 13:09:48.117513 27336 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:48.027400 30073 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.152896 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:47.932582 30178 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.218s
W20260709 13:09:48.167668 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.009s	sys 0.035s
I20260709 13:09:48.171403 27343 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:48.184836 30197 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.199582 30201 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:09:48.200137 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.009s	sys 0.036s
W20260709 13:09:48.200512 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 639978us
I20260709 13:09:48.151381 30173 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.203109 30173 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.206696 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.207275 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.207852 30197 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:48.208938 30056 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:48.209501 30056 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:48.210228 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.228s (SENT)
I20260709 13:09:48.186450 30144 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.187595 30055 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.211732 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.212395 30055 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:48.188604 27336 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:48.215042 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.185318 30068 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.190253 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:48.211627 30083 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.054s	user 0.012s	sys 0.000s
I20260709 13:09:48.158911 29786 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:09:48.189429 30151 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.067s	user 0.008s	sys 0.003s
I20260709 13:09:48.216240 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.216893 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.227083 27413 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.217198 27336 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:09:48.190382 30073 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.229274 27336 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:48.232167 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.226100 27337 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:48.218545 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.219312 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.219913 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.223532 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.223852 27417 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:48.233875 27412 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.240370 27336 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:48.240834 27233 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.242067 27233 leader_election.cc:400] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:48.242336 27233 leader_election.cc:403] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:09:48.242421 27336 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:09:48.244720 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:48.227584 30188 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:48.239353 30173 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:48.227733 30144 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:48.246752 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:48.228030 30135 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.006s	sys 0.047s
I20260709 13:09:48.257654 30174 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:09:48.259303 30049 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260709 13:09:48.259910 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2042) took 1064 ms. Trace:
I20260709 13:09:48.292088 27339 rpcz_store.cc:276] 0709 13:09:47.195790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.353645 (+157855us) service_pool.cc:224] Handling call
0709 13:09:48.259672 (+906027us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400229f54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:48.259834 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79877888}
I20260709 13:09:48.259958 30073 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:48.261307 30173 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.264861 30083 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:48.261996 30194 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.323s	user 0.002s	sys 0.000s
W20260709 13:09:48.263576 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.266148 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.256953 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.256487 30177 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 4. Current term is 5.
I20260709 13:09:48.305249 27413 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:48.263971 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:48.264122 27334 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:48.306269 27334 pending_rounds.cc:85] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 3
I20260709 13:09:48.306535 27334 pending_rounds.cc:107] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:48.306782 27334 raft_consensus.cc:2889] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:48.306957 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:48.264384 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 447938us
I20260709 13:09:48.280761 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:48.308172 27266 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:48.308626 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:48.278163 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.007s
I20260709 13:09:48.278715 30203 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:48.309419 30142 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.310104 30203 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.310565 30203 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.257004 30179 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:09:48.282467 27260 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:48.308933 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.285446 27265 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:09:48.286062 30034 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.889s	user 0.010s	sys 0.000s
I20260709 13:09:48.287633 30056 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.287832 30055 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.313598 27342 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:48.231346 30178 consensus_queue.cc:1243] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:09:48.316156 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85024.4us
W20260709 13:09:48.319263 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.007s
I20260709 13:09:48.320896 30203 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.321393 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.261775 30144 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:48.327527 30203 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.327276 30144 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.306035 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:48.256511 28006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 385) took 1340 ms. Trace:
W20260709 13:09:48.282810 30135 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.006s	sys 0.047s
I20260709 13:09:48.325063 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:48.328660 27263 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:09:48.309772 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.330946 30203 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.296304 27412 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:48.332875 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:48.334235 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 225424us
I20260709 13:09:48.280521 30174 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:48.246186 30204 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:48.339318 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 75411.6us
I20260709 13:09:48.343564 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:48.336941 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.333016 27412 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:48.332871 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:48.374508 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:48.334089 30010 raft_consensus.cc:2764] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:48.390256 27261 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:48.341668 27266 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
W20260709 13:09:48.354899 27380 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.515s (SENT)
I20260709 13:09:48.345089 30178 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:48.360838 27233 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.363894 27411 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:48.356428 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.300283 30049 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.386282 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:48.402061 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:48.402823 27261 raft_consensus.cc:2376] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:48.403126 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 346) took 1002 ms. Trace:
I20260709 13:09:48.403595 27259 rpcz_store.cc:276] 0709 13:09:47.400196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.404288 (+  4092us) service_pool.cc:224] Handling call
0709 13:09:48.402924 (+998636us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b540034f654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:48.403067 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085647616}
I20260709 13:09:48.349473 30203 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.371066 27413 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:48.399808 27411 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:48.304905 30083 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:48.392608 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.734s (SENT)
I20260709 13:09:48.405652 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.368947 30034 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:48.377965 30177 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:48.401002 27412 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:48.368403 30208 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:48.418179 27409 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:48.412449 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.420471 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:48.420768 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60011.1us
I20260709 13:09:48.398765 30178 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:48.422382 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 64279us
W20260709 13:09:48.422575 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66234.9us
I20260709 13:09:48.425058 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.425359 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.409616 30179 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:48.438503 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.447602 27336 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:48.451561 27413 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:48.413108 30051 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:48.412495 30170 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:48.424681 30167 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
I20260709 13:09:48.455540 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:48.410543 30056 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:09:48.328661 28006 rpcz_store.cc:276] 0709 13:09:46.916460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.924733 (+  8273us) service_pool.cc:224] Handling call
0709 13:09:46.954050 (+ 29317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:46.992721 (+ 38671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.240199 (+1247478us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400492354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:48.256425 (+ 16226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64473344}
I20260709 13:09:48.415587 30177 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:48.407517 29786 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:09:48.418783 30072 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:48.458086 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:48.570917 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 112900us
I20260709 13:09:48.484617 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:09:48.423851 30052 consensus_meta.cc:287] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.004s
I20260709 13:09:48.486670 29849 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.423638 29990 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:48.432121 30195 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:48.432435 30178 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.432535 30207 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:48.493515 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.432916 30208 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:48.415719 30203 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.624083 27260 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:48.421330 30129 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:09:48.425770 30010 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:09:48.486045 30044 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:48.634459 30044 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.634984 30044 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:48.636668 30208 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.455405 30201 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:09:48.560295 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:48.491858 30055 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:48.639532 30055 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:48.639780 30213 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:48.628453 30173 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.640528 30055 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.645560 30044 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.646518 30083 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.616073 30218 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:48.648097 30044 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.454118 30151 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:09:48.581281 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96758.7us
I20260709 13:09:48.667799 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:48.583881 30170 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.583911 30072 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:48.585659 30216 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:09:48.586361 30209 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:09:48.571079 30177 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.551486 30122 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:48.417724 30174 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.486306 30051 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.618860 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:48.610266 29990 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.630255 27267 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:48.708900 27267 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:48.597261 30130 consensus_meta.cc:287] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.008s
I20260709 13:09:48.633526 30049 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:48.648061 30218 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:48.577359 30182 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.581950 30052 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:48.664412 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 237012us
W20260709 13:09:48.772558 27380 leader_election.cc:336] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.533s (SENT)
I20260709 13:09:48.773131 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:48.665170 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 286357us
I20260709 13:09:48.624222 30203 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.685554 27417 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:09:48.540270 30221 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.202s
I20260709 13:09:48.677857 30219 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:48.707718 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 89076.1us
I20260709 13:09:48.817641 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.711122 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2081) took 1389 ms. Trace:
I20260709 13:09:48.498754 27335 raft_consensus.cc:2410] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:48.717195 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.709784 27267 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.823599 27267 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:48.819928 27342 rpcz_store.cc:276] 0709 13:09:47.321410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.585991 (+264581us) service_pool.cc:224] Handling call
0709 13:09:48.710885 (+1124894us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54002db754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:48.711061 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362107264}
I20260709 13:09:48.776117 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2070) took 1458 ms. Trace:
I20260709 13:09:48.825001 27341 rpcz_store.cc:276] 0709 13:09:47.317858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.159889 (+842031us) service_pool.cc:224] Handling call
0709 13:09:48.176608 (+ 16719us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.177039 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.177080 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.217760 (+ 40680us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.412282 (+194522us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:48.768596 (+356314us) log.cc:844] Serialized 14 byte log entry
0709 13:09:48.768829 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.768904 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.768945 (+    41us) raft_consensus.cc:1685] finished
0709 13:09:48.775859 (+  6914us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.776043 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69219,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":437596,"threads_started":2,"wal-append.queue_time_us":260498}
W20260709 13:09:48.774864 27380 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 3.087s (SENT)
I20260709 13:09:48.682008 30195 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:48.804561 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 364) took 1585 ms. Trace:
I20260709 13:09:48.837173 27340 rpcz_store.cc:276] 0709 13:09:47.218697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.084729 (+866032us) service_pool.cc:224] Handling call
0709 13:09:48.098278 (+ 13549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.098636 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:48.098668 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.101173 (+  2505us) log.cc:844] Serialized 26 byte log entry
0709 13:09:48.333858 (+232685us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:48.340048 (+  6190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:48.340146 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:48.804272 (+464126us) raft_consensus.cc:1685] finished
0709 13:09:48.804300 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:48.804487 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1319,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13406,"thread_start_us":232309,"threads_started":1,"wal-append.queue_time_us":288493}
I20260709 13:09:48.714484 30151 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:48.827415 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:48.843246 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:48.844044 27342 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:09:48.833427 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:48.840297 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.747818 30083 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.771799 30201 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.873878 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.860333 27408 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:48.859874 27267 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:09:48.799878 30049 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.682685 30006 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:09:48.683530 30170 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.841426 30135 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:48.875741 27267 pending_rounds.cc:85] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 8
I20260709 13:09:48.875363 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.914549 27342 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:48.915867 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:48.916589 27342 raft_consensus.cc:2376] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5. Re-sending same reply.
I20260709 13:09:48.917604 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.918313 27342 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:48.877745 27411 pending_rounds.cc:85] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 5
I20260709 13:09:48.880231 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.919056 27411 pending_rounds.cc:107] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.6
I20260709 13:09:48.767958 30130 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.814110 30219 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.887516 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:48.887661 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:48.927044 27412 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:09:48.889257 29990 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.889906 30242 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:48.889662 30218 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.891875 30051 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.894919 30237 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.870759 27414 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:48.899781 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:48.882302 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 107466us
W20260709 13:09:48.936127 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.547s (SENT)
I20260709 13:09:48.836359 30217 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:09:48.967873 30052 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:48.885509 30201 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.900704 30135 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:48.977831 30135 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.982630 30130 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.856798 30207 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:48.925020 27411 raft_consensus.cc:2917] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Aborting config change with OpId 5.6: Aborted: Op aborted by new leader
I20260709 13:09:48.703454 30072 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.923985 27267 pending_rounds.cc:107] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:09:49.034193 27267 raft_consensus.cc:2889] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.920248 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.035594 27341 raft_consensus.cc:2376] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
W20260709 13:09:48.940865 30191 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.838s	user 0.008s	sys 0.000s
I20260709 13:09:48.944870 30170 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:48.945438 30234 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.039489 30234 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.042497 30234 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:48.945976 30228 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:48.948311 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:49.044394 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 96183.1us
I20260709 13:09:49.046531 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:48.952167 30230 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:48.954571 30142 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:49.048944 30142 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:49.050091 30142 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.990058 27340 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:48.928560 30219 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:48.878371 30083 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.889285 30177 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:48.998296 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:48.921145 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.027463 27411 raft_consensus.cc:2889] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.990182 30052 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:49.054522 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:49.007328 30151 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:49.055156 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 349) took 1634 ms. Trace:
I20260709 13:09:49.063428 27267 rpcz_store.cc:276] 0709 13:09:47.400846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.501417 (+100571us) service_pool.cc:224] Handling call
0709 13:09:47.516235 (+ 14818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.630155 (+1113920us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400174ba0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82ba8dc0 00007fbd82c331c0 00007fbd82c34231 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c
0709 13:09:49.034806 (+404651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.035104 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127986048}
I20260709 13:09:49.007787 30135 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.059924 27342 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:09:49.065253 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.032024 30203 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.071520 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:49.061774 30152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:09:49.077016 30246 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.079396 30212 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.081336 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:49.083484 30243 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.085413 30049 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:49.086102 30049 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:49.087253 30189 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:49.088152 30189 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:49.060813 30179 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:49.065228 30142 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.070901 30051 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:49.100495 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 177083us
I20260709 13:09:49.099100 30049 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:09:49.109025 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.109089 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.091068 30189 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:49.066692 30052 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.112485 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:49.094043 30247 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.072953 30203 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.115917 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.116885 27417 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:49.118777 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:49.120011 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 804fae3c2b684e6a8a7c159e417231fa: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:49.123152 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.124348 30250 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:49.125015 30250 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.092067 30129 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:49.128216 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 526) took 2212 ms. Trace:
I20260709 13:09:49.129554 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.129874 28010 rpcz_store.cc:276] 0709 13:09:46.916132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.925211 (+  9079us) service_pool.cc:224] Handling call
0709 13:09:49.109588 (+2184377us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540060ead4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.126001 (+ 16413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778915584}
W20260709 13:09:49.131088 27380 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.350s (SENT)
I20260709 13:09:49.102003 29990 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
W20260709 13:09:49.137315 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.137743 27380 leader_election.cc:400] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9.
I20260709 13:09:49.138302 27380 leader_election.cc:403] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:49.120442 30051 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:49.133759 30138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.008s	sys 0.015s
I20260709 13:09:49.107975 30207 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:48.997856 30195 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:49.144832 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 76061244738f450fb409cb866212c235: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:49.112627 30151 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.101346 30179 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:48.997692 30237 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.125597 30250 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.077934 30246 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.157919 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:49.143240 30138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.566s	user 0.009s	sys 0.015s
I20260709 13:09:49.161381 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:49.116421 30178 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.147629 30247 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9.
I20260709 13:09:49.168190 30242 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:49.195046 30252 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.195760 30252 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.198769 30252 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.205020 30237 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.209056 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.212242 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.212911 27340 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:49.213884 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.214509 27340 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:49.217168 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:49.219558 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.220858 30138 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:49.221345 30138 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.221690 30138 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.221958 30201 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.229185 27338 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:49.229465 28010 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.229627 27338 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:49.217962 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:49.235872 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.000s (SENT) [suppressed 54 similar messages]
I20260709 13:09:49.240226 27340 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:49.193028 30177 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.244844 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.230554 27338 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.215767 30083 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.259819 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.260191 27263 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:49.260383 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1319) took 1244 ms. Trace:
I20260709 13:09:49.260890 27409 rpcz_store.cc:276] 0709 13:09:48.016173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.023842 (+  7669us) service_pool.cc:224] Handling call
0709 13:09:48.024114 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.421860 (+397746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.260176 (+838316us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540035b954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:49.260329 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905862016}
I20260709 13:09:49.261665 27259 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:49.262410 27260 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:49.263262 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.265426 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:49.265655 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:49.258271 30055 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:09:49.168390 30189 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.235201 30212 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:49.277441 27260 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:49.277936 27260 pending_rounds.cc:85] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:09:49.278210 27260 pending_rounds.cc:107] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:49.252759 28010 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:49.278520 27260 raft_consensus.cc:2889] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.279224 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.268481 27342 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:49.268787 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.269615 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.267431 30189 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.270931 30259 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:49.274562 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:49.284354 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.285460 27261 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.285625 27342 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:49.231001 30219 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.275815 30052 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:49.276167 27335 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2059) took 1996 ms (client timeout 2350 ms). Trace:
I20260709 13:09:49.281243 27263 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:49.281678 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:49.286981 27335 rpcz_store.cc:269] 0709 13:09:47.280292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.454117 (+173825us) service_pool.cc:224] Handling call
0709 13:09:49.275975 (+1821858us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540014bed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.276110 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398167808}
I20260709 13:09:49.281323 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.280560 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:49.282554 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46703.4us
I20260709 13:09:49.272792 30246 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.288151 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.290619 27260 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:49.291899 27335 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:49.291247 30055 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:49.295212 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.296175 27335 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:09:49.295234 30218 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:49.297152 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.297634 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.298151 27335 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:49.298425 27340 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:09:49.299021 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:49.299183 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.299870 27340 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:09:49.301869 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1414731990000746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:09:49.302220 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.302628 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0274712189999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:09:49.304421 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.265931 30179 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.289765 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.303692 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:49.308636 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:49.308210 30182 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:49.310527 30182 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:49.310950 30182 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.310978 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.318233 27261 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:49.290470 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:49.288802 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:49.327551 27263 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 13:09:49.305244 27260 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:49.305258 27335 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:09:49.331956 27335 pending_rounds.cc:85] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:09:49.332329 27335 pending_rounds.cc:107] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:09:49.332567 27335 raft_consensus.cc:2889] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.333068 27261 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:49.330830 27263 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:09:49.335366 27342 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:49.324193 30052 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.341821 28008 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:49.337617 30122 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:09:49.393726 30267 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:09:49.630537 30217 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:49.632817 30174 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:49.355592 30178 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.571384 27414 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:49.570974 27342 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:09:49.576122 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:49.567245 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.397943 30173 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:49.649335 30173 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:49.650202 30173 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.482652 30182 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.397369 30219 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.412254 30243 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:49.401503 30225 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.835s	user 0.012s	sys 0.000s
I20260709 13:09:49.658296 30122 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:49.659152 30122 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:49.661080 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2049) took 2438 ms. Trace:
I20260709 13:09:49.661827 27334 rpcz_store.cc:276] 0709 13:09:47.222680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.108551 (+885871us) service_pool.cc:224] Handling call
0709 13:09:48.263727 (+155176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.307627 (+ 43900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.660462 (+1352835us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400229f50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.660788 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241228032}
W20260709 13:09:49.393411 30266 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:09:49.644784 27342 pending_rounds.cc:85] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 2
I20260709 13:09:49.677348 27342 pending_rounds.cc:107] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:49.677932 27342 raft_consensus.cc:2889] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.662779 30122 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.355293 30138 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.703428 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1316) took 1763 ms. Trace:
W20260709 13:09:49.707655 30273 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:09:49.353817 30052 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.748723 30138 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:49.583248 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:49.402400 30250 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.742548 27416 rpcz_store.cc:276] 0709 13:09:47.940093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.006578 (+ 66485us) service_pool.cc:224] Handling call
0709 13:09:48.114593 (+108015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.171860 (+ 57267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.702769 (+1530909us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400087850. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.703086 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247656704}
I20260709 13:09:49.751734 30126 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:49.761723 30250 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.758226 30127 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:49.766410 30127 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:49.768559 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 459982us
I20260709 13:09:49.770279 30127 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.773085 30127 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.774405 27338 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.758847 30126 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:49.771518 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:49.792677 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.800343 27338 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:49.801010 27338 pending_rounds.cc:85] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 3
I20260709 13:09:49.801368 27338 pending_rounds.cc:107] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:49.801692 27338 raft_consensus.cc:2889] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.802158 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 355) took 1099 ms. Trace:
I20260709 13:09:49.800446 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1317) took 1859 ms. Trace:
I20260709 13:09:49.802806 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2064) took 2486 ms. Trace:
W20260709 13:09:49.810209 30265 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:09:49.810226 27408 rpcz_store.cc:276] 0709 13:09:47.940443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.019231 (+ 78788us) service_pool.cc:224] Handling call
0709 13:09:48.019551 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.875259 (+855708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.799730 (+924471us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b540015b654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:49.800243 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1932916608}
I20260709 13:09:49.802752 27413 rpcz_store.cc:276] 0709 13:09:48.703130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.703535 (+   405us) service_pool.cc:224] Handling call
0709 13:09:48.703856 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:48.803463 (+ 99607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.803513 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:48.803572 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:48.803627 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.801559 (+997932us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54000bd6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:49.801639 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:49.801950 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228422912}
I20260709 13:09:49.813977 27338 rpcz_store.cc:276] 0709 13:09:47.316419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.153154 (+836735us) service_pool.cc:224] Handling call
0709 13:09:48.166252 (+ 13098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.229074 (+1062822us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540040a9a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82ba8dc0 00007fbd82c331c0 00007fbd82c34231 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c
0709 13:09:49.773081 (+544007us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b58007d00d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82b8d0aa 00007fbd82c0f447 00007fbd82c27fe7 00007fbd82c297de 00007fbd82c33b49 00007fbd82c34416 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4
0709 13:09:49.802439 (+ 29358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.802742 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072051328}
I20260709 13:09:49.815740 30138 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:49.817588 30138 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.818328 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.819842 27413 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:49.821079 30138 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.822602 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:49.823664 27338 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:49.824824 30202 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:49.825448 30202 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:49.825807 27338 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:49.826176 30202 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:49.815951 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:49.826134 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.837066 27416 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:49.837286 27408 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:49.835891 30189 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.838372 30189 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.839226 30218 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:49.800596 30126 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.840016 30218 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:49.840896 30189 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:49.837417 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:49.802829 29988 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:09:49.842427 27414 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.843453 30126 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:49.828879 30219 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:49.827519 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.855892 27413 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:49.841905 30218 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.864087 27410 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:09:49.872753 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 101494us
W20260709 13:09:49.877676 27337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2041) took 2681 ms (client timeout 3087 ms). Trace:
I20260709 13:09:49.877938 27410 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:09:49.878252 27337 rpcz_store.cc:269] 0709 13:09:47.195536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:47.868761 (+673225us) service_pool.cc:224] Handling call
0709 13:09:49.872123 (+2003362us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000e2754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.877341 (+  5218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690267392}
I20260709 13:09:49.880156 27334 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:49.880630 27337 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:09:49.884210 27414 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:49.875967 30052 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:49.885815 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:49.886966 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:49.888025 27410 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:49.888377 30068 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:49.889051 30068 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:49.889343 27417 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:49.889673 30068 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:49.892017 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:49.893601 30152 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:49.893734 27408 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:09:49.888285 30274 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.219s	user 0.000s	sys 0.002s
I20260709 13:09:49.896232 30218 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:49.898046 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:49.910043 30182 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:49.923620 30177 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:49.927649 27337 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:49.911556 30202 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:49.939366 30187 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.845s	user 0.005s	sys 0.012s
I20260709 13:09:49.939682 27417 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:49.948421 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:49.949622 27410 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:49.951831 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:49.951690 30210 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:49.953131 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:49.957295 30221 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:49.959108 30221 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:49.960783 30221 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:49.967644 27413 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:49.967725 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1832) took 1132 ms. Trace:
W20260709 13:09:49.973465 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:49.971101 27334 rpcz_store.cc:276] 0709 13:09:48.835593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.664212 (+828619us) service_pool.cc:224] Handling call
0709 13:09:49.875068 (+210856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:49.880624 (+  5556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:49.967485 (+ 86861us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000e2750. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:49.967665 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482492288}
W20260709 13:09:49.979832 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 82355.8us
I20260709 13:09:49.998023 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:50.021955 27262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2057) took 1647 ms (client timeout 1694 ms). Trace:
I20260709 13:09:50.023679 30151 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.024405 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.024348 30151 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:50.025418 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 442676us
I20260709 13:09:50.025993 30203 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.026543 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.027180 30203 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:50.028442 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:50.028755 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 219762us
I20260709 13:09:50.029297 30117 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:50.032128 30142 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:50.032581 30142 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:50.033455 30174 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:50.035102 30083 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:50.035532 30083 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:50.033936 30142 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.028416 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:50.022730 27262 rpcz_store.cc:269] 0709 13:09:48.374059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.374163 (+   104us) service_pool.cc:224] Handling call
0709 13:09:50.021363 (+1647200us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b540034f154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:50.021695 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1140713216}
I20260709 13:09:49.969117 30173 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:49.981887 30210 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:09:50.058084 27410 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:50.055867 30182 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.067948 30142 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.072520 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:50.086477 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 88660.3us
I20260709 13:09:50.094563 30127 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:50.096469 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.097720 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.073151 30151 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.036505 30083 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.119547 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.123762 30202 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.111903 30122 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:50.116324 30226 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.226s	user 0.002s	sys 0.002s
I20260709 13:09:50.106014 30068 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.137245 30083 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:50.137560 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.113643 30250 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:50.144729 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.144903 30121 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:50.145618 30210 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:50.145736 30173 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:50.149854 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.112083 30203 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.155244 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 126962us
I20260709 13:09:50.151464 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:50.172261 30117 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.173111 30117 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.160127 30121 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.175518 30121 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.176060 27263 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:50.176290 30117 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.173142 27415 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:09:50.169538 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.156462 30250 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.190850 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.156152 30151 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:50.195341 30179 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:50.195658 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.200588 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2106) took 1031 ms. Trace:
W20260709 13:09:50.200943 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.168340 30210 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:50.180337 29988 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.204119 27417 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:50.199560 30250 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.220372 30214 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.203758 30117 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:09:49.640595 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.213532 29988 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.205205 27338 rpcz_store.cc:276] 0709 13:09:49.169015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.831192 (+662177us) service_pool.cc:224] Handling call
0709 13:09:49.831820 (+   628us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:50.031867 (+200047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.031898 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:50.032526 (+   628us) log.cc:844] Serialized 52 byte log entry
0709 13:09:50.079365 (+ 46839us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:50.199138 (+119773us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.200258 (+  1120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.200340 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.200390 (+    50us) raft_consensus.cc:1685] finished
0709 13:09:50.200400 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.200531 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198722,"raft.queue_time_us":198096,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"thread_start_us":129250,"threads_started":2,"wal-append.queue_time_us":103970}
I20260709 13:09:50.224380 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2095) took 1377 ms. Trace:
I20260709 13:09:50.223583 30214 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.233518 27336 rpcz_store.cc:276] 0709 13:09:48.829753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.309290 (+479537us) service_pool.cc:224] Handling call
0709 13:09:49.309699 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:49.965545 (+655846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.965594 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:49.966375 (+   781us) log.cc:844] Serialized 52 byte log entry
0709 13:09:50.045272 (+ 78897us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:50.080040 (+ 34768us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.084651 (+  4611us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.084950 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.101890 (+ 16940us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18000ec9e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:50.103407 (+  1517us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.186042 (+ 82635us) raft_consensus.cc:1685] finished
0709 13:09:50.186073 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.207591 (+ 21518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":661197,"prepare.queue_time_us":25363,"raft.queue_time_us":663660,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":3424,"spinlock_wait_cycles":66245248,"thread_start_us":78412,"threads_started":1,"wal-append.queue_time_us":147078}
I20260709 13:09:50.216150 30203 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.239212 29988 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.279333 30201 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.280071 30201 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.282646 30201 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.287573 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2084) took 1416 ms. Trace:
I20260709 13:09:50.288069 27341 rpcz_store.cc:276] 0709 13:09:48.821523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.036613 (+215090us) service_pool.cc:224] Handling call
0709 13:09:49.037099 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.061040 (+ 23941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.061077 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.061554 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.028973 (+967419us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180038c920. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:50.087409 (+ 58436us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:50.215567 (+128158us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.218704 (+  3137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.228962 (+ 10258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.229027 (+    65us) raft_consensus.cc:1685] finished
0709 13:09:50.231872 (+  2845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.237811 (+  5939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23494,"prepare.queue_time_us":131240,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":35430,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":27457,"spinlock_wait_cycles":3476864,"thread_start_us":139216,"threads_started":2,"wal-append.queue_time_us":1116993}
I20260709 13:09:50.292150 30068 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:50.299463 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61674.4us
I20260709 13:09:50.301755 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.228061 30151 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.256608 30214 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.315850 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:50.323884 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 208530us
I20260709 13:09:50.325249 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.333499 27263 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:50.337024 30201 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:50.339913 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.342043 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.343333 30117 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.343452 30202 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.344270 30202 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:50.344038 30117 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.345865 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.346464 30117 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.347318 27265 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:50.347509 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.349648 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.350730 27233 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.340133 30201 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.363524 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.364594 30201 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.331339 30142 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.310793 30083 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.373409 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.376190 30203 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.268702 30179 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.388962 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.392288 27416 raft_consensus.cc:2410] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:50.392288 27408 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:50.396353 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50593.8us
I20260709 13:09:50.397127 30034 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.397773 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.398811 30182 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:50.399757 27259 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:09:50.401748 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.402599 30182 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.407191 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.394369 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:50.389510 30173 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:50.386910 30068 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:50.413388 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80540.7us
I20260709 13:09:50.420161 30203 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.429073 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.362033 30210 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.436009 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2094) took 1606 ms. Trace:
I20260709 13:09:50.436265 30151 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.436435 27340 rpcz_store.cc:276] 0709 13:09:48.829512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.301276 (+471764us) service_pool.cc:224] Handling call
0709 13:09:49.301508 (+   232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:49.306417 (+  4909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.306456 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:49.307443 (+   987us) log.cc:844] Serialized 52 byte log entry
0709 13:09:49.709670 (+402227us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:49.710306 (+   636us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.023914 (+313608us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.024099 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.024205 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.368104 (+343899us) spinlock_profiling.cc:243] Waited 5.28 ms on lock 0x7b18003a49e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:50.435616 (+ 67512us) raft_consensus.cc:1685] finished
0709 13:09:50.435635 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.435821 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317167,"prepare.queue_time_us":34528,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":134,"raft.queue_time_us":976747,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":355,"spinlock_wait_cycles":12146560,"thread_start_us":286799,"threads_started":1,"wal-append.queue_time_us":324911}
I20260709 13:09:50.426710 30203 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.410187 30142 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.447790 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.449687 30151 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.450304 30177 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:50.450738 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.450364 30151 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.452329 30177 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:50.452956 30177 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:50.453788 30296 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:50.454258 30151 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.454108 30177 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.455086 30178 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:50.455476 30068 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:50.457226 30068 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:50.459686 27265 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:50.388370 30121 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.457070 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:50.468292 30151 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.468942 30151 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.470393 30121 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.471117 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.439016 30203 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.427268 30173 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:50.481204 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:50.475533 30182 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.493595 27265 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:50.510839 30292 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:09:50.512982 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.507114 30117 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:50.515599 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.517328 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.517966 30117 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.518011 30173 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.520207 30142 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.518536 30117 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.523626 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.524036 30151 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.524111 30117 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.524899 30151 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:50.513023 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.526142 27261 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:50.527336 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.510190 30121 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.531330 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60312.1us
I20260709 13:09:50.531888 30121 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.532831 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:50.533890 30202 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:50.534162 30121 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.534304 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:09:50.535332 30182 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:50.535389 30202 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:50.535550 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:50.535925 30202 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:50.536347 30202 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.536499 27265 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:50.526808 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 69822us
I20260709 13:09:50.531188 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2078) took 3210 ms. Trace:
I20260709 13:09:50.532199 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:50.467100 30250 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.549935 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.573623 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.576406 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.578001 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.572355 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.536586 30179 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.583652 27261 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.578058 28009 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:50.541857 27343 rpcz_store.cc:276] 0709 13:09:47.320266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.198694 (+878428us) service_pool.cc:224] Handling call
0709 13:09:48.199102 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:48.226079 (+ 26977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:48.226111 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:48.226934 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.123637 (+1896703us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b180045ef20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:50.171256 (+ 47619us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:50.378907 (+207651us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.388546 (+  9639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.394936 (+  6390us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.530738 (+135802us) raft_consensus.cc:1685] finished
0709 13:09:50.530847 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.530999 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26507,"prepare.queue_time_us":50290,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":57,"raft.queue_time_us":47023,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":38121,"spinlock_wait_cycles":30760320,"thread_start_us":180621,"threads_started":2,"wal-append.queue_time_us":1982813}
I20260709 13:09:50.604008 30201 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.605636 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:50.545809 29988 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.607288 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.607999 29988 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.608747 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:50.609689 27416 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.611438 27408 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
W20260709 13:09:50.611549 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61315.1us
I20260709 13:09:50.616266 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.616887 30201 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:50.591764 30121 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:50.621294 27416 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:50.625334 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:50.568923 30142 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:50.626364 27416 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:50.626382 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.628504 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:50.629770 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 179968us
I20260709 13:09:50.601725 30182 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:50.634743 30121 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:50.642781 30201 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:50.674355 27343 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:50.677567 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.662052 30121 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:50.693631 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 77468.5us
W20260709 13:09:50.679055 30287 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.416s	user 0.005s	sys 0.000s
I20260709 13:09:50.645345 30142 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:50.707755 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.716130 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:50.684489 30201 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:50.650518 30214 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:50.718392 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 47379.1us
I20260709 13:09:50.708679 30121 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.710333 30068 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:50.736438 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:50.757426 30034 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:50.758302 30313 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:50.758162 30034 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.757517 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:50.761534 27414 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.739702 30068 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:50.739444 30250 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.776611 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.782140 27416 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:50.782361 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.782948 27262 raft_consensus.cc:2410] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:50.841325 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.842176 27414 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:50.799840 27336 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:50.779493 30068 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:50.853255 27341 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:50.845139 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:50.856675 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:50.848739 30287 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:09:50.864516 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:50.840768 30312 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:09:50.856207 30034 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:50.867507 29988 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:50.875833 30320 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:09:50.875890 27414 raft_consensus.cc:2410] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:50.851888 30250 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:50.879854 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:50.881726 30182 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:50.886126 30182 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:50.887657 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.888326 27265 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:50.889156 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.890269 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.891007 27265 raft_consensus.cc:2410] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:09:50.891316 27262 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:50.892423 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:50.892827 30034 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.894104 29988 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:50.895394 30314 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.895556 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:50.901880 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 192257us
I20260709 13:09:50.904275 27334 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:50.863878 30174 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:50.891330 30178 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.919770 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.915597 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:50.924225 27338 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:50.928120 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:50.930004 27337 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:09:50.904585 30250 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:50.945621 27336 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:09:50.861330 30201 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:50.947395 27342 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:50.946801 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.944579 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:50.948889 27334 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:50.946048 27336 pending_rounds.cc:85] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 6
I20260709 13:09:50.957615 27336 pending_rounds.cc:107] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:09:50.957999 27336 raft_consensus.cc:2889] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.910483 30203 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:50.963352 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 200273us
I20260709 13:09:50.916563 30034 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:50.980651 30316 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:09:50.991439 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:50.980119 29988 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:50.996097 30326 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:09:50.997383 30323 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:09:50.998773 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.908699 30314 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.931595 30068 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.933004 30174 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.999789 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:50.997432 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.004427 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:51.022805 27338 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:50.932583 30178 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:50.988610 30142 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.027036 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2097) took 2089 ms. Trace:
W20260709 13:09:51.037683 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 115267us
I20260709 13:09:51.038033 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:51.038975 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.042086 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:51.043886 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.003589 30214 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:51.044327 30330 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:51.045006 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.045737 27264 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:51.046242 30330 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.047678 30250 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.048939 30197 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:51.049620 30197 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:51.020274 30030 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.051687 30030 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:51.052639 30328 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:09:51.053988 30316 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:51.006300 30173 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:51.055205 30173 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.057694 30173 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.058058 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:51.059487 30052 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.059983 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:51.027441 30321 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.060246 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:51.062005 27336 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:09:51.058938 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:51.067191 28007 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.067010 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.036870 27335 rpcz_store.cc:276] 0709 13:09:48.830291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.333392 (+503101us) service_pool.cc:224] Handling call
0709 13:09:49.333687 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:49.967617 (+633930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:49.967660 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:49.968277 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:09:50.105505 (+137228us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:50.203764 (+ 98259us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.204086 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.214974 (+ 10888us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:50.678209 (+463235us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:50.912670 (+234461us) raft_consensus.cc:1685] finished
0709 13:09:50.919991 (+  7321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:50.920141 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":640232,"prepare.queue_time_us":148864,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":639398,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":1488,"spinlock_wait_cycles":66876288,"thread_start_us":177681,"threads_started":2,"wal-append.queue_time_us":214621}
I20260709 13:09:51.046729 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.032637 30314 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.073493 27264 raft_consensus.cc:2410] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:51.073649 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.066315 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.081830 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:51.078581 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.065999 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:51.086185 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:51.091343 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.054003 30030 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:51.099546 30300 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.557s	user 0.000s	sys 0.004s
I20260709 13:09:51.100078 30135 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.101054 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.101666 30083 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:51.104260 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.106271 28007 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:51.106508 30178 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.107457 30174 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:51.097154 30202 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.002s
I20260709 13:09:51.109881 27263 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:09:51.133702 30317 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.354s	user 0.003s	sys 0.001s
W20260709 13:09:51.137157 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.138677 27411 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:51.140376 27260 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:51.096086 30142 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.147468 27414 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:51.125818 30179 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:51.155802 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.167028 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2107) took 1997 ms. Trace:
I20260709 13:09:51.167567 27339 rpcz_store.cc:276] 0709 13:09:49.169355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.864445 (+695090us) service_pool.cc:224] Handling call
0709 13:09:49.864911 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:50.035220 (+170309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.035257 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:50.036041 (+   784us) log.cc:844] Serialized 52 byte log entry
0709 13:09:50.383294 (+347253us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:50.418266 (+ 34972us) log.cc:844] Serialized 14 byte log entry
0709 13:09:50.418534 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:50.418622 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.029932 (+611310us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:51.035519 (+  5587us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b1800425320. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:51.166703 (+131184us) raft_consensus.cc:1685] finished
0709 13:09:51.166722 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.166866 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185839,"prepare.queue_time_us":37184,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2142,"raft.queue_time_us":181907,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":15450,"spinlock_wait_cycles":50367232,"thread_start_us":346269,"threads_started":1,"wal-append.queue_time_us":474379}
W20260709 13:09:51.170293 30334 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 13:09:51.159022 27408 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
W20260709 13:09:51.174156 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.109681 30330 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.112583 27268 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:09:51.066056 30203 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.118932 27262 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:51.121287 27261 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:09:51.122917 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.060060 30052 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.107671 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:51.210114 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 87313.9us
I20260709 13:09:51.212425 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.209648 27267 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:51.223481 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.233362 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.143610 30202 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.238057 30202 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:51.278635 27265 raft_consensus.cc:2410] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:09:51.305743 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 72500.2us
I20260709 13:09:51.306807 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.312480 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:51.313491 27414 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:51.313843 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 267228us
I20260709 13:09:51.314860 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:51.231559 30135 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:51.261397 30203 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.334914 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.224481 30179 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:51.315747 27336 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:51.338009 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:51.330813 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.352228 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45541.9us
I20260709 13:09:51.353499 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.309523 30083 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:51.304145 30177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.003s	sys 0.017s
I20260709 13:09:51.320254 30197 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:51.321084 30142 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:51.319618 30221 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.333575 30127 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.376441 27414 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:51.338587 30068 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.339039 30174 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:51.373591 30177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.004s	sys 0.018s
I20260709 13:09:51.329334 30135 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:51.438040 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.450387 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 97006.7us
I20260709 13:09:51.453327 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:51.408159 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46051.7us
W20260709 13:09:51.464960 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 423027us
I20260709 13:09:51.378206 30034 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.487581 27264 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:51.456976 30135 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:51.459242 30197 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:09:51.499574 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:51.500445 30197 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:51.502271 30197 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:51.407907 30127 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.447863 30083 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.480338 30201 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:51.519345 27265 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:51.519240 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.410382 30221 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.518690 27263 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:51.574703 27265 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:51.378286 30205 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.134s
I20260709 13:09:51.546000 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.507966 30174 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.577010 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.549402 30201 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.549240 30034 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:51.612892 27263 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:09:51.656500 30182 consensus_meta.cc:287] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.770s	user 0.011s	sys 0.003s
W20260709 13:09:51.683508 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 106627us
W20260709 13:09:51.659320 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 206045us
W20260709 13:09:51.645433 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 159680us
I20260709 13:09:51.692045 27265 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.702400 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.705328 27265 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.614863 30199 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.692111 30214 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:51.712925 30214 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:51.714169 30305 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:09:51.704514 30182 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.711494 30199 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.691213 30250 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:51.622676 30310 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:51.682901 29988 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.648111 30052 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:51.632272 30200 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.686714 27263 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.618788 30151 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:51.680826 30201 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:51.641360 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 287798us
I20260709 13:09:51.687726 30174 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.681602 30034 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.766793 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:51.752997 30127 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.756155 30342 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.764420 30218 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:09:51.752617 27409 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.005s	sys 0.028s
I20260709 13:09:51.783025 27263 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:51.767724 30360 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:09:51.787215 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 269373us
W20260709 13:09:51.790170 27409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.005s	sys 0.032s
W20260709 13:09:51.791831 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 89541.1us
I20260709 13:09:51.792804 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.793924 30343 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.794138 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:51.794854 30354 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:09:51.794646 30343 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.795747 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.797394 30343 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:51.797571 30338 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.317s	user 0.002s	sys 0.000s
I20260709 13:09:51.799532 30174 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.800112 30174 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:51.800434 30174 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:51.801080 30174 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.778007 30250 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.811476 27265 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:09:51.812029 27265 pending_rounds.cc:85] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
I20260709 13:09:51.812316 27265 pending_rounds.cc:107] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:09:51.812574 27265 raft_consensus.cc:2889] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:51.816179 30350 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:09:51.822808 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 352934us
I20260709 13:09:51.775113 30151 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:51.808655 30345 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:09:51.804078 30127 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:51.822613 30121 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.006s
I20260709 13:09:51.806704 30142 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:51.827503 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:51.826149 30321 consensus_meta.cc:287] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.006s
W20260709 13:09:51.835395 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.827091 30370 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:09:51.830377 30127 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.779901 30052 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:09:51.851260 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.850311 27410 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:51.850443 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 378) took 1113 ms. Trace:
I20260709 13:09:51.850935 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.851229 30202 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:51.765793 30200 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:51.890405 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.853173 27413 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:09:51.892858 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:51.896458 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66545.5us
I20260709 13:09:51.888986 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:51.864048 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 351916us
W20260709 13:09:51.897099 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 62787.9us
I20260709 13:09:51.898347 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:51.898795 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50475.6us
I20260709 13:09:51.899433 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:51.900586 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 108979us
I20260709 13:09:51.903726 27414 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:51.903790 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.904824 27267 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:51.837031 30203 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:51.837297 30121 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.832026 30250 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:09:51.915997 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.910231 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.851994 30127 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:51.916349 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.843443 30321 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:51.926411 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:51.889987 27259 rpcz_store.cc:276] 0709 13:09:50.736900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.152453 (+415553us) service_pool.cc:224] Handling call
0709 13:09:51.186928 (+ 34475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.187539 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:51.278497 (+ 90958us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.582098 (+303601us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.714267 (+132169us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b180043a980. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:09:51.849712 (+135445us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b180043a980. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:09:51.849950 (+   238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:51.850019 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:51.850084 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.850183 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.850354 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31725,"prepare.queue_time_us":95682,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":142,"raft.queue_time_us":289455,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":7025,"spinlock_wait_cycles":23847168,"thread_start_us":278109,"threads_started":1,"wal-append.queue_time_us":508397}
I20260709 13:09:51.929256 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.930235 27411 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:09:51.932850 27262 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:09:51.888404 30221 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.939355 27412 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:51.935660 27264 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
W20260709 13:09:51.946584 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.952622 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.942878 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:51.943697 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:51.900040 30030 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:09:51.920826 30203 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.970065 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:51.928385 30202 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:51.975975 30373 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.943634 30199 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:51.991287 30329 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:51.992159 30329 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.995790 30200 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.978544 27259 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:51.981962 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:51.972028 30203 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:51.984238 30372 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.000276 30372 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.002692 30372 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:51.984817 30355 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:51.985152 30364 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:51.984526 30373 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:51.986689 30250 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:51.987440 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1267) took 1055 ms. Trace:
I20260709 13:09:52.006211 30373 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.005056 27266 rpcz_store.cc:276] 0709 13:09:50.932157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.302579 (+370422us) service_pool.cc:224] Handling call
0709 13:09:51.303006 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:51.351568 (+ 48562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.351618 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.360574 (+  8956us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.645892 (+285318us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:51.687348 (+ 41456us) log.cc:844] Serialized 14 byte log entry
0709 13:09:51.851415 (+164067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.851494 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:51.987244 (+135750us) raft_consensus.cc:1685] finished
0709 13:09:51.987262 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:51.987381 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":164970,"prepare.queue_time_us":31987,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":165048,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":16430,"thread_start_us":195322,"threads_started":1,"wal-append.queue_time_us":453234}
I20260709 13:09:51.987546 30034 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.988648 30360 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:52.007403 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:51.989302 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.984265 30179 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:52.008567 30179 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.008983 30179 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:52.009066 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:51.990155 30374 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:52.010862 30364 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:52.012307 30364 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.012812 30121 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:51.990075 30370 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:09:52.004117 30358 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:52.019196 27261 raft_consensus.cc:2410] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:52.030834 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.031571 27413 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:09:52.032436 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:51.926466 30371 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 13:09:51.956163 30142 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:09:52.094357 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:09:52.097121 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 77622.5us
I20260709 13:09:52.107019 27263 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:09:52.112172 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:52.112383 27263 pending_rounds.cc:85] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
W20260709 13:09:52.084453 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 54686.8us
I20260709 13:09:51.980947 30330 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:52.100324 30135 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.003s
I20260709 13:09:52.116824 27263 pending_rounds.cc:107] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:09:52.120280 27263 raft_consensus.cc:2889] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:52.117529 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:52.090493 30174 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.090219 30177 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.020946 30202 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.110808 30329 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.129745 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 385) took 1089 ms. Trace:
I20260709 13:09:52.102130 30348 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:09:52.135340 30367 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:09:52.130461 30382 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:52.131839 27263 rpcz_store.cc:276] 0709 13:09:51.040008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.461156 (+421148us) service_pool.cc:224] Handling call
0709 13:09:51.494484 (+ 33328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:52.129393 (+634909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.129662 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:52.139858 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 218191us
I20260709 13:09:52.126924 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:52.136677 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 193049us
I20260709 13:09:52.116422 30330 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.142882 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:52.144621 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:52.145869 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 159878us
I20260709 13:09:52.151449 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:52.128578 30360 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:52.154680 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:52.157433 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.160698 27263 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
W20260709 13:09:52.163092 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 220306us
I20260709 13:09:52.137939 30368 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:52.136093 30348 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:52.139724 30329 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.168282 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.146243 30330 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.170203 27259 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:52.148393 30372 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.124644 30135 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.171384 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:52.174203 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.158932 30218 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.160090 30360 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.156177 30376 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:52.160665 30142 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.147233 30151 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.139688 30174 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.179759 30378 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.177747 30373 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:09:52.180433 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.176851 30218 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.167917 30370 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:52.180457 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.209537 27263 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:52.162424 30377 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:52.140012 30177 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.177769 27264 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:52.173403 30348 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:52.235128 30381 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:52.184296 30360 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:52.245972 30202 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.199524 30151 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.209280 30218 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.261296 30372 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.262156 30387 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:52.264164 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 255222us
I20260709 13:09:52.237131 30377 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.208963 30370 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:52.273617 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:52.263679 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151739us
I20260709 13:09:52.297487 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:52.269587 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:52.288097 30127 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.256626 30381 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.288622 30177 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.289079 30377 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:52.289397 30182 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.299865 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:52.302632 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.273257 30202 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.321300 27264 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:52.323768 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.324596 27414 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:09:52.322875 27264 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:52.304167 30121 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:52.307567 30329 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:52.327039 30375 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:09:52.347554 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 78104.1us
W20260709 13:09:52.366153 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 187091us
I20260709 13:09:52.307087 30381 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:52.368963 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:52.369766 27414 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.375342 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:52.375857 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 76102.7us
I20260709 13:09:52.367872 27264 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:52.407802 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 237049us
I20260709 13:09:52.285023 30151 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:52.377305 30378 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:52.454669 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 87785.3us
I20260709 13:09:52.455636 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:52.350698 30182 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:52.465776 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.503803 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.315415 30372 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.454145 30388 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.509199 27264 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:52.508605 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.511871 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:52.512187 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 148197us
W20260709 13:09:52.513257 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 135952us
I20260709 13:09:52.514225 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:52.515395 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 304257us
I20260709 13:09:52.441329 30368 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.521559 30174 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.349828 30202 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.521903 30151 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.320562 30387 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.454653 30379 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.348s
I20260709 13:09:52.523645 30135 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:52.524758 30201 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.749s	user 0.013s	sys 0.000s
I20260709 13:09:52.525350 30329 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:52.526798 30372 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.527415 30177 raft_consensus.cc:1064] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
W20260709 13:09:52.527693 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:52.381392 30391 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:52.561220 30203 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.004s
I20260709 13:09:52.559877 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.367408 30121 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.568763 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.577517 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.591372 27267 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:52.509821 30382 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:09:52.597856 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:52.599352 30368 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:52.599982 30347 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.945s	user 0.004s	sys 0.005s
I20260709 13:09:52.600183 30368 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:52.600541 30368 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:52.600981 30386 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:52.601428 30368 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.607445 30135 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:52.608232 30135 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.616719 27268 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:52.617193 27268 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:52.618088 27268 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.624373 30083 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:52.626369 30344 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.006s	user 0.008s	sys 0.006s
I20260709 13:09:52.626513 30202 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.627197 30202 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:52.628247 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2108) took 1747 ms. Trace:
I20260709 13:09:52.628646 27341 rpcz_store.cc:276] 0709 13:09:50.881103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.881404 (+   301us) service_pool.cc:224] Handling call
0709 13:09:50.901505 (+ 20101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:50.947057 (+ 45552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:50.947090 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:51.000296 (+ 53206us) log.cc:844] Serialized 26 byte log entry
0709 13:09:51.319674 (+319378us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:51.319716 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.319791 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.625498 (+1305707us) spinlock_profiling.cc:243] Waited 85.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:52.627895 (+  2397us) raft_consensus.cc:1685] finished
0709 13:09:52.627916 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.628185 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14147,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16675,"spinlock_wait_cycles":195966208,"thread_start_us":253534,"threads_started":1,"wal-append.queue_time_us":492028}
I20260709 13:09:52.629768 30142 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:52.633018 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 384) took 1446 ms. Trace:
I20260709 13:09:52.579785 30201 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.633634 30387 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:52.634603 30341 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.994s	user 0.000s	sys 0.016s
I20260709 13:09:52.635494 30201 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.637069 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1343) took 2303 ms. Trace:
I20260709 13:09:52.637925 30393 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:52.616775 30385 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:09:52.638517 30393 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:52.640275 30214 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:52.637473 27417 rpcz_store.cc:276] 0709 13:09:50.333515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.333628 (+   113us) service_pool.cc:224] Handling call
0709 13:09:50.349010 (+ 15382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:51.041612 (+692602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:51.041642 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:51.042282 (+   640us) log.cc:844] Serialized 52 byte log entry
0709 13:09:51.358157 (+315875us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:51.358197 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:51.358295 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:52.633901 (+1275606us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:52.636700 (+  2799us) raft_consensus.cc:1685] finished
0709 13:09:52.636718 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.636989 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":692055,"raft.queue_time_us":698277,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":129560832,"thread_start_us":315407,"threads_started":1,"wal-append.queue_time_us":539138}
I20260709 13:09:52.640892 30214 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.641618 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.642269 27260 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:52.562034 30174 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.641415 30214 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.644062 27268 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:52.644093 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 127409us
I20260709 13:09:52.516427 30182 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.602922 30368 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:52.657843 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 290875us
I20260709 13:09:52.671762 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.674743 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:52.587378 30391 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.588477 30395 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:52.746414 27262 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:52.509245 30370 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.651851 30135 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:52.633461 27408 rpcz_store.cc:276] 0709 13:09:51.186999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.187462 (+   463us) service_pool.cc:224] Handling call
0709 13:09:51.240161 (+ 52699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.240481 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:51.513092 (+272611us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.632118 (+1119026us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b180032bfc0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287
0709 13:09:52.632478 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:09:52.632669 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:52.632713 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:52.632764 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.632829 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:52.632953 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83473,"prepare.queue_time_us":560277,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":182016,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":4393,"spinlock_wait_cycles":6972544,"thread_start_us":368239,"threads_started":2}
I20260709 13:09:52.746018 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:52.768487 27260 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:52.701591 27414 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:52.686270 27233 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.509s (SENT)
I20260709 13:09:52.747269 27265 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:52.759095 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 103186us
W20260709 13:09:52.771485 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85302.9us
I20260709 13:09:52.771538 27410 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:52.772244 27410 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:52.772848 27264 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:52.773350 27264 pending_rounds.cc:85] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 3
I20260709 13:09:52.651609 30202 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:52.774868 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 260735us
I20260709 13:09:52.773734 27410 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.773761 27264 pending_rounds.cc:107] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:09:52.720786 30179 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.002s
I20260709 13:09:52.777572 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.726063 30314 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:52.735697 30121 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:52.787937 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.802954 27416 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:09:52.785179 27264 raft_consensus.cc:2889] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:52.803622 27410 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:52.796801 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:52.802739 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:52.796602 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 340767us
I20260709 13:09:52.757947 30391 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:52.805332 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:52.595929 30203 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.805852 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:52.778599 30376 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
I20260709 13:09:52.808192 27343 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:52.817817 27233 leader_election.cc:336] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.709s (SENT)
I20260709 13:09:52.764731 30182 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.710199 30174 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.622972 30348 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.754894 30377 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.775283 30381 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.734668 30177 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.765480 30395 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.724748 30393 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.825573 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:52.858541 30083 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:53.388705 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 563223us
I20260709 13:09:53.389212 30205 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:53.389077 30083 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.389642 30205 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:53.391335 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:53.422749 27265 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.644s	user 0.018s	sys 0.000s
I20260709 13:09:53.423352 27265 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
W20260709 13:09:53.392014 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 586731us
I20260709 13:09:52.896781 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:53.219511 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 376) took 2156 ms. Trace:
I20260709 13:09:52.825914 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.428285 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.269626 27410 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:09:53.431737 27410 pending_rounds.cc:85] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 2
W20260709 13:09:53.427767 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.432256 27410 pending_rounds.cc:107] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:09:53.432603 27410 raft_consensus.cc:2889] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:53.431684 27411 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:53.301483 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.433636 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 835823us
I20260709 13:09:52.822150 27341 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:53.391683 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:53.425755 27340 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:52.911402 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 115611us
I20260709 13:09:53.390532 30205 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:53.352424 30218 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.058s	user 0.008s	sys 0.005s
I20260709 13:09:53.431219 27409 rpcz_store.cc:276] 0709 13:09:51.063112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:51.063377 (+   265us) service_pool.cc:224] Handling call
0709 13:09:51.080756 (+ 17379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:51.081016 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:52.602029 (+1521013us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b18000047e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd866293c7 00007fbd82c3b9a7 00007fbd82c4b0bf
0709 13:09:52.602225 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 13:09:53.218953 (+616728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:53.219042 (+    89us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:53.219113 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:53.219239 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.219431 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":225941,"prepare.queue_time_us":677160,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":226885,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":18209,"spinlock_wait_cycles":35089664,"thread_start_us":1057509,"threads_started":2}
I20260709 13:09:53.426931 30127 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:52.797719 30135 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:53.452220 27416 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:53.452872 30373 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.453408 30373 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.794256 30202 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.446916 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:52.948976 30383 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:52.799386 30329 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.426411 30121 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:53.046602 30178 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.436583 30378 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:52.921778 30408 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.780071 30360 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:52.799722 30179 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:52.950461 30214 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:52.871883 30387 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.437716 30376 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:53.475641 30383 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:53.473793 30083 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.480764 30173 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.517226 30376 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.505887 30182 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.505169 30416 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.485415 30121 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.818652 30314 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.076594 30203 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:53.532143 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 44960.2us
I20260709 13:09:53.535068 30381 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.536579 30182 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.464260 30135 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:53.539486 30411 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 13:09:53.523701 30387 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.541953 30377 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:53.542649 30330 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.341s	user 0.010s	sys 0.000s
I20260709 13:09:53.543871 30348 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:53.546058 30202 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.495947 30178 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.548781 30179 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.551426 30174 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.551926 30173 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.531823 30407 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:09:53.554109 30413 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:09:53.554764 30353 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.864s	user 0.011s	sys 0.027s
I20260709 13:09:53.489069 30329 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.468582 30218 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.486543 30421 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:53.573134 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 128308us
I20260709 13:09:53.527879 30383 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:53.568703 30083 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.609457 30135 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.611697 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1373) took 1249 ms. Trace:
W20260709 13:09:53.614058 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 796232us
I20260709 13:09:53.601432 30376 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.559752 30205 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.573282 30121 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:53.611972 30182 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:53.656154 30359 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.849s	user 0.016s	sys 0.038s
I20260709 13:09:53.657894 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:53.657903 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.658433 30178 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.717239 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:53.664597 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151013us
W20260709 13:09:53.664110 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.723372 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.670487 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.002s	sys 0.010s
I20260709 13:09:53.660531 30373 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.617179 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:53.704226 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.705125 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.691443 27413 rpcz_store.cc:276] 0709 13:09:52.362878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.363143 (+   265us) service_pool.cc:224] Handling call
0709 13:09:52.363529 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.442140 (+ 78611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:52.449482 (+  7342us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.529569 (+ 80087us) log.cc:844] Serialized 26 byte log entry
0709 13:09:52.774109 (+244540us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:52.774170 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:52.774266 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:53.611459 (+837193us) raft_consensus.cc:1685] finished
0709 13:09:53.611481 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:53.611632 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41205,"raft.queue_time_us":90762,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":56002,"thread_start_us":179017,"threads_started":1,"wal-append.queue_time_us":497468}
I20260709 13:09:53.712546 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.503082 30378 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:53.724308 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.101s	user 0.003s	sys 0.011s
I20260709 13:09:53.649412 30330 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.725140 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:53.726514 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.725939 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:53.734462 27409 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.739892 28009 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:53.618422 30416 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.748631 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.748047 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:53.734568 30368 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.002s
I20260709 13:09:53.751554 27263 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:53.755275 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.755578 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.756220 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:53.756876 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:53.757534 30418 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:53.732270 30419 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:53.758167 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:53.758771 30431 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.758693 30419 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.759596 30431 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.760831 30368 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.761379 30368 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.763083 30431 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:53.765240 27408 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:53.746995 30373 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:53.767625 30373 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:53.768064 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.768796 30378 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:53.768581 30373 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.769323 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:53.701839 30083 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.758306 30178 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:53.761742 30387 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.758843 27417 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:53.771368 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:53.792702 27409 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:53.691880 30421 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:53.817934 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46629.3us
I20260709 13:09:53.753656 30395 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:53.818933 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 111198us
W20260709 13:09:53.823765 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.824369 27233 leader_election.cc:336] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.768s (SENT)
I20260709 13:09:53.824790 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:53.834841 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 110757us
I20260709 13:09:53.823431 30371 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.842558 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:53.795845 30178 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.830590 30174 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:53.822515 30221 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:09:53.861876 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.921547 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:53.921275 27340 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:53.932544 27414 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.932832 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 398) took 1113 ms. Trace:
W20260709 13:09:53.910523 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 128360us
I20260709 13:09:53.933632 27340 rpcz_store.cc:276] 0709 13:09:52.819846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.840539 (+ 20693us) service_pool.cc:224] Handling call
0709 13:09:53.932770 (+1092231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:53.830088 30210 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:09:53.824101 30430 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:53.830250 30135 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:09:53.835474 30395 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:53.919253 30391 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.003s
W20260709 13:09:53.943553 30437 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:09:53.947279 27380 consensus_peers.cc:597] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a30a45f010dd49e5a9ddb107297fa03e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.947732 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 106826us
I20260709 13:09:53.948132 27412 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:53.841037 30433 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:53.911932 30348 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:53.966213 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:53.966966 27264 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:53.971330 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.939771 30430 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:53.972862 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 130391us
W20260709 13:09:53.976691 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:53.977198 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.857049 30368 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:53.847781 30314 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:53.832967 30179 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:09:53.941885 30218 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.985474 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:53.911382 30360 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:53.963053 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:53.988957 27265 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:53.992503 27264 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
W20260709 13:09:53.994485 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:53.994750 27414 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:54.002172 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.997278 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:53.987115 30387 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:53.942071 30427 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:09:53.938443 30174 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.994848 30203 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:53.983613 30430 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:53.937695 30371 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:53.955614 30391 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:53.995188 30214 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:54.005945 30376 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.023561 27265 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:09:53.984215 30348 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.025723 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:54.012264 30360 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:54.028923 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:54.016558 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:54.013813 30387 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:54.027187 30351 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 2.331s	user 0.010s	sys 0.016s
I20260709 13:09:54.031067 27412 raft_consensus.cc:2410] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:09:54.034256 30443 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:09:54.034690 30371 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.021682 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:53.984465 30433 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:54.035837 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.134341 30391 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.136216 30384 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:54.136966 30384 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.139659 30416 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:54.117023 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 273262us
I20260709 13:09:54.017072 30383 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.135591 30178 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.098376 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:54.143494 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:09:54.154397 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125550us
I20260709 13:09:54.021447 30034 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 13:09:54.156417 30374 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:54.157419 30374 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:54.158479 30374 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.124301 30203 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:54.026072 30083 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.147363 30387 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:54.175423 30203 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.030952 30214 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:54.300227 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.574769 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.579545 30416 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.204806 30384 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.185228 30034 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.176769 30433 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.581118 30034 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.583976 30034 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.190097 30394 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:54.204695 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 43900.3us
I20260709 13:09:54.591970 30394 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:54.177763 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.594872 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.225657 30436 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.512858 30197 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:54.225405 30343 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:54.596105 30343 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:54.595949 30436 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.597757 30343 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:54.559036 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.580226 30416 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.599139 30343 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:54.600903 30416 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.183832 27306 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:54.574860 30214 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:54.192535 30449 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:09:54.595999 30197 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.603245 30394 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.193152 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:54.611874 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.613912 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.614796 27414 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:54.190054 30121 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.224401 27417 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:09:54.163929 30371 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:54.166520 30360 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:53.792258 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:54.612525 27978 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.623s (SENT) [suppressed 14 similar messages]
W20260709 13:09:54.628624 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 444828us
I20260709 13:09:54.635143 27412 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:54.637178 30457 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:09:54.638310 30430 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 13:09:54.638904 30430 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.640252 30383 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:54.641778 30430 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:54.613041 30458 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.642958 30458 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:54.644773 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.645583 30458 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:54.646245 30378 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:54.651480 30214 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:54.651842 30174 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.669119 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:54.669539 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:54.670245 27338 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:54.683984 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.684939 27417 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:54.663515 30403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.022s	sys 0.039s
W20260709 13:09:54.692054 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:54.698195 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1288) took 2135 ms (client timeout 1849 ms). Trace:
I20260709 13:09:54.698294 27414 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:09:54.698940 27263 rpcz_store.cc:269] 0709 13:09:52.536453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.540220 (+  3767us) service_pool.cc:224] Handling call
0709 13:09:54.671259 (+2131039us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003147d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:54.671440 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2668705152}
I20260709 13:09:54.663621 30394 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:54.653931 30384 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.700444 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.708864 27414 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:54.688470 30122 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:54.694795 30403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.022s	sys 0.039s
I20260709 13:09:54.719897 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.743831 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.759058 30433 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:54.760604 30433 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.761664 30197 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:54.763295 30330 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.746505 30416 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:54.764016 30330 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:54.764142 30416 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.764605 30330 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.770095 27417 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:54.766913 30330 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.775393 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.713414 30384 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.778981 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.767071 30416 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:54.784595 27233 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.993s (SENT)
W20260709 13:09:54.786039 27233 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 2.027s (SENT)
I20260709 13:09:54.756731 30122 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:54.789662 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:54.724763 30360 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.782610 30197 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:54.784263 30179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.029s	sys 0.038s
I20260709 13:09:54.810217 27417 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:54.787767 30330 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:54.791558 30416 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:54.789988 30182 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:54.815374 30179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.029s	sys 0.038s
W20260709 13:09:54.889290 30205 consensus_meta.cc:287] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.179s	user 0.013s	sys 0.001s
I20260709 13:09:54.821264 30197 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.921307 30197 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:54.884496 30121 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:54.892266 30122 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.936391 27408 raft_consensus.cc:2410] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:09:54.920796 30459 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:09:54.904790 30433 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:54.954527 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:54.883601 30182 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:54.894487 30330 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:54.887418 30416 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:54.959192 30463 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:09:54.959666 30464 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:09:54.944705 30383 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:54.969707 30466 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:09:54.965572 30433 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:54.998565 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 386073us
W20260709 13:09:54.999507 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 310197us
I20260709 13:09:55.033016 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:55.014853 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.035386 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.038704 30387 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.818s	user 0.012s	sys 0.000s
I20260709 13:09:55.037413 30361 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:54.992615 30383 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.041882 30472 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.035006 30433 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:55.060120 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.050951 30384 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:55.067058 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.074148 30465 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
W20260709 13:09:55.075954 30468 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:09:55.077448 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1281) took 2919 ms. Trace:
I20260709 13:09:55.077824 27266 rpcz_store.cc:276] 0709 13:09:52.157689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:52.157849 (+   160us) service_pool.cc:224] Handling call
0709 13:09:52.158192 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:52.164647 (+  6455us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:09:52.164679 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:52.191672 (+ 26993us) log.cc:844] Serialized 26 byte log entry
0709 13:09:54.608610 (+2416938us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b18003296e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:09:54.788339 (+179729us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:09:54.788385 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:54.788460 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:55.077117 (+288657us) raft_consensus.cc:1685] finished
0709 13:09:55.077136 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.077369 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77523,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":11568,"spinlock_wait_cycles":19913088,"thread_start_us":179553,"threads_started":1,"wal-append.queue_time_us":2637538}
I20260709 13:09:55.096761 30348 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:55.097373 30348 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:55.097862 30348 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.097412 30219 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:55.099984 30219 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:55.100311 30219 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:55.101253 30219 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:55.102708 30219 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:55.103538 30330 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:55.105732 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.105535 30416 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:55.106467 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.108222 30348 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:55.115334 30203 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:55.060118 30361 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:55.117017 30135 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:55.117646 30135 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:55.117190 30361 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:55.120201 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 395) took 1413 ms. Trace:
I20260709 13:09:55.120570 27415 rpcz_store.cc:276] 0709 13:09:53.706454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.706572 (+   118us) service_pool.cc:224] Handling call
0709 13:09:55.119536 (+1412964us) spinlock_profiling.cc:243] Waited 894 us on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:09:55.119693 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.119863 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:55.119886 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:55.119941 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:55.119976 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.120032 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:55.120147 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089600}
I20260709 13:09:55.122004 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:55.122540 30135 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:55.115985 30203 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:55.058516 30472 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.125011 30203 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:55.125980 30472 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:55.132124 27265 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:55.132565 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.132928 30419 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:55.132192 27266 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:55.118748 30384 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:55.133965 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:55.134093 30384 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:55.133659 27266 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:55.057600 30379 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:55.135700 30379 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.136160 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:55.134579 27264 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:55.136727 27260 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:55.137959 30379 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:55.070048 30474 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.140138 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:55.140551 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1396) took 1389 ms. Trace:
I20260709 13:09:55.140710 27268 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.140908 27408 rpcz_store.cc:276] 0709 13:09:53.751253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.769086 (+ 17833us) service_pool.cc:224] Handling call
0709 13:09:55.140336 (+1371250us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540013c4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:55.140475 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675799936}
I20260709 13:09:55.142180 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:55.142779 30343 consensus_meta.cc:287] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.005s
I20260709 13:09:55.143702 27411 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:09:55.143982 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.144199 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.144587 27262 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:55.144948 27263 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:55.145450 30433 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:55.145900 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.146714 27265 raft_consensus.cc:2410] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:55.048341 30387 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.147580 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:55.147833 30465 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:09:55.148260 27261 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
W20260709 13:09:55.139639 30462 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.368s	user 0.003s	sys 0.000s
I20260709 13:09:55.149614 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:55.155078 30173 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:55.156032 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:55.147818 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.135866 27266 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.158059 27266 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:55.159066 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.164831 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:55.175268 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.178834 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.186691 27264 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:55.197933 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.201438 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.202214 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.203053 27265 raft_consensus.cc:2410] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:55.205996 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.205017 28009 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:55.154580 30210 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.208145 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.147624 30474 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:55.214848 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:55.219777 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:55.334192 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:55.712533 27337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.002s	sys 0.034s
W20260709 13:09:56.014772 27337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.012s	sys 0.049s
W20260709 13:09:55.382038 30475 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:09:55.234786 27268 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:56.017280 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1398) took 2001 ms. Trace:
I20260709 13:09:56.017812 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.019094 27267 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:56.017746 27414 rpcz_store.cc:276] 0709 13:09:54.015623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.792664 (+777041us) service_pool.cc:224] Handling call
0709 13:09:54.793123 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:54.793572 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.793597 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:54.798265 (+  4668us) log.cc:844] Serialized 26 byte log entry
0709 13:09:55.053141 (+254876us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:55.053197 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.053280 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.017041 (+963761us) raft_consensus.cc:1685] finished
0709 13:09:56.017070 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.017214 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":6552,"thread_start_us":168530,"threads_started":1,"wal-append.queue_time_us":410918}
I20260709 13:09:55.631819 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.020673 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:55.523123 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.022068 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:55.752840 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.001s	sys 0.016s
W20260709 13:09:55.979839 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.006s
W20260709 13:09:55.769429 30394 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.056s	user 0.012s	sys 0.001s
W20260709 13:09:55.411453 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.523941 30384 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:56.024971 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.563408 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.025681 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.419593 30473 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 13:09:56.028548 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.029800 27380 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.008s
W20260709 13:09:56.030225 27380 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.004s	sys 0.008s
W20260709 13:09:56.030323 27260 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.004s
W20260709 13:09:56.030531 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 569581us
I20260709 13:09:56.030814 27260 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:09:56.015331 30481 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:55.219133 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.032511 27263 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
W20260709 13:09:55.692091 27417 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.013s	sys 0.005s
W20260709 13:09:56.034245 27417 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.015s	sys 0.010s
W20260709 13:09:55.524500 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.036444 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.023762 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.006s
W20260709 13:09:56.011006 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:55.152132 30421 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:55.257694 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.049923 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.036360 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.022985 27414 raft_consensus.cc:2368] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:56.051690 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.030860 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.215395 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.052361 27415 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 5: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:56.053045 27408 raft_consensus.cc:2410] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:56.054008 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.014542 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.055514 27262 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:56.054980 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:56.042006 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.005s	sys 0.019s
I20260709 13:09:55.185860 30173 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:55.258044 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:55.185118 30433 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:56.047708 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:55.776724 30360 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.003s	sys 0.032s
I20260709 13:09:56.060706 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.057073 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1824) took 1017 ms. Trace:
I20260709 13:09:56.069278 27415 rpcz_store.cc:276] 0709 13:09:55.040067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.207792 (+167725us) service_pool.cc:224] Handling call
0709 13:09:56.057008 (+849216us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:56.059737 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 963181us
I20260709 13:09:56.065707 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.060570 27259 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:55.258922 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.071455 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.076254 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.076516 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.077657 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:55.520084 30378 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:56.081018 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.013708 30210 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.084746 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.087208 27415 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.088593 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:56.091100 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.068743 30360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.005s	sys 0.035s
I20260709 13:09:56.099078 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.125303 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.088223 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.129787 27261 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:56.094517 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.132467 27262 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:56.133978 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:56.087752 27309 connection.cc:256] RPC call timeout handler was delayed by -1.7782604130001118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:09:56.138242 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:56.139119 27309 connection.cc:256] RPC call timeout handler was delayed by -1.4507739729999685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:09:56.139719 27262 raft_consensus.cc:2410] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:56.140173 27309 connection.cc:256] RPC call timeout handler was delayed by -1.4363739730000589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:09:56.140633 27309 connection.cc:256] RPC call timeout handler was delayed by -1.3778739729999643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:09:56.141048 27309 connection.cc:256] RPC call timeout handler was delayed by -1.2959739730000592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:09:56.141448 27309 connection.cc:256] RPC call timeout handler was delayed by -1.1156024210000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:09:56.141793 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0795296979999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:09:56.142194 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0240157360001376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:09:56.144090 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.148794 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:56.149677 27259 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.150301 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.151656 27408 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:09:56.145066 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:56.153721 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1408) took 1024 ms. Trace:
I20260709 13:09:56.154253 27408 rpcz_store.cc:276] 0709 13:09:55.128821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.133354 (+1004533us) service_pool.cc:224] Handling call
0709 13:09:56.153640 (+ 20286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.155784 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.159767 27338 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:56.160024 27261 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:56.160506 28010 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:56.166386 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.158576 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:56.168879 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.169533 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.171064 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.171902 27408 raft_consensus.cc:2410] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:09:56.166250 27261 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:56.167842 27262 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:56.055523 30481 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.178553 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.138103 30387 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:56.070081 30173 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:56.185043 30498 raft_consensus.cc:670] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:09:56.121266 30421 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:09:56.188217 30329 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:56.187945 27261 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.186061 30455 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.189554 27340 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:56.192293 30474 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:56.121693 30378 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.238214 30378 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:56.074524 30433 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.179255 27408 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7. Re-sending same reply.
W20260709 13:09:56.210456 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.239763 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:56.240758 30433 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:56.241086 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.242441 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.243222 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1820) took 1309 ms. Trace:
I20260709 13:09:56.244050 27408 rpcz_store.cc:276] 0709 13:09:54.934389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.242188 (+1307799us) service_pool.cc:224] Handling call
0709 13:09:56.243145 (+   957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.244927 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.245115 30498 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:56.245994 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.247061 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.247838 30221 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:56.248066 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.248355 30221 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:56.247923 30455 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.248879 27408 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:56.249223 30221 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.249718 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.250458 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1406) took 1122 ms. Trace:
I20260709 13:09:56.250602 27413 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:56.250774 27408 rpcz_store.cc:276] 0709 13:09:55.128312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.249510 (+1121198us) service_pool.cc:224] Handling call
0709 13:09:56.250401 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.251650 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.252280 27408 raft_consensus.cc:2368] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:56.212325 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.186061 30142 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:56.176380 30373 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:56.231827 30210 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:56.204941 30219 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.102s	user 0.015s	sys 0.001s
I20260709 13:09:56.255342 27264 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.253015 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:56.290683 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 251753us
I20260709 13:09:56.270751 27415 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:56.291579 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1411) took 1161 ms. Trace:
W20260709 13:09:56.292129 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.292016 27415 rpcz_store.cc:276] 0709 13:09:55.129661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.070082 (+940421us) service_pool.cc:224] Handling call
0709 13:09:56.291524 (+221442us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:56.292780 27233 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.587s (SENT)
I20260709 13:09:56.292999 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.273000 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1400) took 2244 ms. Trace:
I20260709 13:09:56.207991 30384 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.288553 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.290949 27261 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.294219 27413 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:56.293937 27417 rpcz_store.cc:276] 0709 13:09:54.028971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.811195 (+782224us) service_pool.cc:224] Handling call
0709 13:09:54.811595 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:54.878754 (+ 67159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:54.878800 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:54.883478 (+  4678us) log.cc:844] Serialized 52 byte log entry
0709 13:09:55.055504 (+172026us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:56.034749 (+979245us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.272265 (+237516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.272451 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.272543 (+    92us) raft_consensus.cc:1685] finished
0709 13:09:56.272584 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.272912 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42519,"prepare.queue_time_us":660710,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":222825,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":4159,"thread_start_us":1365763,"threads_started":3,"wal-append.queue_time_us":233070}
I20260709 13:09:56.295285 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.296092 27413 raft_consensus.cc:2410] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:56.252985 30455 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:56.296612 30384 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.297960 27338 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:56.299263 30384 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:56.300879 27265 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:56.315254 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.316380 27408 raft_consensus.cc:2368] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:56.317484 28015 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:56.320992 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:56.322280 27233 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 2.010s (SENT)
W20260709 13:09:56.287906 30480 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:09:56.324330 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.326224 27414 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:56.326860 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1822) took 1350 ms. Trace:
I20260709 13:09:56.327406 27408 rpcz_store.cc:276] 0709 13:09:54.976199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.314865 (+1338666us) service_pool.cc:224] Handling call
0709 13:09:56.326782 (+ 11917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.328603 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.329522 27408 raft_consensus.cc:2368] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
W20260709 13:09:56.330969 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 238267us
I20260709 13:09:56.332170 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.334808 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.335651 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.335824 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.344532 27414 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:56.336846 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.345324 27408 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
W20260709 13:09:56.339214 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 1.11949e+06us
I20260709 13:09:56.340124 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.346882 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:56.347666 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125491us
I20260709 13:09:56.350418 27339 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:56.349133 27341 pending_rounds.cc:85] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 2
I20260709 13:09:56.354354 27341 pending_rounds.cc:107] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:09:56.342926 27233 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.354700 27341 raft_consensus.cc:2889] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:56.355546 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.290412 30142 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.362125 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:56.362534 27415 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:09:56.363536 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1817) took 1547 ms. Trace:
I20260709 13:09:56.365064 27415 rpcz_store.cc:276] 0709 13:09:54.816299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.352021 (+1535722us) service_pool.cc:224] Handling call
0709 13:09:56.362187 (+ 10166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:56.363150 (+   963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.363464 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.364439 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.362929 27336 raft_consensus.cc:2376] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8. Re-sending same reply.
I20260709 13:09:56.368492 27408 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:56.368643 27417 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.369599 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1810) took 1702 ms. Trace:
I20260709 13:09:56.370029 27417 rpcz_store.cc:276] 0709 13:09:54.667416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.351527 (+1684111us) service_pool.cc:224] Handling call
0709 13:09:56.368412 (+ 16885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.369212 (+   800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.369501 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.374684 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1816) took 1576 ms. Trace:
W20260709 13:09:56.375557 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 243799us
I20260709 13:09:56.376173 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 404) took 1674 ms. Trace:
I20260709 13:09:56.375278 27408 rpcz_store.cc:276] 0709 13:09:54.798766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.352907 (+1554141us) service_pool.cc:224] Handling call
0709 13:09:56.365468 (+ 12561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.374389 (+  8921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.374614 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.376758 27233 leader_election.cc:400] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:09:56.377426 27233 leader_election.cc:403] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:56.382730 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.383702 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1295) took 1240 ms. Trace:
I20260709 13:09:56.384083 27266 rpcz_store.cc:276] 0709 13:09:55.130770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.131792 (+  1022us) service_pool.cc:224] Handling call
0709 13:09:55.132076 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:55.652128 (+520052us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:09:56.059032 (+406904us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.370598 (+311566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.370644 (+    46us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:56.370692 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.370825 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.370925 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":484973,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":12576,"raft.queue_time_us":99957,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":151,"thread_start_us":678222,"threads_started":2}
I20260709 13:09:56.387135 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.387627 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.388950 27266 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:09:56.389341 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:56.390777 30491 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:56.391390 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.390138 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.394053 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.394179 27408 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:09:56.394059 27417 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.360790 30329 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:56.376637 27337 rpcz_store.cc:276] 0709 13:09:54.702215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.702396 (+   181us) service_pool.cc:224] Handling call
0709 13:09:54.709522 (+  7126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.709728 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:54.938294 (+228566us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.141356 (+1203062us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.375804 (+234448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.375888 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:56.375961 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.376027 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.376123 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110458,"prepare.queue_time_us":347745,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":90,"raft.queue_time_us":257557,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":6094,"thread_start_us":1594272,"threads_started":4,"wal-append.queue_time_us":1252536}
I20260709 13:09:56.392617 27410 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:56.360404 30373 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:56.366997 30433 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.403230 27410 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:56.401046 27334 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:56.401384 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1821) took 1442 ms. Trace:
W20260709 13:09:56.403705 27231 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.000s (SENT)
I20260709 13:09:56.406582 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1827) took 1285 ms. Trace:
I20260709 13:09:56.406605 27417 rpcz_store.cc:276] 0709 13:09:54.958826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.371008 (+1412182us) service_pool.cc:224] Handling call
0709 13:09:56.393891 (+ 22883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.395437 (+  1546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.401321 (+  5884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.407706 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:56.408522 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:56.367190 30496 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:56.410669 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.401597 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.410547 27410 rpcz_store.cc:276] 0709 13:09:55.121337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.402779 (+1281442us) service_pool.cc:224] Handling call
0709 13:09:56.403044 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.406359 (+  3315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.406531 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.406873 30407 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:56.418606 27268 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:56.420100 27268 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:56.391305 30497 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:56.405642 30474 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.402113 30329 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.434999 27233 leader_election.cc:400] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:56.412935 27336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:56.413209 30407 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.400019 30504 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
W20260709 13:09:56.440804 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.470458 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.423237 30433 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.448276 30173 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:56.451445 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.460839 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:56.462543 27336 raft_consensus.cc:606] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:56.481622 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:56.481730 27336 raft_consensus.cc:614] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:56.462193 27233 leader_election.cc:403] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:56.439896 30329 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:56.438186 30474 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:09:56.508728 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74158.4us
I20260709 13:09:56.414436 30373 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:56.553057 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.568512 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.512929 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:56.583267 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.510077 30494 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:56.604125 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 91270.6us
W20260709 13:09:56.606155 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.486887 30378 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:56.658726 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.473598 30455 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:09:56.424628 30496 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.511384 30173 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:56.672518 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.659562 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.524586 30474 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:56.709086 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.733248 27336 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:56.709895 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.726821 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 323106us
W20260709 13:09:56.733791 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.473263 30495 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.190s
I20260709 13:09:56.555023 30511 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:56.739315 27231 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.491s (SENT)
W20260709 13:09:56.742031 27259 consensus_meta.cc:287] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260709 13:09:56.741714 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:56.742938 27259 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:56.438675 30497 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:56.748991 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.749979 27336 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:56.751056 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.735456 30504 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.737294 30173 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:09:56.756213 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.755535 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96081.8us
W20260709 13:09:56.778465 27411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1812) took 2041 ms (client timeout 1993 ms). Trace:
I20260709 13:09:56.746440 30368 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:09:56.782599 30407 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:56.822134 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:56.792451 27411 rpcz_store.cc:269] 0709 13:09:54.715760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.775101 (+ 59341us) service_pool.cc:224] Handling call
0709 13:09:56.752895 (+1977794us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b540036ae54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:56.756627 (+  3732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844701568}
I20260709 13:09:56.837893 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:56.741696 30506 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:56.742223 30515 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.841776 27417 raft_consensus.cc:2410] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:09:56.836114 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1402) took 1708 ms. Trace:
I20260709 13:09:56.838099 27259 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:56.848258 27408 rpcz_store.cc:276] 0709 13:09:55.127236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.404203 (+1276967us) service_pool.cc:224] Handling call
0709 13:09:56.416151 (+ 11948us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:56.429487 (+ 13336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.429531 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:56.436899 (+  7368us) log.cc:844] Serialized 52 byte log entry
0709 13:09:56.477253 (+ 40354us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:09:56.477295 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.480819 (+  3524us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:56.835780 (+354961us) raft_consensus.cc:1685] finished
0709 13:09:56.835808 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.836027 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12920,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":6367,"thread_start_us":39868,"threads_started":1,"wal-append.queue_time_us":234593}
W20260709 13:09:56.849666 27412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1397) took 2834 ms (client timeout 3269 ms). Trace:
W20260709 13:09:56.850263 27412 rpcz_store.cc:269] 0709 13:09:54.015366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:54.171897 (+156531us) service_pool.cc:224] Handling call
0709 13:09:56.849464 (+2677567us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54003859d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:56.849582 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54653184}
I20260709 13:09:56.838727 27336 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:56.851284 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1410) took 1721 ms. Trace:
W20260709 13:09:56.852238 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.852421 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1405) took 1724 ms. Trace:
I20260709 13:09:56.849846 27414 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:56.849004 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.851938 27408 rpcz_store.cc:276] 0709 13:09:55.129388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.850344 (+1720956us) service_pool.cc:224] Handling call
0709 13:09:56.850699 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.850908 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.850935 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.850987 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:56.851025 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.851081 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.851227 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:56.844038 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 325083us
I20260709 13:09:56.852875 27411 rpcz_store.cc:276] 0709 13:09:55.127999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.851568 (+1723569us) service_pool.cc:224] Handling call
0709 13:09:56.851889 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.852069 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.852098 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.852153 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:56.852205 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.852269 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.852368 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.757552 30481 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:56.859377 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.836642 30173 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:56.862515 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 410) took 1388 ms. Trace:
W20260709 13:09:56.861721 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 122434us
I20260709 13:09:56.861094 27336 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:09:56.898774 27233 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.894508 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 409) took 1420 ms. Trace:
W20260709 13:09:56.870505 27261 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.004s
W20260709 13:09:56.856138 30502 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 13:09:56.900935 27261 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:09:56.902240 27411 rpcz_store.cc:276] 0709 13:09:55.474205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.854695 (+1380490us) service_pool.cc:224] Handling call
0709 13:09:56.861988 (+  7293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.862174 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.862212 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.862256 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:56.862297 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.862351 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.862460 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.854169 30515 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:56.862665 30509 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 13:09:56.862430 30505 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
W20260709 13:09:56.909813 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55358.3us
I20260709 13:09:56.910161 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1819) took 2007 ms. Trace:
I20260709 13:09:56.901971 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:56.900784 30452 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:09:56.913785 30519 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:56.926731 30519 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:56.913847 30481 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:56.927615 30481 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:56.928077 30481 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:56.900130 27408 rpcz_store.cc:276] 0709 13:09:55.473833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.854252 (+1380419us) service_pool.cc:224] Handling call
0709 13:09:56.893738 (+ 39486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.894008 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.894046 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.894107 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:56.894166 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.894245 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.894423 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.911394 27261 pending_rounds.cc:85] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:09:56.912128 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:56.913314 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:56.933964 27261 pending_rounds.cc:107] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:56.857378 30518 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:56.917445 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:56.945500 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:56.913275 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 435328us
I20260709 13:09:56.916600 27415 rpcz_store.cc:276] 0709 13:09:54.903106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.366210 (+1463104us) service_pool.cc:224] Handling call
0709 13:09:56.376263 (+ 10053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.376467 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:56.411957 (+ 35490us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.909884 (+497927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.909925 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:56.909964 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.910018 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.910103 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40898,"prepare.queue_time_us":27753,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":43178,"thread_start_us":433840,"threads_started":1}
W20260709 13:09:56.951098 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.920569 27411 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:56.951996 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:56.952529 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1841) took 1418 ms. Trace:
I20260709 13:09:56.952922 27411 rpcz_store.cc:276] 0709 13:09:55.533904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.914920 (+1381016us) service_pool.cc:224] Handling call
0709 13:09:56.915247 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.952284 (+ 37037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.952477 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:56.913244 30515 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.923317 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:56.860176 30511 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:56.858587 30495 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:56.929519 30519 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:56.949030 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:56.969062 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.856581 30506 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:56.910512 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1403) took 1783 ms. Trace:
I20260709 13:09:56.954177 27267 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:56.934333 27261 raft_consensus.cc:2889] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:56.962460 27408 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:56.949059 30518 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:56.914906 30368 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:09:56.963406 30384 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:09:56.981137 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:56.981130 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 69070.3us
I20260709 13:09:56.976842 27410 rpcz_store.cc:276] 0709 13:09:55.127483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.414086 (+1286603us) service_pool.cc:224] Handling call
0709 13:09:56.414665 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.414941 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:56.440584 (+ 25643us) log.cc:844] Serialized 14 byte log entry
0709 13:09:56.909517 (+468933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.909575 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:56.910260 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.910334 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:56.910456 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70849,"prepare.queue_time_us":25727,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":64544,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1655,"thread_start_us":404030,"threads_started":1,"wal-append.queue_time_us":404346}
I20260709 13:09:56.966611 30495 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:56.999264 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:56.975538 30455 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:57.018424 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:56.980408 30433 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:57.020409 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 121731us
I20260709 13:09:56.978708 30503 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:56.985198 30518 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.021595 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.020539 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:09:57.030957 30516 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:09:57.033728 30500 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:09:57.034543 30527 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:09:57.036517 30512 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:09:57.038944 27340 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:57.011987 30525 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:57.039608 30525 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:57.017333 30373 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:09:57.047742 30513 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:09:57.050365 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:57.018661 30490 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.051880 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.051812 30490 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.053309 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.054803 27263 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:57.013101 30455 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:57.015547 30368 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.055740 30433 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:57.055099 30490 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:57.057463 27263 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:57.079659 27263 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: [4.3-9.5]
I20260709 13:09:57.059855 30455 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.063557 30368 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:57.083536 30368 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.007980 30384 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:57.035068 30527 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:57.068457 30497 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.070261 30506 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:57.163359 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 136402us
W20260709 13:09:57.137394 30329 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.000s
I20260709 13:09:57.166740 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.072397 30496 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.137391 30384 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:57.169890 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 460108us
W20260709 13:09:57.170917 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 219016us
I20260709 13:09:57.074046 30511 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:09:57.071223 30515 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.167840 30534 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:57.188781 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.189574 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.190415 27411 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:09:57.191638 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.193845 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.194563 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.189167 30173 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.197010 30455 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.193565 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.199234 27259 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.199398 30455 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:57.193495 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.201610 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.209046 30515 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.210711 27259 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:57.173830 30329 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.211550 30496 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.213009 27264 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.213380 30370 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.215710 30329 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:57.220959 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.221506 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.221488 30519 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.071789 30495 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:57.223264 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.224709 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 404) took 1124 ms. Trace:
I20260709 13:09:57.226119 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 427) took 2009 ms. Trace:
I20260709 13:09:57.239969 27260 rpcz_store.cc:276] 0709 13:09:56.100609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.100789 (+   180us) service_pool.cc:224] Handling call
0709 13:09:56.101150 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.257535 (+156385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.257564 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.257606 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:56.257634 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.224468 (+966834us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540031f1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:57.224510 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.224644 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359220480}
I20260709 13:09:57.241441 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.242089 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:57.192302 30507 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.210774 30481 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.250512 30481 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.234709 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.251751 27267 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.252318 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:57.252591 30541 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.253162 30506 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.253295 30541 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:57.253841 30541 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:57.241988 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.242720 27260 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.255774 27411 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:57.255894 30474 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:09:57.256352 30474 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.258030 30383 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:57.258430 30474 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.234129 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.260180 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:57.240073 28010 rpcz_store.cc:276] 0709 13:09:55.216304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.216501 (+   197us) service_pool.cc:224] Handling call
0709 13:09:55.225524 (+  9023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.167175 (+941651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.225850 (+1058675us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540050fd54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:57.226042 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141476224}
I20260709 13:09:57.243317 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.261411 27410 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.246898 30407 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.193857 30534 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.192148 30527 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.259060 27264 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.264762 27260 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:57.258270 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:57.246347 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43587.3us
I20260709 13:09:57.269908 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.273092 27260 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:57.287549 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.251791 30458 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:57.239885 30504 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:57.293604 27260 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:09:57.262213 30495 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.295773 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.296008 27260 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:57.297446 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.305757 27410 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:57.268697 30383 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.314888 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.321637 30548 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.276424 30407 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.279505 30455 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.323455 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:57.326185 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.322877 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.254699 30541 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.341696 27340 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:57.346132 27266 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:57.229838 30525 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.340224 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:09:57.294662 30458 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:57.317570 30527 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.322446 30506 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:57.355754 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 97550.4us
I20260709 13:09:57.368021 27410 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:57.324389 30383 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:57.371606 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111506us
I20260709 13:09:57.371867 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2121) took 1160 ms. Trace:
I20260709 13:09:57.372494 27338 rpcz_store.cc:276] 0709 13:09:56.211836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.212012 (+   176us) service_pool.cc:224] Handling call
0709 13:09:57.371603 (+1159591us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540021d754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.371769 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102002048}
I20260709 13:09:57.377826 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.369482 30496 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.366086 30506 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:57.376339 30393 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.315430 30518 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.353369 30455 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:57.391278 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.385015 30525 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.391424 27415 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.397517 30507 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.400164 30383 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:57.391850 30458 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:57.400646 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 409) took 1036 ms. Trace:
I20260709 13:09:57.411540 27259 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:57.365166 30368 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.388089 30496 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.390216 30506 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.411832 27342 rpcz_store.cc:276] 0709 13:09:56.364061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.373430 (+  9369us) service_pool.cc:224] Handling call
0709 13:09:56.388834 (+ 15404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.745534 (+356700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.745566 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:56.745608 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:56.745645 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.400415 (+654770us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540014b9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:57.400473 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.400593 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819813248}
I20260709 13:09:57.406632 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.413946 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:09:57.415071 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.433641 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.474360 27260 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:09:57.460889 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83504.4us
I20260709 13:09:57.439607 27416 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:09:57.475083 30382 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.475585 30382 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.480297 30407 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:57.481141 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.481835 27260 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:09:57.483788 30547 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:09:57.486804 27411 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:57.493394 30534 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.494326 30549 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:57.496933 30557 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:57.497675 30557 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:09:57.500617 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 94098.9us
I20260709 13:09:57.500998 27413 raft_consensus.cc:1217] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:09:57.501840 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.500962 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 402) took 3703 ms. Trace:
I20260709 13:09:57.505527 27413 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:09:57.506675 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.482620 30384 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:57.508569 28015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 401) took 2275 ms (client timeout 1710 ms). Trace:
I20260709 13:09:57.502705 27409 rpcz_store.cc:276] 0709 13:09:53.797630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.983532 (+185902us) service_pool.cc:224] Handling call
0709 13:09:53.996250 (+ 12718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:54.035891 (+ 39641us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:54.126035 (+ 90144us) log.cc:844] Serialized 14 byte log entry
0709 13:09:54.242468 (+116433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:54.242544 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:54.242616 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:55.139105 (+896489us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:57.500658 (+2361553us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b5400317c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:57.500736 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.500908 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1996,"prepare.queue_time_us":89891,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":58776,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9101,"spinlock_wait_cycles":93137920,"thread_start_us":115839,"threads_started":1,"wal-append.queue_time_us":590390,"wal-append.run_cpu_time_us":4419,"wal-append.run_wall_time_us":1434234}
I20260709 13:09:57.472313 30496 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.507834 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:57.510911 28015 rpcz_store.cc:269] 0709 13:09:55.197416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:55.197594 (+   178us) service_pool.cc:224] Handling call
0709 13:09:57.472733 (+2275139us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54002e45d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.472902 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572534528}
I20260709 13:09:57.515584 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.522310 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:57.529733 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 54284.5us
I20260709 13:09:57.506605 30458 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.531319 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2117) took 1381 ms. Trace:
I20260709 13:09:57.533206 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.534631 27260 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:57.514770 30519 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.518169 30549 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:57.533653 27335 rpcz_store.cc:276] 0709 13:09:56.149781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.149909 (+   128us) service_pool.cc:224] Handling call
0709 13:09:56.176164 (+ 26255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.176529 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.176566 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.181092 (+  4526us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.393080 (+1211988us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18003de820. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1
0709 13:09:57.393228 (+   148us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:57.393519 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.517255 (+123736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.517404 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.517441 (+    37us) raft_consensus.cc:1685] finished
0709 13:09:57.530984 (+ 13543us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.531249 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":571,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":205613,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":18553,"spinlock_wait_cycles":5915520,"thread_start_us":263819,"threads_started":2,"wal-append.queue_time_us":310388}
I20260709 13:09:57.536921 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.523904 30548 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.540098 30455 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:57.498947 30557 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.543253 30518 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.541231 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.533223 30555 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:09:57.566227 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:57.567058 27260 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.568409 30559 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.568702 30384 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.575199 30368 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:57.578761 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.560570 30556 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:57.584074 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.565207 30558 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.586719 30558 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:57.587118 30558 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.588341 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.589269 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.589918 28015 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:09:57.592978 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.569428 30559 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.569445 30384 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:57.602146 27260 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:57.603585 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.604398 27260 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:09:57.607815 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66673.2us
I20260709 13:09:57.613806 30506 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.615370 30548 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.611687 27309 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.618196 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.594765 30559 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:57.618875 30554 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:57.620795 30436 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.647827 30504 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.616722 30384 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:57.649544 30384 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.616011 30506 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.626277 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.626927 30507 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.655572 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.656392 27411 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:57.657258 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.635149 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2116) took 1189 ms. Trace:
I20260709 13:09:57.659192 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.658353 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.660485 27411 raft_consensus.cc:2410] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:57.637579 30142 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:57.639840 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 408932us
I20260709 13:09:57.618242 30556 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.642753 27408 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:57.643550 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 402216us
I20260709 13:09:57.669127 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:57.624967 30496 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.673388 30496 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.659413 27263 rpcz_store.cc:276] 0709 13:09:56.445770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.088140 (+642370us) service_pool.cc:224] Handling call
0709 13:09:57.088504 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.088755 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:57.139336 (+ 50581us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.191532 (+ 52196us) log.cc:844] Serialized 14 byte log entry
0709 13:09:57.634469 (+442937us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b18001312c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:09:57.634620 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.634671 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:57.634720 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.634786 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.635077 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":442663,"prepare.queue_time_us":52087,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":445341,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":2744,"spinlock_wait_cycles":5180416,"thread_start_us":51437,"threads_started":1,"wal-append.queue_time_us":176950}
I20260709 13:09:57.659313 28006 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:57.677770 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.679492 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.682046 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:57.682425 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56262.7us
I20260709 13:09:57.683369 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:57.685706 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.687399 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:57.643456 30559 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.688093 27335 raft_consensus.cc:606] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:57.689085 27233 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:57.700929 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:57.682127 30329 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.701910 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.676967 30030 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.703377 27335 raft_consensus.cc:614] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:57.707265 30515 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:57.707558 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:57.708412 27335 raft_consensus.cc:606] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:57.631155 30558 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.708847 27335 raft_consensus.cc:614] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:57.687639 30142 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:57.711908 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.689512 30556 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.689028 30474 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:57.718124 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.725633 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 417) took 1321 ms. Trace:
I20260709 13:09:57.723079 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.724406 30481 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:57.747007 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:57.733366 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.745800 30555 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:57.714107 30515 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:57.711491 30373 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.726876 27417 rpcz_store.cc:276] 0709 13:09:56.404690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.408224 (+  3534us) service_pool.cc:224] Handling call
0709 13:09:57.725407 (+1317183us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54000be0d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.725572 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986896128}
I20260709 13:09:57.720898 30142 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:57.726897 30519 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:57.731428 30549 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:57.712543 30030 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.766299 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:57.726922 30562 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.721534 30556 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:57.757856 30384 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:57.768368 30142 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.805702 30384 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:57.806268 30384 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:57.807283 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.807976 30521 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.890s	user 0.004s	sys 0.004s
I20260709 13:09:57.808234 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 411) took 1339 ms. Trace:
I20260709 13:09:57.808674 27265 rpcz_store.cc:276] 0709 13:09:56.468804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.223141 (+754337us) service_pool.cc:224] Handling call
0709 13:09:57.223560 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.639464 (+415904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.639496 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:57.648060 (+  8564us) log.cc:844] Serialized 26 byte log entry
0709 13:09:57.723505 (+ 75445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:57.723563 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.723671 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.807864 (+ 84193us) raft_consensus.cc:1685] finished
0709 13:09:57.807888 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.808172 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415762,"raft.queue_time_us":415879,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":22967,"thread_start_us":74998,"threads_started":1,"wal-append.queue_time_us":101684}
I20260709 13:09:57.810535 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 409) took 1345 ms. Trace:
I20260709 13:09:57.810958 27259 rpcz_store.cc:276] 0709 13:09:56.465229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.211701 (+746472us) service_pool.cc:224] Handling call
0709 13:09:57.212008 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.412017 (+200009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.810280 (+398263us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54001d97d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:57.810475 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458469120}
I20260709 13:09:57.812440 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:57.813994 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2113) took 1369 ms. Trace:
I20260709 13:09:57.814270 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.814410 27266 rpcz_store.cc:276] 0709 13:09:56.445011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.050048 (+605037us) service_pool.cc:224] Handling call
0709 13:09:57.813782 (+763734us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b540024c7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.813911 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628006656}
W20260709 13:09:57.771636 30565 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:09:57.771710 30515 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.770807 27335 raft_consensus.cc:606] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:57.774549 27342 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 8. Ops: []
I20260709 13:09:57.822499 27335 raft_consensus.cc:614] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:57.775830 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.776894 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.776875 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.823423 27341 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.778422 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.778769 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.779323 30519 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:57.782079 30558 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:57.784155 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 537) took 3797 ms (client timeout 1791 ms). Trace:
I20260709 13:09:57.786098 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.792322 30221 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.793624 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1818) took 2907 ms. Trace:
I20260709 13:09:57.825455 27415 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:57.825506 27413 rpcz_store.cc:276] 0709 13:09:54.886575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.352367 (+1465792us) service_pool.cc:224] Handling call
0709 13:09:57.500884 (+1148517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:57.508203 (+  7319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.793369 (+285166us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400317c50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.793547 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640339328}
I20260709 13:09:57.799098 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.827937 30481 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:57.828976 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.801373 30562 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:09:57.799319 27309 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52486 dropped due to backpressure: service queue is full with 50 items
I20260709 13:09:57.800065 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:57.782135 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1815) took 2993 ms. Trace:
I20260709 13:09:57.831499 27414 rpcz_store.cc:276] 0709 13:09:54.788841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.352020 (+1563179us) service_pool.cc:224] Handling call
0709 13:09:56.849582 (+497562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.853566 (+  3984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:57.781943 (+928377us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54003859d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.782074 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107893632}
I20260709 13:09:57.820634 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2126) took 1460 ms. Trace:
I20260709 13:09:57.758165 30373 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:57.833038 30373 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:57.832765 27339 rpcz_store.cc:276] 0709 13:09:56.360449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.374304 (+ 13855us) service_pool.cc:224] Handling call
0709 13:09:56.398102 (+ 23798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:56.412486 (+ 14384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:56.412532 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:56.413142 (+   610us) log.cc:844] Serialized 26 byte log entry
0709 13:09:56.683321 (+270179us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:56.683389 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:56.683500 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:57.807420 (+1123920us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:57.816163 (+  8743us) raft_consensus.cc:1685] finished
0709 13:09:57.816184 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:57.820569 (+  4385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13456,"spinlock_wait_cycles":9216768,"thread_start_us":269611,"threads_started":1,"wal-append.queue_time_us":429274}
I20260709 13:09:57.821487 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.835011 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.836431 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.836495 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.837875 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:57.838104 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.840103 30507 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.828295 30519 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.845896 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.846328 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.847759 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.847927 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.849061 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.851395 27338 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:57.852378 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.853018 27338 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:57.853425 27341 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:09:57.816862 30556 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.858569 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.860948 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.861222 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.861909 27338 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:57.861781 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.828557 30481 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:57.863982 28007 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:57.869271 27415 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 5.
I20260709 13:09:57.873107 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.873974 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:57.849511 30562 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:57.877092 30530 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:57.877650 30530 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:57.850730 27309 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52486 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1880)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
I20260709 13:09:57.878579 30530 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:57.829128 28006 rpcz_store.cc:269] 0709 13:09:53.987087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.995835 (+  8748us) service_pool.cc:224] Handling call
0709 13:09:57.783798 (+3787963us) spinlock_profiling.cc:243] Waited 3.51 s on lock 0x7b54000307d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.784054 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8074031360}
I20260709 13:09:57.845968 30421 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:57.881608 30421 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:57.881999 30421 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:09:57.882831 30421 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.884079 30421 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:57.887777 30573 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:09:57.891005 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:57.891969 30494 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:57.892098 30376 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.892491 30494 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:57.893481 30494 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.894572 30494 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:57.897905 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.898586 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.898931 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.894207 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:57.904584 27417 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:57.905671 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:57.906576 28007 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:57.907632 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.908314 27266 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:09:57.910352 27231 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52486 dropped due to backpressure: service queue is full with 50 items
I20260709 13:09:57.914088 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.916086 27414 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:09:57.939155 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.917616 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.945741 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:57.946264 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:57.947022 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.948426 27266 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:57.949569 27415 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:57.951850 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.913538 30456 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.954900 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:57.958118 27416 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1388) took 4256 ms (client timeout 3307 ms). Trace:
W20260709 13:09:57.958693 27416 rpcz_store.cc:269] 0709 13:09:53.693242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.699321 (+  6079us) service_pool.cc:224] Handling call
0709 13:09:57.949726 (+4250405us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b54000adf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:57.949828 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8534138752}
I20260709 13:09:57.961997 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:09:57.962210 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.913424 30558 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:57.964079 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.964744 27266 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:57.971195 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.973067 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:57.973086 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.895754 30384 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.948107 30534 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.976902 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:57.929665 30383 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:57.981853 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.983121 27266 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.983739 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:57.986162 27259 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:09:57.988019 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.988938 27265 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:09:57.989764 27334 raft_consensus.cc:2368] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:09:57.961792 30456 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:57.915288 30556 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:57.917618 30559 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:57.987023 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:57.970404 30122 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:57.968955 30360 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:57.970583 30329 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.970219 30503 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:57.996644 27268 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:57.998796 30384 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:57.996672 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.008103 30562 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.033602 27268 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:57.971246 30550 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:09:57.995486 30456 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:57.971578 30558 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.017798 30556 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:57.944144 30483 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:09:58.022126 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:57.979046 30518 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:57.979277 30504 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:57.981338 30539 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.026062 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.051972 27265 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:58.027379 27262 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:09:58.029484 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 113269us
I20260709 13:09:58.007460 30511 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 2 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:58.037040 27341 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.037611 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.030733 30503 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:58.056432 27262 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:09:58.045173 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.025144 30122 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.019008 30383 consensus_queue.cc:1243] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:58.050997 27342 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.064181 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.070056 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.066376 30122 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.078640 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 410) took 1613 ms. Trace:
I20260709 13:09:58.061129 30382 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.079326 27264 rpcz_store.cc:276] 0709 13:09:56.465560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.214303 (+748743us) service_pool.cc:224] Handling call
0709 13:09:57.214591 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.269227 (+ 54636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.078287 (+809060us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b540034f654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:58.078543 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101840256}
I20260709 13:09:58.080866 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.086509 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.091426 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.096524 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.097535 30558 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:58.108783 27259 pending_rounds.cc:85] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 3
I20260709 13:09:58.109166 27259 pending_rounds.cc:107] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:58.109452 27259 raft_consensus.cc:2889] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.057804 30575 ts_tablet_manager.cc:933] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.031960 30360 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.129801 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:57.976248 27306 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2145)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 418)
I20260709 13:09:58.061364 30503 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.135597 27306 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 16)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 420)
I20260709 13:09:58.141844 27306 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 16)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 420)
I20260709 13:09:58.156544 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.157235 27264 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:58.147042 27306 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 16)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 420)
I20260709 13:09:58.123039 30508 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.165095 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2125) took 1818 ms. Trace:
I20260709 13:09:58.068466 30481 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.167374 27343 rpcz_store.cc:276] 0709 13:09:56.346650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.353912 (+  7262us) service_pool.cc:224] Handling call
0709 13:09:56.382830 (+ 28918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:56.383029 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:56.383585 (+   556us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.040474 (+1656889us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b180003bf20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:09:58.164729 (+124255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.164787 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.164839 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.164919 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.165036 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":421,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5202,"raft.queue_time_us":1844,"spinlock_wait_cycles":5587712,"thread_start_us":123945,"threads_started":1}
I20260709 13:09:58.108703 30373 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.173441 27306 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49416 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1879)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2156)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2141)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1875)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1881)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1866)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1876)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1883)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1856)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1884)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1891)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1872)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2142)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2139)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2140)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2146)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1885)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1892)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 16)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1860)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1870)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2149)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 420)
I20260709 13:09:58.155936 30393 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 13:09:58.179428 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.183507 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.151106 30394 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:09:58.181000 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.188187 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.166615 30501 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.191449 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:58.191625 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46650.4us
W20260709 13:09:58.187336 30571 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:09:58.158864 30577 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:09:58.200657 27417 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:58.202031 27416 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:58.202453 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.205333 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.252789 27414 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.253407 27410 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.251068 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:58.257678 27335 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:58.263926 27268 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.265825 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.266831 27335 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:58.270640 27410 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:58.237190 30562 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.281520 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:58.225184 30559 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:58.283891 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.284538 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.287612 27343 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.232653 30481 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:58.198163 30382 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:58.296084 27268 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:58.295869 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.236356 30122 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.257933 30456 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.301944 30368 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:58.303063 30122 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.310020 27410 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 3. (term mismatch)
I20260709 13:09:58.310187 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.321758 27410 pending_rounds.cc:85] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 2
I20260709 13:09:58.300724 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.290067 30383 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:58.319813 27343 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:58.314992 27416 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:58.322072 27410 pending_rounds.cc:107] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:09:58.315683 30525 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.351526 27410 raft_consensus.cc:2889] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.352022 27410 pending_rounds.cc:107] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:09:58.352320 27410 raft_consensus.cc:2889] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:58.351284 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.353680 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.353885 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:58.354372 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.354456 27343 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
W20260709 13:09:58.351682 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 166549us
I20260709 13:09:58.358456 27414 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:58.359215 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.359339 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.359891 27339 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:58.361651 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.362807 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.369238 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.370380 27343 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:09:58.370714 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46944.6us
I20260709 13:09:58.371402 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:58.374053 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.300536 30460 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:09:58.380718 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.388479 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.390223 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.352133 30501 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.392324 30501 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.404978 30501 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.408102 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.421146 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:58.423229 27335 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:58.391053 27339 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:58.298593 30382 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.424945 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.407226 30030 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.415902 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.299134 30446 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
W20260709 13:09:58.407326 30585 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:09:58.362007 30525 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.434759 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.414175 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:58.423267 28011 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:09:58.386175 30548 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:58.413297 30558 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:58.438158 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.414412 30373 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.434943 27416 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:09:58.443939 27416 pending_rounds.cc:85] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 3
I20260709 13:09:58.444275 27416 pending_rounds.cc:107] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:09:58.444552 27416 raft_consensus.cc:2889] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:58.437021 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 138993us
I20260709 13:09:58.442729 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.442986 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.443089 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:58.407292 30550 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:09:58.446846 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:09:58.448271 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.449317 27339 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.419682 30384 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:09:58.448719 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.451740 30525 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.430621 30562 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:09:58.454947 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.456306 27335 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.453123 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.391557 30503 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.450275 30421 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:58.463003 30582 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:09:58.466522 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:58.466989 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.453747 30460 raft_consensus.cc:2764] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:58.450763 30519 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.445282 30575 tablet_copy_client.cc:323] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:09:58.433156 30541 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:09:58.470970 27408 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:58.453778 30558 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.471939 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:58.473022 30579 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.272s	user 0.004s	sys 0.000s
I20260709 13:09:58.473510 30382 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:58.436376 30182 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.475855 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.476688 27343 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.480681 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:58.481190 30456 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:58.482713 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:58.484153 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.488821 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.475725 30519 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:58.479344 30587 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:58.497836 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.508044 27335 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:58.492422 28011 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:09:58.483532 30558 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:09:58.499344 30383 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.499421 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.490463 30460 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:58.534175 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.507596 30587 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.532366 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.497161 30519 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.537806 30523 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:58.541314 30523 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.542320 30523 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.547796 28007 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:58.529661 30460 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:58.553656 27231 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.544s (SENT)
I20260709 13:09:58.549108 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.555488 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.538225 30383 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.556571 30182 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.557152 30383 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.562674 30360 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.564329 30436 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:58.564821 30436 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.565765 30436 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.568986 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet a30a45f010dd49e5a9ddb107297fa03e from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:09:58.569685 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet a30a45f010dd49e5a9ddb107297fa03e from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-a30a45f010dd49e5a9ddb107297fa03e
I20260709 13:09:58.569797 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.570639 27339 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.570884 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.571520 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.572284 27335 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:09:58.572566 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.571570 27336 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:58.576570 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.576177 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.578573 27339 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:09:58.579923 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.538645 30587 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.593338 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.593988 27261 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:09:58.539448 30456 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.595803 30456 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.596211 30456 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.596644 30173 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.597831 30494 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:58.598237 30494 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:09:58.598938 27231 leader_election.cc:336] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.586s (SENT)
I20260709 13:09:58.599424 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:58.599155 30494 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.600152 30494 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.603533 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.604197 27268 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.606192 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.607539 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.581498 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.608166 27337 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:58.608560 27339 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:58.582084 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.611500 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.612128 27336 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:58.612910 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.613739 27268 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:09:58.571094 30525 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.573515 30460 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.554553 30394 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:58.615540 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.575942 30436 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.620281 27335 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:09:58.627590 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.617540 30173 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:58.632890 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.633495 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.634961 27335 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:09:58.637440 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 100431us
I20260709 13:09:58.633683 27340 raft_consensus.cc:2376] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7. Re-sending same reply.
I20260709 13:09:58.642040 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.647575 27264 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
W20260709 13:09:58.650667 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.667070 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.678478 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.680119 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.693557 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.693785 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.694446 27340 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:58.694479 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:58.696127 30525 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.706669 30481 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:09:58.707536 30481 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.713685 28007 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:58.714224 28007 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:09:58.695796 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 68121.4us
I20260709 13:09:58.697033 27411 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
I20260709 13:09:58.714949 28007 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.718896 28007 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:58.580783 30558 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.720768 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:09:58.721853 27340 raft_consensus.cc:606] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:58.722363 27340 raft_consensus.cc:614] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:58.723191 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.696393 30503 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:58.707389 30525 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:58.744745 27231 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.641s (SENT)
I20260709 13:09:58.745584 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.746637 30539 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.752236 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:58.755237 27340 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.755744 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:09:58.763355 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:09:58.763844 27340 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:58.765058 27340 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:09:58.743149 30495 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:58.751261 30446 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.772568 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:58.763374 30483 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:58.774459 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:09:58.775522 30592 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:09:58.774507 30483 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:58.761377 30030 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:58.763376 30378 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.762109 30481 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:58.776839 30483 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.757131 30200 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:58.797540 27342 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:58.805013 27408 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:58.798323 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:58.806808 30200 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:58.807519 30200 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:09:58.809526 27411 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:58.796090 27413 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:09:58.789309 30576 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.620s	user 0.000s	sys 0.004s
I20260709 13:09:58.777617 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:09:58.820030 30591 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:58.823657 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.826145 27342 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.797683 30030 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.828709 30407 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:58.789108 30456 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.831712 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1901) took 1035 ms. Trace:
I20260709 13:09:58.866334 27341 rpcz_store.cc:276] 0709 13:09:57.796567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.968669 (+172102us) service_pool.cc:224] Handling call
0709 13:09:58.831421 (+862752us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b540021dc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:58.831629 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120833280}
I20260709 13:09:58.832520 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1854) took 1054 ms. Trace:
I20260709 13:09:58.871238 27334 rpcz_store.cc:276] 0709 13:09:57.777974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.778139 (+   165us) service_pool.cc:224] Handling call
0709 13:09:58.832311 (+1054172us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001fbb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:58.832458 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378921344}
I20260709 13:09:58.871709 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:09:58.835297 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.846057 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:58.855918 30602 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:58.878449 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85363.6us
I20260709 13:09:58.867870 30030 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.866067 30200 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:58.881395 30200 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:58.777999 30446 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.883482 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1857) took 1104 ms. Trace:
I20260709 13:09:58.884104 27340 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:09:58.884325 27231 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.786s (SENT)
I20260709 13:09:58.885210 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.883977 27337 rpcz_store.cc:276] 0709 13:09:57.779536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.724617 (+945081us) service_pool.cc:224] Handling call
0709 13:09:58.753449 (+ 28832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.753942 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:58.753987 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.762883 (+  8896us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.869068 (+106185us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.869104 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.869165 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:58.883241 (+ 14076us) raft_consensus.cc:1685] finished
0709 13:09:58.883262 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.883425 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1233,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":3638,"thread_start_us":72368,"threads_started":1,"wal-append.queue_time_us":106383}
I20260709 13:09:58.888017 30511 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:58.889431 27426 tablet_copy_source_session.cc:215] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:58.804273 30378 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:58.893581 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:58.866793 30481 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:58.894166 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 48212.3us
I20260709 13:09:58.898790 27342 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.899375 27334 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:58.867013 30407 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:58.900487 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:58.901077 27339 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:09:58.911410 27231 leader_election.cc:336] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.813s (SENT)
I20260709 13:09:58.912036 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.913075 30494 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.913652 30494 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.916126 30494 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.886787 30173 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:58.919056 30378 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.920161 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.920848 27262 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:58.922178 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:58.923022 30525 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:58.923460 30525 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.904452 30376 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.923857 30525 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:58.925635 30501 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:09:58.923470 30578 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.724s	user 0.018s	sys 0.010s
I20260709 13:09:58.933055 30460 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.914176 30456 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.913587 30407 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:58.940379 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.941331 27268 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:58.877445 30182 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:58.963770 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.963550 30173 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:58.970949 27264 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:58.890481 30587 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:58.970006 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58638.4us
W20260709 13:09:58.978835 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:58.985790 27231 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.851s (SENT)
I20260709 13:09:58.986652 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:58.995882 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:58.996757 27268 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:59.013484 30610 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:09:58.972025 30525 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.014401 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:58.968931 30460 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.015069 27261 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:09:58.963845 30407 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:58.968775 30446 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:58.973726 30614 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:09:59.042865 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 62268.1us
I20260709 13:09:59.048151 27417 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:59.047564 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:59.051136 27231 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.949s (SENT)
I20260709 13:09:59.051641 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:09:59.056933 30604 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:09:59.015856 30539 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.062479 30601 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.039911 30525 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:58.968508 30519 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:09:59.064831 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 160704us
I20260709 13:09:59.062788 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:59.070631 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:59.070847 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.071291 27261 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.050061 30608 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.073426 27268 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:59.075418 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:09:59.061323 30173 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.079030 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.081280 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.082222 27338 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:09:59.064954 30601 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.085402 27264 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:09:59.074057 30602 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:59.090709 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.098632 27261 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:59.088186 30601 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.114267 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:59.090768 30525 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:59.076373 30608 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.149993 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.155109 27337 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
W20260709 13:09:59.151007 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 78144.3us
I20260709 13:09:59.151355 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.157428 27261 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.100711 30602 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.184284 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:09:59.185814 27231 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.993s (SENT)
I20260709 13:09:59.186352 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:09:59.187537 30173 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:59.191046 27334 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:59.197490 27337 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.170727 30525 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:09:59.209728 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.212714 27334 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:59.170985 30602 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.216993 27261 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:59.115604 30030 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:59.183887 30494 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.227499 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:59.235195 27337 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.205533 30587 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:59.246912 30620 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:59.250046 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:59.251058 27342 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.229009 30368 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:59.293763 30525 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:59.300199 30517 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:09:59.311328 30173 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.311906 30173 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:09:59.314244 30616 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:09:59.316056 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:59.316776 27334 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:09:59.319253 30562 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.321888 27337 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:09:59.321782 30562 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:09:59.322758 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.323283 27337 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:09:59.324074 27337 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:59.325073 30562 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:59.325387 27337 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:59.287923 30617 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:09:59.327322 27337 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:59.330374 27337 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.293264 30368 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.339354 30182 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.340921 30368 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.340988 30394 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.341598 30394 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.318938 30173 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:59.343364 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:59.238871 30494 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:09:59.345470 30581 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.049s	user 0.010s	sys 0.006s
I20260709 13:09:59.346174 30494 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.346829 30494 raft_consensus.cc:2764] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:09:59.332715 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:09:59.335320 27337 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:59.347329 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1332) took 1239 ms. Trace:
I20260709 13:09:59.349429 30519 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:59.319597 30608 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.350152 30030 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.340833 27265 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:59.351497 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.369463 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:09:59.353658 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.354305 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.355562 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.371141 27260 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.371198 27263 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:59.368422 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.373345 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:09:59.373986 27268 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:59.367823 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:09:59.375423 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.375799 27267 raft_consensus.cc:2368] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:09:59.362457 27259 rpcz_store.cc:276] 0709 13:09:58.108075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.108226 (+   151us) service_pool.cc:224] Handling call
0709 13:09:58.108604 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:58.110099 (+  1495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:58.110144 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:58.123632 (+ 13488us) log.cc:844] Serialized 26 byte log entry
0709 13:09:58.181777 (+ 58145us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:58.280750 (+ 98973us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.291104 (+ 10354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.291259 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:59.344953 (+1053694us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:09:59.347021 (+  2068us) raft_consensus.cc:1685] finished
0709 13:09:59.347115 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.347264 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":243623,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4051,"raft.queue_time_us":10079,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4821,"spinlock_wait_cycles":3984256,"thread_start_us":156496,"threads_started":2,"wal-append.queue_time_us":139382}
I20260709 13:09:59.377611 27337 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:59.375108 27268 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 3. (index mismatch)
I20260709 13:09:59.386049 27342 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:09:59.387650 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.388427 27262 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:59.392761 27260 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:09:59.394855 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:09:59.395556 27261 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.393743 27263 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:09:59.339919 30182 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.401963 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:09:59.406068 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53567.7us
W20260709 13:09:59.408983 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.413565 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.414223 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.413250 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:59.431473 30587 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:59.431927 30587 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:09:59.432327 30587 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:59.434245 30368 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.434839 30368 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.440435 30368 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.440721 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:59.448378 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:59.450398 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:09:59.456473 27261 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:59.448671 30368 raft_consensus.cc:2764] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:09:59.460048 30608 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:59.468406 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.504294 30622 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.391s	user 0.003s	sys 0.000s
I20260709 13:09:59.571456 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:59.587260 27261 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:59.509196 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1413) took 4379 ms. Trace:
W20260709 13:09:59.586468 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:59.800765 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 350416us
I20260709 13:09:59.803962 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:09:59.555678 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1443) took 1056 ms. Trace:
W20260709 13:09:59.791438 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 193809us
I20260709 13:09:59.503753 30575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a30a45f010dd49e5a9ddb107297fa03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:59.554908 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:09:59.512490 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:59.798141 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:09:59.822146 27408 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:09:59.532204 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1877) took 1745 ms. Trace:
I20260709 13:09:59.816334 30368 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:59.480649 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:09:59.823866 27340 rpcz_store.cc:276] 0709 13:09:57.786490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.765665 (+979175us) service_pool.cc:224] Handling call
0709 13:09:58.883780 (+118115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:58.884738 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.531906 (+647168us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b540024fed0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:59.532117 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271139584}
I20260709 13:09:59.828078 30507 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:59.801565 27412 rpcz_store.cc:276] 0709 13:09:55.130242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.852386 (+1722144us) service_pool.cc:224] Handling call
0709 13:09:57.726043 (+873657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.726262 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:57.765401 (+ 39139us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.628536 (+863135us) log.cc:844] Serialized 14 byte log entry
0709 13:09:58.735418 (+106882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:58.739227 (+  3809us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:58.739289 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.739369 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.508924 (+769555us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b54000be0d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:09:59.509107 (+   183us) inbound_call.cc:177] Queueing success response
0709 13:09:59.601533 (+ 92426us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18001466e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
Metrics: {"mutex_wait_us":891452,"prepare.queue_time_us":1851826,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":2140,"raft.queue_time_us":91932,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":200,"spinlock_wait_cycles":2017952512,"thread_start_us":152335,"threads_started":3,"wal-append.queue_time_us":37150,"wal-append.run_cpu_time_us":3073,"wal-append.run_wall_time_us":1910881}
W20260709 13:09:59.827015 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 272251us
I20260709 13:09:59.795814 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:09:59.840400 27410 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:09:59.807704 27417 rpcz_store.cc:276] 0709 13:09:58.499614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.500221 (+   607us) service_pool.cc:224] Handling call
0709 13:09:58.500578 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.059320 (+558742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.555310 (+495990us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54000acb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:09:59.555599 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258789120}
I20260709 13:09:59.834609 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:09:59.553282 30580 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.330s	user 0.004s	sys 0.000s
I20260709 13:09:59.490302 30587 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:59.873978 30562 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:59.874992 30507 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:59.492630 30602 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.877411 30602 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:09:59.795445 30182 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:59.777400 30394 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:09:59.886474 30394 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:09:59.892187 30587 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:09:59.549353 30601 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.919236 30368 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:59.920063 30601 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:09:59.748174 30530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.559s	user 0.015s	sys 0.014s
W20260709 13:09:59.920974 30530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.016s	sys 0.015s
I20260709 13:09:59.929240 30525 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:09:59.930058 30525 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.932063 30407 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:59.932576 30407 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:09:59.933064 30407 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:59.545070 30495 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:00.022130 30485 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:00.022995 30485 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.026479 30485 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:00.029237 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1863) took 2247 ms (client timeout 1949 ms). Trace:
W20260709 13:10:00.029820 27343 rpcz_store.cc:269] 0709 13:09:57.781569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.429161 (+647592us) service_pool.cc:224] Handling call
0709 13:10:00.028960 (+1599799us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:00.029142 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86639488}
W20260709 13:10:00.057390 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 245454us
W20260709 13:10:00.079360 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 205807us
I20260709 13:10:00.035329 30495 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.080497 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:00.136144 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.142184 30624 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.674s	user 0.003s	sys 0.012s
I20260709 13:10:00.147652 30507 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:00.149598 30407 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.169510 30407 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:00.130496 30562 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:00.219740 30562 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.176347 30507 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:00.223532 30507 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:00.224742 30507 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.226343 30507 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.260200 30495 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.282894 30562 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:00.283854 30562 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:00.285058 30562 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:09:59.553993 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:59.511637 27161 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 8, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.498406 27161 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:00.502489 27161 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:00.507375 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.508423 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.516376 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:00.524358 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.529175 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2161) took 1429 ms. Trace:
I20260709 13:10:00.529327 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.529763 27340 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:10:00.530817 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.534140 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.535506 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.537146 27342 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:00.538761 27343 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:00.540886 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 736840us
I20260709 13:10:00.544209 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1891) took 1469 ms. Trace:
I20260709 13:10:00.570425 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:00.572031 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1446) took 1006 ms. Trace:
I20260709 13:10:00.579838 30485 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:00.581367 30558 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.584033 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:00.587467 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.008s
I20260709 13:10:00.587311 30495 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:00.578306 30618 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:10:00.370689 30575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55754 (request call id 541) took 2527 ms. Trace:
I20260709 13:10:00.592188 30525 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:00.600214 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:00.186998 28015 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:00.614235 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1890) took 1544 ms. Trace:
W20260709 13:10:00.639716 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.008s
W20260709 13:10:00.648681 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.655316 27339 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:00.657100 27334 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:00.655400 27341 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.652565 30200 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:00.642469 30646 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:00.673866 30485 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:00.645160 27409 rpcz_store.cc:276] 0709 13:09:59.069465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.069629 (+   164us) service_pool.cc:224] Handling call
0709 13:09:59.077624 (+  7995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.077798 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.077814 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.592471 (+514657us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b2c0009df68. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:09:59.593083 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.971585 (+378502us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:59.971645 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.971750 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.613490 (+641740us) raft_consensus.cc:1685] finished
0709 13:10:00.613536 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.613977 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10055424,"thread_start_us":377977,"threads_started":1,"wal-append.queue_time_us":975008}
I20260709 13:10:00.632369 27408 rpcz_store.cc:276] 0709 13:09:59.565954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.832190 (+266236us) service_pool.cc:224] Handling call
0709 13:09:59.832675 (+   485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.868768 (+ 36093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.868808 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:59.869412 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.081815 (+212403us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:00.081871 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.081965 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.571370 (+489405us) raft_consensus.cc:1685] finished
0709 13:10:00.571418 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.571774 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22514,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":157575,"thread_start_us":210471,"threads_started":1,"wal-append.queue_time_us":697003}
W20260709 13:10:00.688601 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 608190us
I20260709 13:10:00.686532 30485 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:00.710696 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:00.716113 27414 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:00.630780 27411 rpcz_store.cc:276] 0709 13:09:59.074953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.075143 (+   190us) service_pool.cc:224] Handling call
0709 13:09:59.087788 (+ 12645us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:59.088412 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.088461 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:59.089087 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:09:59.215553 (+126466us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:59.215665 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.215892 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:00.141440 (+925548us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:00.543490 (+402050us) raft_consensus.cc:1685] finished
0709 13:10:00.543543 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.543997 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98,"raft.queue_time_us":1565,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":11072,"spinlock_wait_cycles":29629696,"thread_start_us":125934,"threads_started":1,"wal-append.queue_time_us":316072}
I20260709 13:10:00.722056 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.628645 27338 rpcz_store.cc:276] 0709 13:09:59.099868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.100303 (+   435us) service_pool.cc:224] Handling call
0709 13:09:59.100579 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.100784 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:59.186630 (+ 85846us) log.cc:844] Serialized 14 byte log entry
0709 13:10:00.034196 (+847566us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b1800410860. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a
0709 13:10:00.528215 (+494019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:00.528362 (+   147us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:00.528485 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.528633 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:00.528872 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":780,"prepare.queue_time_us":130118,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":248136,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":60912512,"thread_start_us":627241,"threads_started":3,"wal-append.queue_time_us":202034,"wal-append.run_cpu_time_us":1214,"wal-append.run_wall_time_us":1004804}
I20260709 13:10:00.712716 30525 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.715873 30407 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.733711 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:00.732661 30200 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:00.760723 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.660521 30575 rpcz_store.cc:276] 0709 13:09:57.843674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.844670 (+   996us) service_pool.cc:224] Handling call
0709 13:09:58.150322 (+305652us) ts_tablet_manager.cc:934] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
0709 13:09:59.479643 (+1329321us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:00.160623 (+680980us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:00.160786 (+   163us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:00.369668 (+208882us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:00.370104 (+   436us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:00.370486 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:00.370570 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":27455,"tablet-copy.queue_time_us":140600,"thread_start_us":208596,"threads_started":2}
I20260709 13:10:00.767992 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.768916 27340 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.768596 27161 catalog_manager.cc:5697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:00.768165 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73923.5us
W20260709 13:10:00.770397 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.751093 30649 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.772647 30523 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:00.773132 30649 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.773702 30645 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:00.756148 28015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 421) took 1209 ms (client timeout 1580 ms). Trace:
I20260709 13:10:00.748406 30485 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:00.775446 28015 rpcz_store.cc:269] 0709 13:09:59.480130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.480306 (+   176us) service_pool.cc:224] Handling call
0709 13:10:00.685026 (+1204720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:00.775635 30407 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.776614 30485 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.777697 30394 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:00.778151 30394 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:00.778708 30407 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:00.779206 30495 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:00.779747 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.779891 30200 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:00.780032 30495 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.772661 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.781381 27337 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:00.775456 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.782755 30495 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:00.783998 30575 tablet_copy_client.cc:806] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:00.756295 30626 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:00.790272 30649 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:00.790716 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:00.756433 30483 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.774565 30645 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.743242 30646 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.759527 30525 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.804857 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.806171 27336 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:00.807518 30575 tablet_copy_client.cc:670] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:00.796418 30649 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.825500 30643 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:00.794726 30394 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.816500 30483 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.841084 27342 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:00.842306 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.827561 30525 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:00.822784 30626 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.864243 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:00.865955 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64447.4us
I20260709 13:10:00.837021 30649 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.868088 27336 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:00.877499 27339 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:00.869467 27161 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.868711 30200 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:00.890419 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:00.892556 27161 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.909330 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.915952 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:00.918262 30525 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.918880 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:00.919304 30525 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.920329 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:00.921525 30495 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.921689 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:00.922138 30495 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:00.922964 30382 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:00.923590 30382 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:00.923497 30495 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.924206 30458 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:00.924593 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:00.924935 30382 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.925479 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:00.924867 30458 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:00.922202 30525 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:00.927642 30407 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:00.928594 30407 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:00.927470 30458 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:00.897569 30646 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:00.898856 30200 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:00.949282 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:00.953013 27164 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 232) took 25792 ms (client timeout 15000 ms). Trace:
I20260709 13:10:00.952575 27161 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 4, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:00.970132 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.972149 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:00.975265 27338 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:00.979430 30626 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:00.961403 30523 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:00.975970 30394 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:00.993129 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:00.994344 30507 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.767s	user 0.013s	sys 0.005s
W20260709 13:10:01.000003 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 101679us
I20260709 13:10:00.999718 27161 catalog_manager.cc:5697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.000993 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:01.001816 27161 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:00.974725 30525 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:01.003439 30647 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.169s	user 0.002s	sys 0.001s
I20260709 13:10:01.009022 30645 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:01.011440 30200 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.015434 30483 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:01.015560 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.016742 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:01.017858 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.018589 27339 raft_consensus.cc:2410] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:01.019522 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:01.019706 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.020416 27338 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:01.020641 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.021418 27343 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:00.977173 30407 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.014842 30649 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.021221 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.024221 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.002852 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:01.022213 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.034163 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.037523 27341 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:01.042464 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.043103 27343 raft_consensus.cc:2368] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7.
I20260709 13:10:01.048229 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.051990 27336 raft_consensus.cc:2368] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:10:01.054957 27161 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:01.061775 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59092.4us
I20260709 13:10:01.062595 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:01.071080 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.074146 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 490566us
W20260709 13:10:00.953652 27164 rpcz_store.cc:269] 0709 13:09:35.160740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.184041 (+ 23301us) service_pool.cc:224] Handling call
0709 13:09:35.645766 (+461725us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:00.952639 (+25306873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:46.743886 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:46.872945 (+129059us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:46.872986 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:09:46.873005 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:47.078964 (+205959us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:47.079047 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:47.079073 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:09:47.079876 (+   803us) tablet.cc:701] Row locks acquired
0709 13:09:47.079903 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:09:47.080093 (+   190us) write_op.cc:270] Start()
0709 13:09:47.080231 (+   138us) write_op.cc:276] Timestamp: P: 1783602587080038 usec, L: 0
0709 13:09:47.080259 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:09:47.143321 (+ 63062us) log.cc:844] Serialized 2886 byte log entry
0709 13:09:48.631059 (+1487738us) op_driver.cc:464] REPLICATION: finished
0709 13:09:49.028083 (+397024us) write_op.cc:301] APPLY: starting
0709 13:09:49.032599 (+  4516us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:49.075491 (+ 42892us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:49.105727 (+ 30236us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:49.186489 (+ 80762us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:49.186854 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:09:49.186949 (+    95us) write_op.cc:312] APPLY: finished
0709 13:09:49.187360 (+   411us) log.cc:844] Serialized 59 byte log entry
0709 13:09:49.187610 (+   250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.187770 (+   160us) write_op.cc:454] Released schema lock
0709 13:09:49.187831 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:49.188378 (+   547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.188418 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56276,"reported_tablets":37,"spinlock_wait_cycles":43427584,"child_traces":[["op",{"apply.queue_time_us":281258,"apply.run_cpu_time_us":4889,"apply.run_wall_time_us":189624,"num_ops":7,"prepare.queue_time_us":189554,"prepare.run_cpu_time_us":17291,"prepare.run_wall_time_us":610346,"raft.queue_time_us":356179,"raft.run_cpu_time_us":23985,"raft.run_wall_time_us":213257,"replication_time_us":1501099,"thread_start_us":591461,"threads_started":4,"wal-append.queue_time_us":308236,"wal-append.run_cpu_time_us":44540,"wal-append.run_wall_time_us":2773589}]]}
I20260709 13:10:01.079818 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.079910 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.078603 27161 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:01.088491 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 213915us
W20260709 13:10:01.083725 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 294703us
I20260709 13:10:01.118672 27343 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:01.111830 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.113487 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.087268 30648 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.136914 30656 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:01.137389 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:01.137755 30656 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.139603 27267 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:01.139892 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:01.140745 27266 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.140966 27268 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:10:01.141824 30639 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
W20260709 13:10:01.141960 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 355518us
I20260709 13:10:01.147948 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.149143 27262 raft_consensus.cc:2393] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:01.150988 30654 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.151748 30654 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.153213 27266 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.154450 30654 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.155241 27265 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:01.155195 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 360857us
I20260709 13:10:01.156544 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1445) took 1616 ms. Trace:
I20260709 13:10:01.158434 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.159348 27265 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.161062 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.161996 27265 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:01.163376 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.163946 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.164871 27265 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:01.157068 27415 rpcz_store.cc:276] 0709 13:09:59.540392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:59.576096 (+ 35704us) service_pool.cc:224] Handling call
0709 13:09:59.576628 (+   532us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:59.870206 (+293578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.870235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:00.546044 (+675809us) log.cc:844] Serialized 52 byte log entry
0709 13:10:00.922618 (+376574us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:00.922671 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:00.922820 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:01.156056 (+233236us) raft_consensus.cc:1685] finished
0709 13:10:01.156089 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:01.156305 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":293084,"raft.queue_time_us":351445,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":375905,"threads_started":1,"wal-append.queue_time_us":506809}
I20260709 13:10:01.148098 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:01.172151 27264 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:01.172876 27340 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:01.122905 30407 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.181984 27336 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:10:01.182502 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.187493 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44499.5us
I20260709 13:10:01.181095 27261 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.190846 27337 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:10:01.192718 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44806.3us
I20260709 13:10:01.195979 27340 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:01.197274 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.193503 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:01.199244 27260 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:01.200698 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.201598 27265 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.203146 27266 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:01.203392 30660 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:01.203476 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.204905 27261 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:01.204995 27264 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:01.174693 30648 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.168469 30654 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.213855 27268 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.212003 30645 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:01.227499 27267 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.228637 30645 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:01.229094 30645 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:01.230294 30645 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.231879 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:01.232177 30645 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.232838 30658 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.220063 30562 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:01.234120 30562 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.234544 30562 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:01.237994 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.241093 27161 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 5, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.218158 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.244623 30655 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:01.245301 30655 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.249572 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:01.250893 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.253765 30407 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:01.255478 30659 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.256026 30659 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:01.256543 30558 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.003s
I20260709 13:10:01.257309 30558 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:01.257254 30659 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.259377 30659 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.260488 27411 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:01.259518 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53052.3us
I20260709 13:10:01.267661 27268 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:01.262477 27161 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:01.272183 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50830.7us
I20260709 13:10:01.274370 27161 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:01.280018 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48258.3us
I20260709 13:10:01.282184 27342 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:10:01.277772 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:01.284924 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:01.288355 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:01.291302 27336 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:01.293299 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.267904 30525 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.294706 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:01.299696 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 72674.8us
I20260709 13:10:01.299933 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.295347 27161 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:01.303364 27263 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:01.303653 30661 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:10:01.304913 30661 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:01.280675 30658 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.305356 30661 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:01.307796 30662 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:01.308081 30407 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:01.318660 27409 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:01.305863 30382 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:01.320226 30382 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.322695 30382 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:01.308032 27161 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:01.310256 27414 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:10:01.323554 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.310916 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.311147 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.313411 27335 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:01.325660 30407 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:01.326169 30407 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:01.317778 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 100037us
I20260709 13:10:01.316109 27411 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:01.331562 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47886.7us
I20260709 13:10:01.332286 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1887) took 3541 ms. Trace:
I20260709 13:10:01.332863 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.332710 27335 rpcz_store.cc:276] 0709 13:09:57.790399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.693239 (+902840us) service_pool.cc:224] Handling call
0709 13:10:01.332033 (+2638794us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b540022a454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:01.332200 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5905352960}
I20260709 13:10:01.318194 30662 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.334296 30662 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.335214 30458 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:01.336428 30458 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:01.324151 27161 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 5, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 5 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.336794 30458 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:01.337774 30458 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.337679 27161 catalog_manager.cc:5697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.333704 27263 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:01.340438 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:01.300879 30648 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.287966 30654 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:01.343554 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80556.5us
I20260709 13:10:01.352157 30458 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.352948 30656 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:01.353449 27231 connection.cc:256] RPC call timeout handler was delayed by -1.5646408049999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:10:01.354075 27231 connection.cc:256] RPC call timeout handler was delayed by -1.540340805000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:10:01.356108 27231 connection.cc:256] RPC call timeout handler was delayed by -1.4422408049999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:10:01.352432 27411 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:10:01.356614 27231 connection.cc:256] RPC call timeout handler was delayed by -1.3963408050000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:10:01.356911 27231 connection.cc:256] RPC call timeout handler was delayed by -1.3252408050000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:10:01.357263 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2991408049999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 13:10:01.357582 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2874408049999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:10:01.357888 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2829408049999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:10:01.358217 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2622408050000331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:10:01.358528 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2550408050000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
W20260709 13:10:01.358774 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2424408050000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:10:01.359040 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2251603500000101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:10:01.359328 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1947408050000377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:10:01.359674 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0984408049999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 13:10:01.360005 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0849408049999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:10:01.360230 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0687408049999476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:10:01.360476 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0534408050000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:10:01.360795 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0426408050000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:10:01.327868 30668 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.342389 30655 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:01.376933 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 115318us
I20260709 13:10:01.363909 30656 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:01.356175 30660 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:01.367882 30525 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.389218 30517 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.387760 30656 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:01.390655 30656 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.391122 30525 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:01.393455 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.398484 30525 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.399493 27408 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.400956 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.402499 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.403379 27417 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:01.401144 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.406024 27414 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:01.381506 30407 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.365830 30663 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:10:01.366680 30658 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.403726 30575 tablet_copy_client.cc:538] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.428920 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:01.413934 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:01.404839 30661 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:01.436697 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 81060.2us
W20260709 13:10:01.437238 27231 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.509s (SENT)
I20260709 13:10:01.437811 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.441705 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:01.443027 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 66352.9us
I20260709 13:10:01.445053 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.377506 30495 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:01.447628 30456 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:01.449270 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:01.450115 30664 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:01.450730 27409 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:01.438150 30667 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:01.456835 30558 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.461130 30676 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.461565 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.462803 30674 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:01.463331 30665 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 13:10:01.463431 30483 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:01.463660 30629 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:01.394650 30648 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:01.444005 30663 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:01.384536 30562 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:01.382069 30668 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.401906 30525 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.438967 30485 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:01.490792 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:01.498165 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60955.7us
I20260709 13:10:01.495527 28007 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:01.465392 30643 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:10:01.548820 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 134677us
I20260709 13:10:01.490752 30663 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.555578 30643 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:01.499687 30407 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:01.498605 30646 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.595747 30646 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.597067 30485 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:01.552762 30382 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:01.487385 30649 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:10:01.553099 30639 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:10:01.501039 30483 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:01.626603 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.558936 30663 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:01.640190 27231 leader_election.cc:336] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.536s (SENT)
I20260709 13:10:01.545670 30507 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:01.565858 30643 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:01.570755 30655 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.648110 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:01.646829 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 167685us
I20260709 13:10:01.597687 30485 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:01.603775 30382 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:01.677850 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:01.555914 30674 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:01.685807 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 127807us
I20260709 13:10:01.693631 30682 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:10:01.695598 30689 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.696441 30689 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.699232 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.563833 30676 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.678720 30382 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.654100 30649 consensus_queue.cc:1243] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:01.707259 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.678418 30662 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.731231 30662 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.731606 30676 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.732491 30689 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.683085 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.733924 30683 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:01.699311 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.734519 30683 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:01.735697 30683 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.737938 30483 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.747659 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:01.748297 30679 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:01.748908 30679 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:01.747743 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 148500us
W20260709 13:10:01.767015 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 209902us
W20260709 13:10:01.794618 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 74833.9us
I20260709 13:10:01.719059 30655 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.798666 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:01.799860 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.797638 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.734393 30495 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.766532 30676 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:01.800004 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.580s (SENT) [suppressed 61 similar messages]
W20260709 13:10:01.807247 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 115262us
W20260709 13:10:01.809878 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.734371 30680 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:10:01.767812 30646 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:01.812034 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:01.750170 30643 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.803604 30658 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:01.816897 30659 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:10:01.825095 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.818130 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:01.815647 30562 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:01.829008 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 121913us
I20260709 13:10:01.828449 30697 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:01.832551 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 102057us
I20260709 13:10:01.832818 30697 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:01.833869 30697 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.836632 30696 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.840059 28007 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.841600 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.841823 30643 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:01.805760 30485 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.850970 30697 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.851246 30525 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:01.851922 30485 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.854797 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:01.861807 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.805671 30655 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.827176 30626 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:01.830977 30517 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.875953 27264 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:01.874444 30702 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 13:10:01.859946 30458 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:10:01.825246 30495 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.824795 30686 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.883550 30686 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:01.884496 30495 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:01.878345 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.886297 30686 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:01.851926 30668 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:01.897380 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 77965.6us
I20260709 13:10:01.898329 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:01.899477 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:01.876359 30649 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:01.907375 28010 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:01.875998 30674 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:01.901975 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 105133us
I20260709 13:10:01.909515 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:01.910676 27409 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:01.889811 30525 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:01.915599 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.922199 30517 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:10:01.924549 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.920177 30525 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.927491 30525 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.929195 30456 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:01.929867 30456 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:01.911432 30649 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.879724 30663 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.911852 30680 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.915263 30562 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:01.951550 30705 consensus_queue.cc:1175] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 13:10:01.952592 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:01.953092 30703 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.953739 30679 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:01.985368 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 185369us
W20260709 13:10:01.992038 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 113786us
I20260709 13:10:01.955850 30649 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:01.993637 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:01.994920 28011 raft_consensus.cc:2368] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
I20260709 13:10:02.021123 30707 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.022030 30707 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:01.984675 30562 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:02.034117 30715 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.990105 30702 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:02.039075 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:02.040179 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 228214us
W20260709 13:10:02.043186 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 143623us
W20260709 13:10:02.043835 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126796us
I20260709 13:10:02.045462 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:02.035468 30575 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
W20260709 13:10:02.069625 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 76101.5us
I20260709 13:10:01.988965 30680 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.054011 30679 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:02.091274 30706 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:02.056494 30643 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:02.087391 30711 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.039206 30562 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.111584 30711 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.114144 30711 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.095206 30495 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.114990 30495 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.117369 30495 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.102559 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:02.104262 27383 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:02.106343 30680 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:02.137205 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:02.138989 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:02.143047 27231 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.696s (SENT)
I20260709 13:10:02.144254 28015 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:02.142853 30695 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.146543 30695 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.146744 30680 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.146987 30695 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.147734 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:02.148579 30659 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.149084 30659 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.151538 30680 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.151960 27383 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:02.157219 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 86354.6us
I20260709 13:10:02.100009 30679 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.165831 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:02.170818 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78314.9us
I20260709 13:10:02.035616 30703 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.152021 30680 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.177281 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:02.176878 30558 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.184058 30648 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.184965 30648 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:02.185276 30648 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:02.163812 30679 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.163681 30650 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.141448 30495 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:10:02.215338 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.179876 30711 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.168197 30523 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:10:02.224104 27338 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:02.224622 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:02.226552 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 129637us
W20260709 13:10:02.227046 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.223827 30523 consensus_queue.cc:1243] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:02.230363 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.233939 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.238128 27266 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:02.236955 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:02.239955 30718 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:02.239832 30678 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:10:02.240343 30523 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.240196 30382 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.240679 30718 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:02.240866 30678 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:02.241348 30678 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:02.240983 30523 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.233476 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.245656 30456 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:02.241732 30714 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:10:02.221894 30711 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:02.288932 30711 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.291424 30718 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.297108 30726 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:02.261904 30707 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.253684 30456 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.245918 30382 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:02.265350 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:02.265952 27231 leader_election.cc:336] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.775s (SENT)
I20260709 13:10:02.308185 27265 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:02.309158 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.267094 30523 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.239854 30692 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:02.310918 30692 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.269431 30698 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:02.311474 30692 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.310266 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.317477 27265 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:02.317848 30695 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:02.320681 27265 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:02.271572 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.275573 27260 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:02.324441 27263 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:02.284816 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:02.285554 30655 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:02.227260 30659 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:02.435811 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:02.233564 30696 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.236838 30648 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.236881 30495 consensus_queue.cc:1243] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:02.266819 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71677.7us
I20260709 13:10:02.277632 30703 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:02.440196 30695 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:02.440558 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:02.496991 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.446441 27259 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:02.845553 30710 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:02.441524 30654 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:02.846058 30710 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:10:02.446089 30407 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.006s
W20260709 13:10:02.549309 30690 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.863s	user 0.004s	sys 0.000s
I20260709 13:10:02.848299 30710 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:02.849397 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:02.850150 30710 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.850795 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:02.851765 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 585871us
W20260709 13:10:02.852195 27342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.053s
I20260709 13:10:02.446763 30558 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.853240 30648 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:02.496308 27264 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:10:02.871269 27342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.008s	sys 0.053s
W20260709 13:10:02.445067 30525 consensus_meta.cc:287] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
W20260709 13:10:02.880723 30717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.009s	sys 0.016s
I20260709 13:10:02.891469 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 553) took 1096 ms. Trace:
I20260709 13:10:02.545086 30643 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:02.671411 30698 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:02.886698 30697 consensus_meta.cc:287] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
I20260709 13:10:02.713714 30659 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:02.917459 28011 rpcz_store.cc:276] 0709 13:10:01.795450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.799579 (+  4129us) service_pool.cc:224] Handling call
0709 13:10:02.891254 (+1091675us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540065fed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:02.891411 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440688896}
W20260709 13:10:02.947743 27231 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.804s (SENT)
W20260709 13:10:02.893774 30562 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.001s
I20260709 13:10:02.948504 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:02.887786 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:02.956830 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:02.887002 30655 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.887878 30683 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:02.917303 30717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.017s
I20260709 13:10:02.506377 30680 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.960439 27409 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:02.886885 30558 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:02.938982 30710 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:02.938657 30715 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.991145 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:02.947340 30695 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:02.889541 30525 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.021275 27415 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:03.026288 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:03.025118 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.510s (SENT)
W20260709 13:10:03.029918 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 179250us
I20260709 13:10:03.030885 27338 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:02.990741 28008 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:02.964922 30562 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.020179 30703 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:03.041145 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:02.981835 30655 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:02.968881 30698 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.043833 27415 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:02.990419 30683 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.002722 30659 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.044569 30718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.017s	sys 0.035s
I20260709 13:10:03.027872 30715 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.028898 30695 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.058290 30562 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.056136 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:03.056986 30718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.018s	sys 0.035s
I20260709 13:10:03.054484 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.059909 27409 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:03.061847 27413 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:03.062891 30655 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.063462 30655 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:03.063782 30698 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:03.064107 30679 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.000s
I20260709 13:10:03.064622 30679 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.065533 30683 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.058975 30695 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.066129 30680 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.066645 30679 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.067592 30558 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:03.064981 30692 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.753s	user 0.004s	sys 0.006s
I20260709 13:10:03.068470 27414 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:03.075745 27414 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:03.077464 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.079716 27413 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:03.068145 30525 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.078743 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.052670 30703 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.085834 27264 pending_rounds.cc:85] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:10:03.085762 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.086200 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.086549 27412 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:03.086759 27259 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.086946 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.086277 27264 pending_rounds.cc:107] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:03.117865 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.119117 27263 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.080399 27414 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.119531 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.120436 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.076081 30692 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.118701 27264 raft_consensus.cc:2889] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:03.125332 27414 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.120347 27265 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:10:03.101161 30649 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.000s
W20260709 13:10:03.118808 28006 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.004s
I20260709 13:10:03.100838 30562 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:10:03.143337 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 96239.6us
I20260709 13:10:03.141659 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:03.155354 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 109016us
I20260709 13:10:03.122943 30695 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:03.142678 30734 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:10:03.167893 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.169075 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:03.169390 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 178548us
I20260709 13:10:03.171931 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.201395 27265 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.201918 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.207521 27380 leader_election.cc:400] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
I20260709 13:10:03.207973 27380 leader_election.cc:403] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:03.213011 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.217670 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.127892 30680 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:03.229202 27409 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:03.149716 28006 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:03.207038 30698 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:03.207333 30718 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:03.206184 30618 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.212877 30697 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:03.147799 30649 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:03.242117 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 348902us
I20260709 13:10:03.169747 30683 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:03.234215 30407 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:10:03.255101 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 173611us
W20260709 13:10:03.261031 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56157.1us
I20260709 13:10:03.271324 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:03.272078 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.241307 30698 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.274245 27409 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:03.276703 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:03.274459 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:03.274660 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:03.276806 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.281466 30679 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:03.281929 30679 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.282271 30679 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:03.282917 30732 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:10:03.284214 27231 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.817s (SENT)
I20260709 13:10:03.284683 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.275255 30495 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:03.256086 30735 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:10:03.275974 30718 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:03.284718 30659 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.277554 28011 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:10:03.274991 30740 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:03.288113 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 451) took 1120 ms. Trace:
I20260709 13:10:03.248711 30697 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:03.287250 30698 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.268620 30562 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:03.304334 27342 rpcz_store.cc:276] 0709 13:10:02.167458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.167612 (+   154us) service_pool.cc:224] Handling call
0709 13:10:02.183672 (+ 16060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.220468 (+ 36796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.220497 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.247679 (+ 27182us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.885287 (+637608us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:02.885334 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.885405 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.287891 (+402486us) raft_consensus.cc:1685] finished
0709 13:10:03.287909 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.288053 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59340,"raft.queue_time_us":49323,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":11183,"thread_start_us":637224,"threads_started":1,"wal-append.queue_time_us":824199}
I20260709 13:10:03.297170 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:03.298774 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69552.2us
I20260709 13:10:03.255208 30618 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:03.336743 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 133174us
I20260709 13:10:03.297616 30695 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.338327 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2184) took 1110 ms. Trace:
I20260709 13:10:03.298390 30718 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:03.308763 30697 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.304610 30739 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:03.359256 30739 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:03.359704 30739 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.360064 30739 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:03.298467 30507 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:10:03.358278 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 74123.5us
W20260709 13:10:03.340524 30731 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:10:03.338865 30715 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.360587 27259 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:03.358467 30683 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.349927 30718 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.347422 27262 rpcz_store.cc:276] 0709 13:10:02.223089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.223215 (+   126us) service_pool.cc:224] Handling call
0709 13:10:02.237066 (+ 13851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.264600 (+ 27534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.264648 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.495927 (+231279us) log.cc:844] Serialized 26 byte log entry
0709 13:10:02.954734 (+458807us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:02.954794 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.954894 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.097768 (+142874us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:03.326912 (+229144us) raft_consensus.cc:1685] finished
0709 13:10:03.326932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.333489 (+  6557us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11281,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":58418,"spinlock_wait_cycles":43726080,"thread_start_us":383875,"threads_started":1,"wal-append.queue_time_us":503853}
I20260709 13:10:03.369412 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 423) took 1797 ms. Trace:
I20260709 13:10:03.372490 28015 rpcz_store.cc:276] 0709 13:10:01.569056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.569262 (+   206us) service_pool.cc:224] Handling call
0709 13:10:02.088188 (+518926us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5800164798. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:02.119400 (+ 31212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:02.153834 (+ 34434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.365589 (+1211755us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b54007f0dd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:03.365819 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154076928}
I20260709 13:10:03.356647 30663 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.351120 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.377570 27409 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:03.375145 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.378530 27261 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.361253 30695 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.380195 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:03.380338 27231 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.822s (SENT)
I20260709 13:10:03.380934 27259 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:03.381192 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.391635 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.395344 30758 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:03.396626 30562 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.397334 30562 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.400072 30562 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.378001 30710 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:03.401880 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.401945 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:03.406335 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.407686 27409 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:03.408674 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 550) took 1662 ms (client timeout 1987 ms). Trace:
W20260709 13:10:03.409224 28006 rpcz_store.cc:269] 0709 13:10:01.746038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.768673 (+ 22635us) service_pool.cc:224] Handling call
0709 13:10:03.408493 (+1639820us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540060ead4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:03.408607 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994460416}
I20260709 13:10:03.410041 30749 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:03.413708 30648 consensus_meta.cc:287] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.002s
I20260709 13:10:03.418083 30721 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:03.418556 30721 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:03.420282 30750 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:03.421113 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2179) took 1199 ms. Trace:
I20260709 13:10:03.421312 30660 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:03.421519 27267 rpcz_store.cc:276] 0709 13:10:02.221721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.221843 (+   122us) service_pool.cc:224] Handling call
0709 13:10:02.237853 (+ 16010us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:02.245334 (+  7481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.245365 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:02.245998 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 13:10:02.581753 (+335755us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:02.581815 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:02.581931 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:03.420902 (+838971us) raft_consensus.cc:1685] finished
0709 13:10:03.420920 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.421055 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":706,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":335219,"threads_started":1,"wal-append.queue_time_us":806907}
I20260709 13:10:03.423816 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.425132 30703 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.425256 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.426028 27262 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.426826 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.427199 27414 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:03.427592 27414 pending_rounds.cc:85] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 8
I20260709 13:10:03.427814 27414 pending_rounds.cc:107] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:03.428066 27414 raft_consensus.cc:2889] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:03.428411 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 79004us
I20260709 13:10:03.430160 27265 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:03.435438 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.430651 27260 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:03.431849 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59708us
W20260709 13:10:03.443653 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 153319us
I20260709 13:10:03.444634 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.444281 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.380920 30683 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.404755 30710 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:03.444468 30749 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:03.448884 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.447396 27259 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:03.462294 27414 raft_consensus.cc:1217] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-10.6]   Dedup: 6.4->[8.5-10.6]
I20260709 13:10:03.462919 27414 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: [4.3-10.6]
I20260709 13:10:03.463140 27265 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:03.469705 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.465948 30649 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.458058 30763 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:03.473507 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.472693 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:03.469795 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.547490 27263 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:03.538688 27259 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:03.549096 27414 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:03.550360 28015 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.455040 27342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
W20260709 13:10:03.553781 27231 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.853s (SENT)
I20260709 13:10:03.461350 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:03.468817 30759 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:03.472769 30644 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.574409 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125597us
I20260709 13:10:03.559372 30762 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:03.590296 30762 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:03.593230 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56303.5us
I20260709 13:10:03.590682 30749 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.573813 30649 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:03.587323 30711 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.298s	user 0.016s	sys 0.000s
I20260709 13:10:03.575048 30759 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:03.647565 30759 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:03.647315 30711 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.580183 30758 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:03.463245 30721 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.642241 27231 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.858s (SENT)
I20260709 13:10:03.573900 30663 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:10:03.590337 30644 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.569918 30710 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.649138 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:03.638388 30732 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:03.656364 27261 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:03.571997 30698 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.641191 30755 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.073s	user 0.000s	sys 0.009s
I20260709 13:10:03.714571 27342 raft_consensus.cc:606] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:03.681710 30618 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.686205 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:03.641865 30679 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.659718 27231 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.867s (SENT)
I20260709 13:10:03.682535 30721 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.685856 30718 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.687225 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 243000us
W20260709 13:10:03.740109 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.741478 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.655247 30758 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.705237 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:03.744920 27261 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:03.715080 27342 raft_consensus.cc:614] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:03.718674 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:03.746392 27337 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:03.642009 30407 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
W20260709 13:10:03.723664 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 255132us
I20260709 13:10:03.735781 27409 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 10. Ops: []
I20260709 13:10:03.743376 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:03.754705 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 95058.2us
I20260709 13:10:03.759887 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.763273 27262 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:03.767222 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:03.737607 28006 raft_consensus.cc:2376] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:03.747956 30710 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.757411 30679 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:03.774700 27231 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.920s (SENT)
I20260709 13:10:03.755113 30644 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.755530 30711 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.766173 30525 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.748312 30758 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.775101 30407 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:03.775151 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.771134 30718 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.783257 27262 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:03.767447 30695 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.766485 30770 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.773195 30738 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:03.772454 30683 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:03.804293 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61111.8us
I20260709 13:10:03.810487 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:03.811357 30407 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:03.811848 30407 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:03.812309 30407 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.788244 30768 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:03.816923 27260 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:03.790947 30769 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:03.795538 30770 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.808818 30738 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.788077 30525 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.787518 30697 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:03.837867 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69804.2us
I20260709 13:10:03.829200 30738 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:03.826453 30770 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:03.828963 30768 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:03.840421 30769 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:03.843407 30762 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.846355 30698 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.861405 28015 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:03.862566 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:03.862767 27231 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.027s (SENT)
I20260709 13:10:03.863533 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.855352 30769 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:03.882138 30753 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.462s	user 0.003s	sys 0.000s
I20260709 13:10:03.868971 30762 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:03.884025 30678 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.879725 30768 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.928433 30697 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.929595 30738 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:03.936219 27231 leader_election.cc:336] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.060s (SENT)
I20260709 13:10:03.936676 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:03.938846 27414 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:03.931150 30758 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.941560 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.942226 30758 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.942787 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.943397 27415 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:03.944221 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.944796 27415 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:03.946033 30525 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.946254 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.946946 27415 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:03.947894 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.948246 30769 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:03.949034 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:03.950712 27415 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:03.952275 27415 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:03.954071 27415 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:03.953871 30770 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.954860 30758 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:03.955117 27231 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.077s (SENT)
I20260709 13:10:03.955650 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.956508 30738 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.956969 30758 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:03.958989 27231 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.198s (SENT)
I20260709 13:10:03.959442 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:03.960204 30759 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.961549 27260 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:03.961735 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1897) took 1001 ms. Trace:
I20260709 13:10:03.963019 30759 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.963618 30759 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:03.963856 30739 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:10:03.964278 30739 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.965305 27261 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:03.966390 30739 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:03.966823 30678 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:03.971141 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.971226 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:03.962095 27410 rpcz_store.cc:276] 0709 13:10:02.960339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.960521 (+   182us) service_pool.cc:224] Handling call
0709 13:10:02.985505 (+ 24984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.066775 (+ 81270us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:03.230109 (+163334us) log.cc:844] Serialized 14 byte log entry
0709 13:10:03.959344 (+729235us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800204a60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287
0709 13:10:03.959428 (+    84us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.959478 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:03.959522 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.961429 (+  1907us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b540027d154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:03.961469 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:03.961580 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25951,"prepare.queue_time_us":231788,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2973,"raft.queue_time_us":121403,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":17825,"spinlock_wait_cycles":223986176,"thread_start_us":496034,"threads_started":3,"wal-append.queue_time_us":342109}
I20260709 13:10:03.977221 30407 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:03.978662 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:03.982462 30407 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:03.987987 30763 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:03.988960 30763 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:03.996939 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:03.997617 27265 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.002393 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:03.986029 30733 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.929s	user 0.004s	sys 0.000s
I20260709 13:10:04.014129 27265 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:04.015105 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.015281 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:04.016300 27410 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:04.017810 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.018640 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:04.019209 27265 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:10:04.019389 27415 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.020339 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:04.021051 27413 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.022895 27268 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:04.027518 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.027601 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.028462 27267 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.028846 27260 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.000248 30678 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:04.030339 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.032465 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.033288 27265 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.030972 30770 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.043905 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.049923 27264 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:04.054718 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.056289 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.057122 27262 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:04.058521 30770 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.059093 30770 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:04.059597 30770 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.068259 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:04.069145 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:04.070097 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:04.050741 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.081347 27413 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:04.083590 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:04.089648 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.089798 27265 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:04.091301 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:04.091934 27265 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.092177 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.093112 30758 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.051633 30678 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.095220 30758 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:04.095669 30758 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.096938 30678 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.097880 28010 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:04.098006 30696 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:04.098395 30696 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.099256 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:04.099730 30692 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:04.099858 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 462464us
I20260709 13:10:04.100993 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:04.104103 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:04.084287 30759 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:04.109634 27260 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.113157 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:04.118729 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 447) took 2650 ms. Trace:
I20260709 13:10:04.125715 27267 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:04.125659 27231 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.775s (SENT)
I20260709 13:10:04.126610 27415 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:04.107940 30769 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:04.121622 30661 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:04.129137 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 465) took 1111 ms. Trace:
I20260709 13:10:04.130498 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:04.123235 27336 rpcz_store.cc:276] 0709 13:10:01.467971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.480211 (+ 12240us) service_pool.cc:224] Handling call
0709 13:10:01.496479 (+ 16268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:01.543759 (+ 47280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:01.543791 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:01.559135 (+ 15344us) log.cc:844] Serialized 26 byte log entry
0709 13:10:01.813477 (+254342us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:01.829114 (+ 15637us) log.cc:844] Serialized 14 byte log entry
0709 13:10:01.838930 (+  9816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:01.839026 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:02.082954 (+243928us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b180042f700. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:02.099546 (+ 16592us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180042f700. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:02.548467 (+448921us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180042f700. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1
0709 13:10:04.115910 (+1567443us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b180042f700. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:04.118489 (+  2579us) raft_consensus.cc:1685] finished
0709 13:10:04.118511 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.118642 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123184,"prepare.queue_time_us":15332,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":50141,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":41487,"spinlock_wait_cycles":90727040,"thread_start_us":163237,"threads_started":1,"wal-append.queue_time_us":237854}
I20260709 13:10:04.134052 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:04.122092 30759 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:04.110822 30696 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.139133 27265 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:04.140084 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:04.141268 27383 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.152733 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.146034 30703 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:04.153774 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:04.156128 27380 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.826s (SENT)
I20260709 13:10:04.156775 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:04.147755 27417 rpcz_store.cc:276] 0709 13:10:03.017717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.017835 (+   118us) service_pool.cc:224] Handling call
0709 13:10:03.018136 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.059376 (+ 41240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.059406 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.059444 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:03.059477 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.128918 (+1069441us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b540036b354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:04.128961 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.129074 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94380288}
I20260709 13:10:04.147200 30769 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:04.160841 30626 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:04.167707 27231 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.834s (SENT)
I20260709 13:10:04.183517 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:04.184837 27231 leader_election.cc:336] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 3.103s (SENT)
I20260709 13:10:04.170040 30756 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.163470 30407 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:04.170799 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.151633 30759 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.158509 30692 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.158733 30768 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.176556 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 466) took 1158 ms. Trace:
I20260709 13:10:04.176266 30769 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.176633 30758 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.194548 27408 rpcz_store.cc:276] 0709 13:10:03.018648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.018816 (+   168us) service_pool.cc:224] Handling call
0709 13:10:03.026082 (+  7266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.132151 (+106069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:03.132204 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:03.132264 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:03.132322 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.176299 (+1043977us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b5400087854. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:04.176356 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.176495 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226951680}
I20260709 13:10:04.196897 28007 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:04.197366 30737 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.181273 30770 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:04.193809 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:04.200639 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 99381.1us
W20260709 13:10:04.201959 27231 leader_election.cc:336] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.167s (SENT)
I20260709 13:10:04.202544 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:04.191951 30762 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:04.198299 30697 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.194614 30756 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.198206 30721 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.214675 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:04.211828 30626 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:04.199221 30649 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:04.227720 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:04.213106 30458 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:10:04.229732 27309 leader_election.cc:400] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:10:04.215252 30507 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:10:04.234248 27309 leader_election.cc:403] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:10:04.208492 30654 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:04.204473 30407 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.236054 30407 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.236801 27412 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:04.237720 27408 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:04.238329 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:04.238620 30692 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.203594 30737 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.221153 30770 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.206660 30768 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.230530 30562 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.231021 30644 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.231515 30721 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:10:04.231915 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.977s (SENT)
I20260709 13:10:04.232695 30756 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.208544 30758 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:04.207091 30558 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.282120 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:04.250434 27415 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
W20260709 13:10:04.251654 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53380us
I20260709 13:10:04.254355 27417 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:04.265511 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 453) took 2083 ms. Trace:
I20260709 13:10:04.284544 27343 rpcz_store.cc:276] 0709 13:10:02.181974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.182167 (+   193us) service_pool.cc:224] Handling call
0709 13:10:02.200439 (+ 18272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:02.232970 (+ 32531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:02.233007 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:02.265940 (+ 32933us) log.cc:844] Serialized 26 byte log entry
0709 13:10:03.681495 (+1415555us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b1800313d80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:03.759272 (+ 77777us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:03.773486 (+ 14214us) log.cc:844] Serialized 14 byte log entry
0709 13:10:04.265070 (+491584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.265154 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.265200 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:04.265312 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:04.265449 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434422,"prepare.queue_time_us":30734,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":460564,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":17038,"spinlock_wait_cycles":109739904,"thread_start_us":137461,"threads_started":2,"wal-append.queue_time_us":1522519}
I20260709 13:10:04.260702 30517 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:04.286724 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84809.2us
I20260709 13:10:04.287501 27266 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:04.288676 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56793.2us
I20260709 13:10:04.289445 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:04.254333 30507 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:10:04.294287 30626 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:04.294226 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:04.261104 30648 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:04.261637 30562 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:04.287940 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.300338 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.291005 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:04.294438 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.293732 30517 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.294166 30659 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:04.304613 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 740717us
I20260709 13:10:04.239763 30692 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:10:04.312084 28007 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 558) took 2161 ms (client timeout 1714 ms). Trace:
I20260709 13:10:04.312675 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:04.313534 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 450916us
W20260709 13:10:04.312577 28007 rpcz_store.cc:269] 0709 13:10:02.139013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.147461 (+  8448us) service_pool.cc:224] Handling call
0709 13:10:04.300155 (+2152694us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400750154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:04.300263 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4711226624}
I20260709 13:10:04.314239 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:04.326632 27231 connection.cc:256] RPC call timeout handler was delayed by -1.3009054090000518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:10:04.327147 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1605054090000522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 13:10:04.337113 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:04.303542 30648 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:04.339288 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48356.8us
I20260709 13:10:04.304720 30659 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:04.345757 30659 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:04.345816 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51667.9us
W20260709 13:10:04.347357 30761 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.665s	user 0.006s	sys 0.000s
I20260709 13:10:04.313031 30800 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.323591 30558 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:04.316524 30718 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:04.331132 30458 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.286823 30768 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.342816 27380 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:04.312357 30760 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:04.361671 30648 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.363696 30648 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:04.315645 30691 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:04.343663 30407 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.340883 30644 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:04.338882 30629 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:10:04.355252 30718 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.386216 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.357798 30458 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.342682 30507 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:10:04.360327 30760 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:04.389261 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.364497 30776 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:04.403653 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 60967.6us
I20260709 13:10:04.411873 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:04.406216 27383 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.415661 30799 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:10:04.416054 30680 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:04.388420 30718 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.388634 30458 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.389932 30626 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:04.447518 27380 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.101s (SENT)
W20260709 13:10:04.448251 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.399156 30797 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:04.452751 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.403889 30760 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.399603 30507 consensus_queue.cc:1243] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:04.403870 30763 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.411154 30407 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.468420 30407 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.382423 30562 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.472218 27417 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:04.472820 30562 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.381947 30517 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.417303 30495 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:04.410252 30800 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:04.478173 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:04.481019 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:04.479271 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:04.443579 30776 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.458030 30749 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:04.476218 30525 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:04.462167 30697 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.506801 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.510102 27343 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.460532 30797 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.456291 30644 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:10:04.475391 30200 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
W20260709 13:10:04.512658 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65170.5us
I20260709 13:10:04.510344 30799 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.462579 30626 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.571770 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.503899 30769 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:04.583566 30769 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:04.584676 30626 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:04.584766 30769 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:04.586292 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.498852 30495 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.580541 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.509053 30758 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:04.587842 27338 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.588047 30495 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.591626 27336 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:04.505730 30645 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:04.497287 30649 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:10:04.594609 27336 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:04.455997 30558 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.598286 27335 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:04.600057 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.669039 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.669940 27336 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:04.676723 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 99483.6us
I20260709 13:10:04.509125 30759 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.690941 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.566457 30770 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:04.593881 30749 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.699919 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.700665 27342 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:04.708467 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.709465 27335 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:04.691761 30802 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.714216 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.715149 27337 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.687618 30649 consensus_queue.cc:1243] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:04.695451 30715 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.582629 30799 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.601514 30645 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.728636 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:04.740890 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:04.732812 30525 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:04.711624 30813 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:04.754909 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51735.6us
I20260709 13:10:04.753971 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.761294 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.713377 30655 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:10:04.757944 30705 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:04.726195 30802 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.729768 30715 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.801512 30737 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.803114 30715 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.738195 30763 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:10:04.788578 30749 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.804234 30763 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.804593 30763 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:04.763582 30805 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 13:10:04.825613 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.788054 27337 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:04.789368 27417 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:04.791666 28007 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:04.792309 27380 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.200s (SENT)
I20260709 13:10:04.694057 30797 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.787300 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.790416 30705 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.794799 30802 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.714305 30776 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.795800 30709 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:04.716424 30800 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.759938 30813 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:04.843027 30812 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:10:04.798017 30807 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:10:04.806842 27260 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:04.862072 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.814393 27343 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:04.862952 27339 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:04.831857 27335 raft_consensus.cc:606] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Received request to transfer leadership to TS d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:04.863636 27335 raft_consensus.cc:614] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:04.833019 27340 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:04.837878 27259 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:10:04.864477 27337 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:04.759840 30758 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:10:04.750722 30708 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:04.837762 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.839112 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:04.841981 30814 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:04.841575 30763 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.875813 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.876770 30763 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.877239 27260 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:04.878542 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.838052 30705 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.879752 30708 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:04.880137 30708 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.880952 30708 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:04.843309 30817 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:10:04.847237 30806 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:10:04.848445 27264 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
W20260709 13:10:04.849745 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57455.1us
I20260709 13:10:04.850783 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.902719 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.903635 27336 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:04.796268 30659 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.744427 30777 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:10:04.872016 30696 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.892124 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.892755 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.893584 28007 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:04.855010 30709 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:04.895676 27334 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:04.895972 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.919006 27343 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:04.897527 27338 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.921446 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.924340 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.925503 27340 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:04.891674 30708 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:04.929584 27339 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.928404 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.932919 27334 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.937717 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.938302 27336 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:04.938410 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.940277 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:04.946758 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.935457 30645 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:04.962007 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.962821 27339 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.963698 28006 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:04.963801 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.964781 27339 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:04.940044 30458 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:04.965632 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.966741 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.967460 27339 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:04.967772 30808 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:10:04.968258 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:04.968803 27339 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:04.969560 30811 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:10:04.970242 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:04.971900 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.981252 27340 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:04.971136 30709 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.990085 30705 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:04.991518 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.992193 27338 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:04.993541 30659 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:04.995555 27342 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:05.007961 30705 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:05.012998 30575 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:05.014202 30575 tablet_bootstrap.cc:492] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:10:04.923470 30770 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:10:05.017071 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:05.031409 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.021332 27341 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.023337 27336 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.047506 27334 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
W20260709 13:10:05.048296 27380 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.520s (SENT)
I20260709 13:10:05.049059 27339 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:05.050916 27265 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:05.018268 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.015007 30575 ts_tablet_manager.cc:1403] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 3.065s	user 0.043s	sys 0.028s
I20260709 13:10:05.060403 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:05.064735 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.624s (SENT)
I20260709 13:10:05.066289 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.066949 27338 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:10:05.067480 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.067875 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.068215 27334 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:05.068506 27338 raft_consensus.cc:2376] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:05.044116 30759 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.069258 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.055639 30458 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:05.071105 30816 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:05.071683 30816 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:05.071911 30618 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:05.072342 30618 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:05.072703 30816 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.3, Last appended by leader: 3, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.073175 30618 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.075970 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:04.870535 30525 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.076529 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.077404 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.078333 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.078794 27336 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:05.079211 27262 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:05.043802 30758 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.080440 27334 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:05.075341 30648 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.000s
I20260709 13:10:05.074163 30816 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.043507 30799 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.065834 30709 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.091532 30813 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.096277 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.097119 27265 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:05.080826 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.082934 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.083530 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:05.084743 30718 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.000s
W20260709 13:10:05.087435 30809 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.333s	user 0.004s	sys 0.000s
I20260709 13:10:05.105667 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.115599 27336 raft_consensus.cc:2376] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:05.117055 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.132512 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.146847 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.147600 27338 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.148581 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.149369 27338 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:05.082613 30618 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.151755 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.154518 27338 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:05.196736 28011 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:05.196988 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.197887 27334 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:05.199366 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.208995 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.210302 27336 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:05.196448 30648 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:05.211862 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.212630 27336 raft_consensus.cc:2376] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7. Re-sending same reply.
I20260709 13:10:05.212165 30648 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.214111 27336 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:05.214514 27336 pending_rounds.cc:85] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:10:05.214802 27336 pending_rounds.cc:107] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:05.095343 30758 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.210747 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.215093 27336 raft_consensus.cc:2889] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.273232 27265 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 10. Ops: []
I20260709 13:10:05.151659 30718 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.274392 27334 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:05.516861 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.517244 27267 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:05.517530 27338 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.517796 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.279657 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.518431 27334 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:10:05.284963 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:05.519883 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.523453 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.277047 27265 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:05.532851 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:05.488657 30708 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.005s
I20260709 13:10:05.536432 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.376221 30648 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.540475 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.527215 30801 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:05.543800 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.533780 30769 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:05.542718 30760 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.044s	user 0.013s	sys 0.000s
I20260709 13:10:05.548568 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.549530 27334 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.550256 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.550895 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.551633 30507 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:05.547006 30770 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:05.553030 30507 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:05.553225 30770 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.553905 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.554008 30507 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.550529 30760 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.555863 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.543495 30801 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:05.555315 30507 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.559469 30801 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.566399 27338 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:05.568238 30801 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.568040 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.569351 27338 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.570567 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.572041 27338 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.555258 30770 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.580942 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.583040 27334 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:05.548087 30769 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.586357 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.592624 27334 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:05.585222 30770 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.576442 30575 raft_consensus.cc:359] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 7 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.604110 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.605228 27334 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:05.606292 30836 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.607079 30836 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.608588 30769 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.609962 30836 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.610133 27266 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.3-9.3]
I20260709 13:10:05.611725 30760 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:05.613421 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.618906 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.620527 27334 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.621004 27265 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:05.622788 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.623515 27265 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:05.601460 30770 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.635541 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.622819 27259 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.639741 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.640453 27265 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:05.642002 27266 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:05.615597 30837 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.639451 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.643764 27334 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:05.644786 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.645368 27334 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.615155 30575 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:10:05.651846 30575 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:05.652940 27334 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:05.653970 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.654515 27334 raft_consensus.cc:2376] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:05.659775 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:05.664827 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.664696 30770 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.665283 30648 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.665889 30648 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.666324 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.667106 27334 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.668051 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.668927 27334 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:05.669710 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.670380 27334 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:05.671387 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.672063 27334 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.672823 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.673494 27334 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.674248 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.674785 27334 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:10:05.675665 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.676687 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.677647 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:05.678164 30816 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 13:10:05.615797 30718 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:05.685459 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.688534 27265 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
I20260709 13:10:05.698030 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.687547 30770 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.699002 30575 ts_tablet_manager.cc:1434] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.641s	user 0.010s	sys 0.002s
I20260709 13:10:05.642913 30837 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.714956 27336 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.715606 27334 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:05.707669 30618 consensus_meta.cc:287] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.558s	user 0.013s	sys 0.000s
I20260709 13:10:05.715879 30769 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:05.715240 30575 ts_tablet_manager.cc:1467] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Tablet startup took 657ms
W20260709 13:10:05.723963 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.720995 30648 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.727245 30648 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.725654 30813 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:05.730086 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.723304 30507 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.732467 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:05.725651 30816 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.733448 30813 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.734059 30816 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.716096 30770 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.734437 30507 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.735786 30813 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.736356 30813 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.736928 30770 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.736788 30813 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.738485 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:05.739886 30507 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.740993 30816 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.727807 30648 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.744514 27414 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:05.747187 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:05.752669 27415 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:05.758597 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.761103 27414 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:05.764881 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.765353 27266 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:05.765733 27268 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.765239 30758 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.766451 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.774950 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.775619 30762 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:05.775835 27343 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:05.776283 30762 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:05.777097 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.777998 27343 raft_consensus.cc:2368] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:05.777609 30762 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.781013 27266 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.770848 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.783422 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.784490 27334 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.779052 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.793550 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.795145 27268 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:05.796877 27334 raft_consensus.cc:2376] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8. Re-sending same reply.
I20260709 13:10:05.798264 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.799993 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.747255 30760 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:05.804400 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.810499 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.810775 30841 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.811332 30758 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.811703 30816 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.814807 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:05.815536 27268 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.816285 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.817121 30758 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:05.818097 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.818876 30758 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:05.819293 30758 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.819649 30758 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.820662 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:05.821453 30654 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.821820 30654 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:05.822166 30654 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.827136 30758 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.832839 30648 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.829917 30654 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.834076 30813 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.831636 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.835500 30758 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.835753 30770 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.836938 27268 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.837965 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.838131 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.838649 27268 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:05.839521 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.840307 27340 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:05.841102 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.842938 30801 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:05.846705 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.847713 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.851814 27231 leader_election.cc:400] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:05.852149 27231 leader_election.cc:403] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.839521 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.861292 27268 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:05.861697 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.862550 27334 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:05.865028 27266 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:05.852275 30760 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.866894 27268 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:05.867678 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.868268 27268 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:05.868634 30760 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.869021 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.869659 27343 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.872437 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.835690 30837 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:05.845521 30762 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.857303 30654 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.883245 27268 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:05.883814 27266 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.884254 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:05.882411 30721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.019s	sys 0.012s
I20260709 13:10:05.896188 27343 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:05.884860 27268 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:05.892659 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.811719 30841 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:05.897656 27338 raft_consensus.cc:2376] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9. Re-sending same reply.
I20260709 13:10:05.905728 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.906461 27340 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:10:05.907080 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.882619 30842 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:05.908083 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.908341 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.906006 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.909165 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.909724 27343 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:05.908033 30655 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.911322 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:05.911756 30840 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:05.913632 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1352) took 1105 ms. Trace:
I20260709 13:10:05.909896 30758 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.915668 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.916281 27343 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:05.917023 30797 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.919823 30842 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:05.724471 30575 ts_tablet_manager.cc:1469] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Trace:
0709 13:09:57.843674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.844670 (+   996us) service_pool.cc:224] Handling call
0709 13:09:58.150322 (+305652us) ts_tablet_manager.cc:934] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
0709 13:09:59.479643 (+1329321us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:00.160623 (+680980us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:00.160786 (+   163us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:00.369668 (+208882us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:00.370104 (+   436us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:00.370486 (+   382us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:00.370570 (+    84us) inbound_call.cc:177] Queueing success response
0709 13:10:01.949608 (+1579038us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:10:05.058042 (+3108434us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:10:05.282594 (+224552us) tablet_replica.cc:261] Starting instrumentation
0709 13:10:05.283232 (+   638us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":27455,"mutex_wait_us":67925,"raft.queue_time_us":172,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"tablet-copy.queue_time_us":140600,"tablet-download-pool.queue_time_us":9838,"tablet-download-pool.run_cpu_time_us":1436,"tablet-download-pool.run_wall_time_us":582536,"thread_start_us":208596,"threads_started":2}
I20260709 13:10:05.921772 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.922544 30758 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:05.924074 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:05.925680 30841 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:05.926196 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.928043 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.904829 30844 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:05.928898 27336 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:05.928973 30844 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.929777 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.930338 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:10:05.931396 30758 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.908242 30770 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:05.913986 27262 rpcz_store.cc:276] 0709 13:10:04.808542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.139911 (+331369us) service_pool.cc:224] Handling call
0709 13:10:05.140347 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:05.537099 (+396752us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:05.545981 (+  8882us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.714996 (+169015us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:05.715505 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.715640 (+   135us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:05.715998 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 13:10:05.731878 (+ 15880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.732003 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.913425 (+181422us) raft_consensus.cc:1685] finished
0709 13:10:05.913448 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.913575 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8934,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":317899,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":2607,"spinlock_wait_cycles":3823872,"thread_start_us":445598,"threads_started":3,"wal-append.queue_time_us":194553}
I20260709 13:10:05.932773 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:05.931156 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.936074 27338 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:05.934981 27343 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:05.936764 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:05.898113 30721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.019s	sys 0.012s
I20260709 13:10:05.937079 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:05.891076 30837 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:05.937654 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.938649 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:05.939829 27343 raft_consensus.cc:2376] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7. Re-sending same reply.
I20260709 13:10:05.940462 27412 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:05.940665 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.941385 27340 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:05.942160 27409 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:05.944139 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:05.944950 27268 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:05.938434 30844 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:05.932008 30758 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.949738 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.950058 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:05.964517 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.964643 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:05.965998 30842 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:05.966239 30708 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.966413 30842 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.966868 30842 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:05.966861 30708 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.969446 30708 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:05.969949 30708 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.965339 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:05.948901 30758 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:05.944468 30654 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:05.970382 30708 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:05.946565 30822 raft_consensus.cc:2764] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:10:05.972970 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:05.974529 30837 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:05.986351 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:05.987015 27336 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:05.984364 30837 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:05.988667 30837 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:05.991927 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 570) took 1200 ms. Trace:
I20260709 13:10:05.992336 28011 rpcz_store.cc:276] 0709 13:10:04.792022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.792164 (+   142us) service_pool.cc:224] Handling call
0709 13:10:04.835555 (+ 43391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.197161 (+361606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.991667 (+794506us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:05.991871 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761886592}
I20260709 13:10:05.994261 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-a30a45f010dd49e5a9ddb107297fa03e received from {username='slave'} at 127.0.0.1:36154
I20260709 13:10:05.999799 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-a30a45f010dd49e5a9ddb107297fa03e on tablet a30a45f010dd49e5a9ddb107297fa03e with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.003656 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.003840 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1344) took 1198 ms. Trace:
I20260709 13:10:06.004294 27267 rpcz_store.cc:276] 0709 13:10:04.805866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.806007 (+   141us) service_pool.cc:224] Handling call
0709 13:10:05.517003 (+710996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:05.517820 (+   817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.003613 (+485793us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54001f86d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:06.003762 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244937600}
I20260709 13:10:06.005421 27268 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.006795 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.008466 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:06.009213 27266 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:10:06.011704 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.985357 30769 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:06.016145 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.017740 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.021894 27336 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:10:06.022253 27336 pending_rounds.cc:85] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 3
I20260709 13:10:06.022509 27336 pending_rounds.cc:107] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:10:06.020725 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.023087 27336 raft_consensus.cc:2889] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.985682 30848 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.022364 27414 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:06.020884 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.031689 27410 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:06.020112 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.029398 27412 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:06.038753 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.039592 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:06.040756 27416 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.040980 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2221) took 1182 ms. Trace:
I20260709 13:10:06.041378 27343 rpcz_store.cc:276] 0709 13:10:04.858248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.024068 (+1165820us) service_pool.cc:224] Handling call
0709 13:10:06.024431 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.040595 (+ 16164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.040624 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:06.040695 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:06.040737 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.040795 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.040927 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1984}
I20260709 13:10:06.038161 30710 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:06.043068 30769 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:06.044241 28013 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 7 LEARNER]: Advancing to term 8
I20260709 13:10:06.039026 30721 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.044885 30769 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.038110 30760 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:10:06.046012 30845 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:06.047029 27411 raft_consensus.cc:1217] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Deduplicated request from leader. Original: 2.2->[4.3-10.6]   Dedup: 6.4->[8.5-10.6]
I20260709 13:10:06.047591 27411 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: [4.3-10.6]
I20260709 13:10:06.048055 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.043082 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:06.048506 30848 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.047479 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.043989 30767 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:06.050673 30848 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.045077 30721 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.053165 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:06.043720 30847 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:10:06.051759 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.056358 30763 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:06.056720 27383 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.056842 30763 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:06.057566 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.060700 30721 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.043697 30710 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:06.057734 30763 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.061965 30710 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.059144 30767 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.063354 30710 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.063442 30697 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.064034 30697 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:06.064826 30697 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.069120 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.071154 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:06.067533 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2220) took 1209 ms. Trace:
I20260709 13:10:06.071964 30729 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:06.072078 27336 rpcz_store.cc:276] 0709 13:10:04.857935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.994964 (+1137029us) service_pool.cc:224] Handling call
0709 13:10:06.021572 (+ 26608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.067276 (+ 45704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.067479 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:06.072614 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:06.073215 28009 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:06.073345 30721 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.073889 30721 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.079396 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.080099 27408 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:06.081375 30721 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.082127 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.082368 28013 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:06.083989 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.084232 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.084741 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.084852 27411 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:06.085470 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.085557 30721 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.086136 30721 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.086802 30721 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.087745 30841 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:06.088557 30841 consensus_queue.cc:1243] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:06.089116 30841 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:06.089548 30841 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:06.090587 30841 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.092404 30841 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:06.096645 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.086108 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.098225 30721 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.039101 30618 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.101307 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:06.128361 27339 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:06.133265 27266 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:06.131300 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:44086 (request call id 18) took 1391 ms. Trace:
I20260709 13:10:06.137454 27335 rpcz_store.cc:276] 0709 13:10:04.712189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.712431 (+   242us) service_pool.cc:224] Handling call
0709 13:10:06.102987 (+1390556us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54001685d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2b853 00007fbd87bf960a 00007fbd8117f7d4 00007fbd8117f762 00007fbd8117f691 00007fbd8117f60c 00007fbd8117e8c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:06.103136 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229393280}
I20260709 13:10:06.138574 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2209) took 1276 ms. Trace:
I20260709 13:10:06.139151 27339 rpcz_store.cc:276] 0709 13:10:04.852587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.064351 (+211764us) service_pool.cc:224] Handling call
0709 13:10:06.101111 (+1036760us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87bf70a0 00007fbd87bf6984 00007fbd811716d4 00007fbd81171662
0709 13:10:06.128996 (+ 27885us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5338496}
W20260709 13:10:06.144384 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 73295.6us
W20260709 13:10:06.145606 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.100039 30822 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.058979 30842 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.157797 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:06.158586 27339 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.157155 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:06.164606 30833 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.079s	user 0.004s	sys 0.000s
I20260709 13:10:06.167132 30844 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.167729 30844 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.168186 30844 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.141513 30618 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.174738 30618 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.184182 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.185890 28009 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:06.196161 27339 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:10:06.203912 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.151787 30767 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:06.206705 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.209493 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.209780 27263 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:06.209236 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:06.211421 27335 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:06.152733 30729 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:10:06.156893 30654 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:06.219018 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:06.224298 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.224793 28013 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.225109 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.225546 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.226305 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:06.226563 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 147346us
I20260709 13:10:06.227643 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.227748 30852 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:06.229795 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.230605 30865 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.231654 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.231671 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:06.232764 30839 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.233290 30839 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.233668 30839 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.235973 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.237020 30822 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.204262 30848 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.206723 30813 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:06.248167 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 170899us
I20260709 13:10:06.206023 30836 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.205886 30801 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.204721 30857 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.203445 28008 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:06.209211 30655 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.212247 30850 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.264998 27335 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:06.265517 27335 pending_rounds.cc:85] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:10:06.267884 27335 pending_rounds.cc:107] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:06.268193 27335 raft_consensus.cc:2889] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.248602 30813 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.259492 30654 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:06.247527 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 70469us
I20260709 13:10:06.275817 27262 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:06.303747 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:06.262588 30857 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:06.314967 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 66080.2us
I20260709 13:10:06.300707 30813 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.261042 30836 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.325100 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.326192 30648 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.322922 27416 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:06.326776 30648 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.328629 27343 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:06.328903 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.329150 30648 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.329638 27416 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:06.329043 27343 pending_rounds.cc:85] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 5
I20260709 13:10:06.330302 27343 pending_rounds.cc:107] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:06.330544 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.330561 27343 raft_consensus.cc:2889] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:06.333498 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.334082 27408 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:06.335731 27335 raft_consensus.cc:606] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:06.336205 27335 raft_consensus.cc:614] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:06.298678 30708 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.334661 30758 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.304698 30655 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.252038 30848 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.262852 30801 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.371739 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2190) took 1658 ms. Trace:
I20260709 13:10:06.379882 27342 rpcz_store.cc:276] 0709 13:10:04.713736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.723400 (+  9664us) service_pool.cc:224] Handling call
0709 13:10:04.995229 (+271829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.995960 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.371527 (+1375567us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540022a450. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:06.371678 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624324992}
W20260709 13:10:06.372400 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.372686 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 147086us
W20260709 13:10:06.375864 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.376715 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2194) took 1591 ms. Trace:
I20260709 13:10:06.321775 30857 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.387458 27342 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:06.388708 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.389545 30648 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.386289 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.384169 27337 rpcz_store.cc:276] 0709 13:10:04.785636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.836759 (+ 51123us) service_pool.cc:224] Handling call
0709 13:10:04.837025 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:04.864829 (+ 27804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.376492 (+1511663us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b54001685d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:06.376661 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62778240}
I20260709 13:10:06.316640 30618 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:06.390408 27408 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.392565 30729 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.394150 28007 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:06.301093 30767 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.348379 30862 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:06.394115 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 162935us
I20260709 13:10:06.267136 30850 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.389911 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.398155 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.400725 30837 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:06.403669 30853 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:10:06.405164 30801 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.405934 30867 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.376878 30655 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.408289 30836 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.408752 30842 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.412194 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:06.442648 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56664.2us
I20260709 13:10:06.452363 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.387682 30721 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:06.462954 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.465080 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 75242.7us
I20260709 13:10:06.470014 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1479) took 1990 ms. Trace:
I20260709 13:10:06.481112 27309 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.480841 27417 rpcz_store.cc:276] 0709 13:10:04.480066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.483745 (+  3679us) service_pool.cc:224] Handling call
0709 13:10:04.483970 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.829821 (+345851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.469680 (+1639859us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540036ae54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:06.469941 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701746048}
I20260709 13:10:06.482574 30841 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.483989 30655 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.484083 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.472460 27408 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:06.477614 27416 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
W20260709 13:10:06.487596 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.476698 30762 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.003s
I20260709 13:10:06.471545 30873 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.469450 30839 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.477470 30862 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:06.502321 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 90237.7us
I20260709 13:10:06.515745 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.467721 30769 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.519579 27259 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:06.521610 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.412315 30729 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.525283 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.479468 30797 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.528525 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.518712 30682 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.520677 30849 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.548671 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.526247 30841 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.555150 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.519888 30870 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.556509 30710 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.557281 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:06.560926 27380 connection.cc:256] RPC call timeout handler was delayed by -1.432883922999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:10:06.562247 27380 connection.cc:256] RPC call timeout handler was delayed by -1.4296652209999365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:10:06.562557 27380 connection.cc:256] RPC call timeout handler was delayed by -1.4213485469999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:10:06.562831 27380 connection.cc:256] RPC call timeout handler was delayed by -1.3937194080000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:10:06.538172 30648 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.565171 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.566083 27266 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
W20260709 13:10:06.567358 27380 connection.cc:256] RPC call timeout handler was delayed by -1.380031641999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 13:10:06.567703 27380 connection.cc:256] RPC call timeout handler was delayed by -1.3711652209999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:10:06.568503 27380 connection.cc:256] RPC call timeout handler was delayed by -1.3290169470000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:10:06.568922 27380 connection.cc:256] RPC call timeout handler was delayed by -1.3092169469999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:10:06.569310 27380 connection.cc:256] RPC call timeout handler was delayed by -1.2962225679999619s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:10:06.569942 27266 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:06.571673 27380 connection.cc:256] RPC call timeout handler was delayed by -1.2455335380000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:10:06.572227 27380 connection.cc:256] RPC call timeout handler was delayed by -1.2104571329999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3214s for a response
W20260709 13:10:06.572639 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1858857069998976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
W20260709 13:10:06.573041 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1811392270000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:10:06.573447 27380 connection.cc:256] RPC call timeout handler was delayed by -1.150816946999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
W20260709 13:10:06.573853 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1412931469999421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:10:06.574355 27380 connection.cc:256] RPC call timeout handler was delayed by -1.12658361900003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
W20260709 13:10:06.574755 27380 connection.cc:256] RPC call timeout handler was delayed by -1.116452506999849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:10:06.575155 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1059053529999119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:10:06.576256 30800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.488s	user 0.007s	sys 0.000s
W20260709 13:10:06.576812 30800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.489s	user 0.008s	sys 0.000s
I20260709 13:10:06.578060 30800 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.578621 30800 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.579128 30800 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.586441 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2258) took 1145 ms. Trace:
I20260709 13:10:06.540719 30797 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.591778 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.587064 27336 rpcz_store.cc:276] 0709 13:10:05.444481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.072995 (+628514us) service_pool.cc:224] Handling call
0709 13:10:06.073319 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.073685 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.073713 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.074320 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.202673 (+128353us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:06.472825 (+270152us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.487355 (+ 14530us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.487672 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.487780 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.586115 (+ 98335us) raft_consensus.cc:1685] finished
0709 13:10:06.586146 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.586359 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10154,"prepare.queue_time_us":344892,"raft.queue_time_us":4241,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":33200,"thread_start_us":391775,"threads_started":2,"wal-append.queue_time_us":135750}
I20260709 13:10:06.544579 30801 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.543349 30721 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:06.594549 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:06.604355 27341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2192) took 1854 ms (client timeout 2127 ms). Trace:
I20260709 13:10:06.605039 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:06.604789 27341 rpcz_store.cc:269] 0709 13:10:04.750425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.751039 (+   614us) service_pool.cc:224] Handling call
0709 13:10:06.604189 (+1853150us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54000e15d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:06.604296 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482277120}
I20260709 13:10:06.607849 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:06.609239 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:06.608678 27341 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:06.609849 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:06.570998 30870 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.585364 30710 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.586699 30648 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.585747 30861 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:06.618410 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61194.6us
I20260709 13:10:06.545780 30769 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.642057 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.562744 30869 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:06.604681 30758 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.598048 30797 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.615370 30721 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:06.692498 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 87542us
I20260709 13:10:06.611223 30859 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.557953 30682 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:06.701357 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 59350.9us
I20260709 13:10:06.732281 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:06.691929 30866 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:10:06.641436 30648 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.617115 30870 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.565984 30849 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.740000 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.603120 30873 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
W20260709 13:10:06.719858 30853 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:06.675100 30710 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.745342 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.750212 27334 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:06.607014 30680 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260709 13:10:06.690891 30852 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:06.759256 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:06.747833 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 180131us
I20260709 13:10:06.721832 30801 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.760718 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:06.750689 30872 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
I20260709 13:10:06.736593 30850 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.752300 30858 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:10:06.769152 30879 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:10:06.769865 30682 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.770233 30708 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:06.770634 30708 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:06.771477 30708 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.772626 30708 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.776849 27339 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:06.779451 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1971) took 1172 ms. Trace:
W20260709 13:10:06.779665 30877 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:06.737718 30859 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.779872 27337 rpcz_store.cc:276] 0709 13:10:05.607444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.390549 (+783105us) service_pool.cc:224] Handling call
0709 13:10:06.390958 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:06.391426 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.391465 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:06.392705 (+  1240us) log.cc:844] Serialized 52 byte log entry
0709 13:10:06.502091 (+109386us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:06.557016 (+ 54925us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.607207 (+ 50191us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.607419 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.607486 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.779227 (+171741us) raft_consensus.cc:1685] finished
0709 13:10:06.779255 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.779399 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50343,"prepare.queue_time_us":88960,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":85,"raft.queue_time_us":25426,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":215,"spinlock_wait_cycles":8582912,"thread_start_us":184747,"threads_started":3,"wal-append.queue_time_us":145739}
I20260709 13:10:06.782756 30859 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.783449 30682 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.783434 30889 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:06.784670 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 72012.2us
W20260709 13:10:06.785691 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.752681 30837 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.786700 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.745241 30885 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:06.794261 27266 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:06.799587 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.763370 30887 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:06.805131 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46207.4us
I20260709 13:10:06.807804 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.791216 30858 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:06.814229 30886 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:10:06.814366 30858 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.784361 30849 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.784152 30682 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.640208 30862 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.824690 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.794472 30885 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.827634 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 1969) took 1220 ms. Trace:
I20260709 13:10:06.761952 30868 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:10:06.806457 30859 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.789654 30801 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:10:06.808495 30839 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.809301 30887 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.828717 30873 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:06.803633 30890 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:06.845834 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:06.826619 30837 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.828589 27342 rpcz_store.cc:276] 0709 13:10:05.606805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.388229 (+781424us) service_pool.cc:224] Handling call
0709 13:10:06.388537 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:06.388952 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.388978 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:06.389634 (+   656us) log.cc:844] Serialized 78 byte log entry
0709 13:10:06.464270 (+ 74636us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:06.553108 (+ 88838us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.553547 (+   439us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.826925 (+273378us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.827222 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.827314 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.827366 (+    52us) raft_consensus.cc:1685] finished
0709 13:10:06.827384 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:06.827562 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4777,"prepare.queue_time_us":159813,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":94,"raft.queue_time_us":19508,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":4005,"thread_start_us":418462,"threads_started":3,"wal-append.queue_time_us":93152}
I20260709 13:10:06.809018 30729 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.850018 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:06.805380 30892 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:06.849852 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89252.7us
I20260709 13:10:06.789912 30721 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.858687 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.831791 30885 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:06.837442 30859 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.865713 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:06.848156 30852 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.829635 30648 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.875905 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:06.850751 30887 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.852165 30890 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.863626 30680 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.881124 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:06.872114 30859 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.892323 30682 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.870958 30873 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.895816 30873 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:06.896194 30873 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:06.896564 30873 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.899580 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.888969 30797 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.885828 30891 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:10:06.884480 30890 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.901702 27408 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:10:06.889427 30844 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.001s
I20260709 13:10:06.902395 30844 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.902813 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.903823 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.904500 30797 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.904758 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.905435 30844 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.905758 30894 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:06.905998 30844 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:06.906122 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.907292 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.908368 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.909536 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.910709 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.912093 27412 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.913034 30859 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.913239 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.913187 30887 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.884997 30680 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:06.915328 30680 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.916131 30873 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.918224 30873 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.919245 30859 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.920058 30893 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.921434 30648 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.921135 30893 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.922160 30769 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.922462 30890 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.923421 30893 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.926333 30848 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.926899 30887 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.928860 30890 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:06.929059 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2257) took 1521 ms. Trace:
I20260709 13:10:06.929659 27343 rpcz_store.cc:276] 0709 13:10:05.407620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.042475 (+634855us) service_pool.cc:224] Handling call
0709 13:10:06.042740 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.332076 (+289336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.928751 (+596675us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54000e1d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:06.928983 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656674560}
W20260709 13:10:06.930621 30813 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.001s
I20260709 13:10:06.876075 30729 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:10:06.932847 30895 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:06.933136 30852 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:06.933979 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46599.9us
I20260709 13:10:06.937465 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:06.938717 30832 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.853s	user 0.001s	sys 0.021s
I20260709 13:10:06.939342 30767 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:06.940771 30767 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:06.883983 30888 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:06.855211 30837 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:06.942865 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:06.886175 27978 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:06.943138 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1376) took 1002 ms. Trace:
I20260709 13:10:06.943746 30407 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:06.946467 30878 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:10:06.965873 30407 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:06.951332 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.967754 27415 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:06.968046 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.968663 27412 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:06.951726 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:06.960453 30855 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.815s	user 0.003s	sys 0.001s
I20260709 13:10:06.970520 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:06.955307 30888 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:06.960481 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:06.945559 30837 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.971768 30888 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:06.962935 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76855.4us
I20260709 13:10:06.974838 30797 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:06.975941 30860 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:06.963261 30849 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:06.964267 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.953892 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:06.964560 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:06.978705 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.979310 27414 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:06.965230 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:06.965042 27262 rpcz_store.cc:276] 0709 13:10:05.940265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.940443 (+   178us) service_pool.cc:224] Handling call
0709 13:10:06.942956 (+1002513us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540024bdd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:06.943068 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768947072}
I20260709 13:10:06.963894 28007 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:06.966876 30407 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.905802 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:06.977451 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:07.017762 27414 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:07.018245 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:07.018755 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:07.019379 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:07.020397 27414 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.019379 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.021569 27340 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.021487 27414 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.018899 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:07.023128 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:07.023751 27408 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:07.023968 27415 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:07.025262 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.025815 27412 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:06.962287 28008 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:07.026041 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.026341 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:07.022481 27414 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.963842 30770 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:06.977217 30849 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.006742 30841 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:07.037369 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.040343 27260 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.051157 27262 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:07.051599 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.052440 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:07.052958 30407 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.053345 30868 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.043712 30895 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:07.030020 30718 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:07.055071 30895 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.055928 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.056123 30895 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.056931 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.057469 27262 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:07.058753 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.059224 30708 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.059633 30867 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.017745 30839 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.060184 30867 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.060518 30839 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.062338 30867 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:07.027380 30836 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:07.048420 30837 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:07.063258 30837 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.063117 30836 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.063663 30837 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.065148 27263 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:07.065245 30836 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:06.926985 30800 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.020810 30865 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:07.067028 27414 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:07.067766 30800 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:07.068409 27334 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.070032 27264 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:07.006955 30769 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:10:07.071131 27264 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:07.030517 30857 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.005s
I20260709 13:10:07.075430 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.075675 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1939) took 1567 ms. Trace:
I20260709 13:10:07.075893 27341 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.076979 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:07.080922 27343 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:07.080859 27338 rpcz_store.cc:276] 0709 13:10:05.508454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.907858 (+399404us) service_pool.cc:224] Handling call
0709 13:10:07.075504 (+1167646us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:07.075627 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62137088}
I20260709 13:10:07.024458 30759 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:07.067456 30865 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:06.931077 30813 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.080256 27417 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.084447 27259 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:07.025187 30763 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:07.077394 27264 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:07.082202 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:07.030067 28008 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:07.087050 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:07.062369 30839 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.076304 30841 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.049194 30849 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.043905 30770 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:07.146564 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64448.8us
I20260709 13:10:07.029606 30801 consensus_queue.cc:1243] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:07.084005 30661 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:07.159010 30851 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:10:07.167055 30661 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.167601 30661 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.167948 30851 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:07.168423 30851 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:07.169337 30851 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.171110 28008 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.172642 28008 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.156389 30718 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.174026 30763 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.084203 30857 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.156860 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.090368 30655 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:07.114699 30517 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:07.186348 30857 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:07.187090 27262 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:10:07.091459 30759 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.059756 30708 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:07.177361 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.187297 27259 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.187968 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.021071 30870 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.156780 30860 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:07.206633 27259 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:07.114328 27412 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:07.186771 30517 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.187232 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.208060 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.194041 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.209611 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:07.210592 27380 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.644s (SENT)
I20260709 13:10:07.087827 30680 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.114921 30697 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:10:07.199805 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 473) took 1070 ms. Trace:
W20260709 13:10:07.202827 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 357050us
I20260709 13:10:07.123837 27340 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:10:07.207772 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 120819us
W20260709 13:10:07.260880 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51352.2us
I20260709 13:10:07.166744 30841 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.214212 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:07.255817 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 298671us
I20260709 13:10:07.256618 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 480) took 1097 ms. Trace:
I20260709 13:10:07.256125 27260 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
W20260709 13:10:07.264117 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49065us
I20260709 13:10:07.263175 27334 rpcz_store.cc:276] 0709 13:10:06.159606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.776438 (+616832us) service_pool.cc:224] Handling call
0709 13:10:06.776781 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.068788 (+292007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.220293 (+151505us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540014b9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:07.256529 (+ 36236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":670215424}
I20260709 13:10:07.267306 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.260968 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:07.205266 30860 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.225796 27341 rpcz_store.cc:276] 0709 13:10:06.129508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.642390 (+512882us) service_pool.cc:224] Handling call
0709 13:10:07.075677 (+433287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.081035 (+  5358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.199552 (+118517us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b540032ffd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:07.199730 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857160960}
I20260709 13:10:07.261297 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:07.272838 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.274781 27264 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:07.288727 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:07.290266 30721 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:07.258239 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.708s (SENT) [suppressed 53 similar messages]
I20260709 13:10:07.215121 30517 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.216359 30851 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.288177 30900 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:07.292022 30900 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:07.292516 30900 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.292806 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.293571 27264 raft_consensus.cc:2393] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:07.265527 27259 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:07.297889 30891 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.263484 30655 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.263620 30857 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:07.275454 30801 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:07.266147 30861 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:07.401811 28015 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.403266 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.423444 27259 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:07.409294 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 120979us
I20260709 13:10:07.414394 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:07.403213 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:07.429683 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:07.313637 30860 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.282099 30862 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
W20260709 13:10:07.439121 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 420294us
I20260709 13:10:07.443571 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:07.306180 30729 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 13:10:07.430107 30868 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:07.473981 27259 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:07.474695 28006 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:07.425601 30839 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.467430 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:07.332850 30859 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:10:07.434682 30758 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.414062 30682 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:10:07.436125 30801 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:07.303117 30900 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.304309 30517 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.418661 30654 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:10:07.455446 30767 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:07.520771 30865 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.418946 30891 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:10:07.421314 30848 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:10:07.475713 30885 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.615s	user 0.015s	sys 0.008s
I20260709 13:10:07.431115 30760 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:10:07.427754 30857 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:07.522126 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 243108us
I20260709 13:10:07.527387 30800 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.424724 30655 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.430832 30888 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:10:07.482789 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.637472 27259 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:07.638458 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.639786 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.404502 30763 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.476802 30721 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.512440 30710 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.749s	user 0.012s	sys 0.008s
I20260709 13:10:07.654076 30710 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:07.557358 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.655550 27264 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:10:07.655967 27264 pending_rounds.cc:85] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:10:07.656193 27264 pending_rounds.cc:107] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:10:07.656445 27264 raft_consensus.cc:2889] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.658806 27411 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:07.660389 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:07.558214 30902 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:10:07.663643 30904 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:07.639359 30822 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:07.665355 30822 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:07.559381 30898 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:10:07.666323 30822 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.464783 30769 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:10:07.568063 30851 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:07.568794 30661 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.572315 28008 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:07.572418 30889 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.573467 30892 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.595757 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.604712 28011 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:10:07.602341 30759 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:07.669693 30851 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:07.670158 30851 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:07.670218 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.668918 30710 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.671221 30851 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.672039 30710 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.672647 30851 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:07.672578 30710 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.673718 30892 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:07.674733 30892 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.675915 30892 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.676229 30661 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.596387 30858 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.677132 28010 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:07.677278 30858 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:07.678778 30869 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:10:07.671329 30889 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.680148 30889 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.517620 30758 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.681432 30889 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.682988 30758 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.674886 30710 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:07.575143 30407 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.009s
I20260709 13:10:07.584497 30708 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.483659 30697 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 13:10:07.645239 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.645148 30850 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:07.641487 30800 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.584699 30813 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.649430 30865 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:07.635684 30885 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.650050 30655 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:07.598654 30868 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:07.651266 30767 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:07.651464 30857 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.652798 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.653034 30721 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.661151 27411 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.655593 30882 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:07.558851 30899 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 13:10:07.607337 30890 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:07.675792 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.678222 30858 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.607497 27163 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.645769 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:07.693372 27413 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.599155 30900 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:07.582084 30680 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:07.487100 30839 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.604373 30517 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:07.702903 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 276865us
I20260709 13:10:07.718096 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.727348 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.788981 27417 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.728878 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.729614 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:07.735610 30837 consensus_meta.cc:287] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.002s
I20260709 13:10:07.740974 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:07.742082 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.790473 27410 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.791756 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:07.728463 30901 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:10:07.689827 30797 consensus_queue.cc:1175] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "203d83f7fac847e0beee51aa18513b25" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:10:07.807646 27336 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:07.583981 30801 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.766382 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:07.767205 27335 raft_consensus.cc:606] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:07.814119 27335 raft_consensus.cc:614] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:07.769368 30655 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.787681 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 142013us
I20260709 13:10:07.769084 30882 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:07.739295 30850 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:07.797533 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:07.798080 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:07.798185 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 330817us
I20260709 13:10:07.826619 27341 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:07.799736 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.800715 27340 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:07.827113 27334 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:07.802597 27343 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:07.804361 27338 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:10:07.804873 30857 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:07.806203 27339 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.711597 30682 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:10:07.809413 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.811125 27342 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:07.832683 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.732951 30710 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:10:07.836328 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.811873 30858 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:07.847704 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.733174 30861 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:07.747233 30868 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.788473 30890 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.829639 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.830327 27337 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:07.830036 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 63774.3us
I20260709 13:10:07.865653 27339 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.793628 30869 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.839300 30857 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:07.869505 30907 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:10:07.834028 27342 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:07.746706 30767 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.841024 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:07.842741 27264 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.843698 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.843854 27266 raft_consensus.cc:1217] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-8.5]   Dedup: 5.4->[8.5-8.5]
I20260709 13:10:07.872725 27266 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [3.3-8.5]
I20260709 13:10:07.872848 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.873530 27264 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.873847 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.870546 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:07.824998 30729 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:07.743639 30865 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.833088 27336 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:07.808698 30870 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.769569 30895 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:10:07.881758 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.898376 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.899747 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:07.852171 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.853057 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:07.854251 27338 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:07.855137 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.794127 30813 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:10:07.829476 30655 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.856559 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:07.917672 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61194.7us
I20260709 13:10:07.918370 27342 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 7: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:07.857718 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:07.828536 27263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.003s	sys 0.020s
I20260709 13:10:07.858431 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.862386 27334 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:07.855417 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:07.934478 27263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.004s	sys 0.023s
I20260709 13:10:07.863847 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:07.864733 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.829466 30900 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.935766 27340 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:07.934973 27343 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:07.844403 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:07.877164 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.937768 27259 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:07.938726 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:07.940176 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:07.941162 30911 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:10:07.941512 30900 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.880043 30882 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.942790 27259 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:07.812153 30837 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:07.880044 30682 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:07.881047 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.946420 27417 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:07.946689 27337 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 12 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:07.904408 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.888224 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.855911 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:07.907275 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.947374 27338 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:07.866178 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:07.866080 30654 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.929461 30890 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.878073 30888 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:10:07.931301 30891 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:10:07.888588 30906 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:10:07.919219 28013 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:10:07.934158 27261 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.874986 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:07.947554 27336 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:07.886200 27339 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:07.948573 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.980547 27338 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:07.953223 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.955680 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.956199 27335 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:07.956962 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:07.945739 30655 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.908123 30895 consensus_queue.cc:1243] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:10:07.925565 30855 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:07.947103 30680 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.981383 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:07.977550 27266 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:07.906276 30836 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:10:07.994809 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.995409 27266 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:07.995663 27337 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:07.984931 27265 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:07.948770 30661 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:07.961946 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:07.992878 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:07.880396 30917 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:10:07.905616 30758 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:10:08.003998 27335 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:08.011022 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 75487.3us
I20260709 13:10:08.013631 27410 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:07.976179 30891 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.975641 30682 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:07.887509 30767 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.006464 30857 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:07.948974 30850 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.006024 30859 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:08.011590 30661 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.012125 30710 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:07.969409 30654 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:07.990341 30517 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:08.021929 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:08.028360 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 184044us
I20260709 13:10:08.050796 27261 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:08.021112 27342 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:08.081718 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:08.083088 27342 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.084565 27342 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:08.029956 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:08.042308 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.069870 27336 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:08.078452 27341 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:08.093818 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:08.078327 30841 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.799s	user 0.010s	sys 0.003s
I20260709 13:10:08.102876 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:08.048717 30770 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.844s	user 0.004s	sys 0.007s
I20260709 13:10:08.109400 27261 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:08.014117 30813 consensus_queue.cc:1243] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:08.048139 30721 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:08.126559 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.045677 30925 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:08.047948 30859 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:08.023010 30697 raft_consensus.cc:2764] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:08.053707 30661 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:08.089985 30839 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.100183 30930 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.100471 30916 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:08.127918 30841 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.108614 30934 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:08.145964 27261 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:08.149518 27267 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:08.154898 27231 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:10:08.175135 27231 leader_election.cc:403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:08.158193 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 282547us
I20260709 13:10:08.012753 30861 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.102492 30942 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.173606 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 309818us
I20260709 13:10:08.198282 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:08.188649 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.158896 27411 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:08.202979 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:08.206794 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 52048.1us
I20260709 13:10:08.210070 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:08.147153 30718 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.973s	user 0.007s	sys 0.012s
I20260709 13:10:08.080659 30710 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:08.146509 30915 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:10:08.144997 30931 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:10:08.207468 30920 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
I20260709 13:10:08.133589 30926 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.240837 27341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:08.282806 27341 raft_consensus.cc:606] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:08.283224 27341 raft_consensus.cc:614] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:08.149585 30654 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.150099 30916 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:08.153156 30841 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.154422 30900 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.225571 30758 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:08.261677 30710 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.146523 30859 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.211611 30729 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:08.263438 30943 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:10:08.265057 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 62194.1us
I20260709 13:10:08.261356 30661 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.125880 30770 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.402236 30770 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.371366 30758 consensus_queue.cc:1243] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:08.403321 30764 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.404732 30929 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.288484 30926 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.158576 30852 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:08.407565 30852 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:08.230473 30892 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.287675 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:08.293529 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 263667us
I20260709 13:10:08.240603 30865 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:08.240559 30718 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:08.225368 30760 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:10:08.226337 30895 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:08.281635 30813 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.226019 30917 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:10:08.103044 30891 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.304692 27264 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:08.231793 30759 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 13:10:08.306499 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 203714us
W20260709 13:10:08.306959 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 92227.1us
I20260709 13:10:08.310881 27341 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:10:08.305478 30889 consensus_meta.cc:287] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.000s
I20260709 13:10:08.375581 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 577) took 1121 ms. Trace:
I20260709 13:10:08.147610 30925 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.228116 30942 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:08.399837 30940 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:10:08.306201 30841 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:08.212970 30682 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.409533 27262 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:08.510456 30839 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
W20260709 13:10:08.408448 30860 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.943s	user 0.011s	sys 0.002s
I20260709 13:10:08.511597 27341 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:08.511900 30918 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.285s
I20260709 13:10:08.512259 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2262) took 1470 ms. Trace:
I20260709 13:10:08.512022 30860 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.513753 30941 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.512743 27263 rpcz_store.cc:276] 0709 13:10:07.041766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.066624 (+ 24858us) service_pool.cc:224] Handling call
0709 13:10:07.066893 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.943383 (+876490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.943414 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.944020 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.044517 (+100497us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:08.044586 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.044715 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.512092 (+467377us) raft_consensus.cc:1685] finished
0709 13:10:08.512111 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.512207 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23363,"raft.queue_time_us":22128,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":39246,"thread_start_us":952406,"threads_started":2,"wal-append.queue_time_us":229533}
I20260709 13:10:08.468690 30859 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.514694 30860 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:08.409176 28013 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:08.515209 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:08.510577 30910 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.217s
W20260709 13:10:08.576447 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 288822us
I20260709 13:10:08.584633 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:08.575132 30926 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.512972 27341 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:10:08.586627 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.008s
W20260709 13:10:08.583647 27413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.000s	sys 0.007s
W20260709 13:10:08.588003 27413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.001s	sys 0.008s
W20260709 13:10:08.589740 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.409577 30849 consensus_meta.cc:287] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.205s	user 0.011s	sys 0.005s
I20260709 13:10:08.509686 28007 rpcz_store.cc:276] 0709 13:10:07.254731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.255358 (+   627us) service_pool.cc:224] Handling call
0709 13:10:07.270621 (+ 15263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.273313 (+  2692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.273342 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.305948 (+ 32606us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.746081 (+440133us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:07.746118 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.746177 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.375361 (+629184us) raft_consensus.cc:1685] finished
0709 13:10:08.375384 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.375520 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2315,"raft.queue_time_us":2433,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":53816,"thread_start_us":291139,"threads_started":1,"wal-append.queue_time_us":393875}
W20260709 13:10:08.587074 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.000s	sys 0.008s
I20260709 13:10:08.511267 30939 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:08.586881 30848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.006s
I20260709 13:10:08.408509 30852 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.609638 28008 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:08.614435 27341 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:08.613552 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 98468.4us
I20260709 13:10:08.633198 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:08.590667 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.485049 30888 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.607210 30759 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:08.580214 30892 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:08.614602 30848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.008s
I20260709 13:10:08.605655 30930 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.588685 30841 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:08.661883 30954 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:10:08.658072 30850 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:08.748822 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 230572us
I20260709 13:10:08.608791 30849 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.484722 30916 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.714023 30862 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.765277 30948 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:08.764295 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 131195us
W20260709 13:10:08.769625 30951 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:10:08.770823 30944 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:08.771705 30952 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:10:08.771518 30944 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.772526 30841 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:08.766309 30953 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:08.773589 30942 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.774078 30944 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:08.774418 30925 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.759268 30850 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.777762 30850 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.752611 30848 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:08.782655 30892 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.783485 28009 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:08.783896 30858 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.000s
I20260709 13:10:08.784659 30862 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.785413 30849 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.759755 30860 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:08.787139 30862 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.666600 30888 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.794107 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:08.785132 30885 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:08.747824 30889 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:08.797806 27382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.012s
W20260709 13:10:08.798623 27382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.011s	sys 0.012s
W20260709 13:10:08.799445 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.799937 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.800925 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.804354 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.806493 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.807150 27412 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 4.
I20260709 13:10:08.811136 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:08.812966 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.814028 27412 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:10:08.815663 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.698565 30759 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.847458 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:08.847635 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:08.758216 30868 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.003s
I20260709 13:10:08.850895 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.862073 27415 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:08.858551 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:08.759454 30939 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:08.864082 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.765870 30948 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.900426 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:08.861663 30848 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:08.905085 30885 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:08.910046 30927 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.964s	user 0.006s	sys 0.000s
I20260709 13:10:08.911095 30759 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:08.900933 30934 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.670s	user 0.008s	sys 0.006s
I20260709 13:10:08.864082 30721 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.890053 30850 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.919332 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:08.890589 30680 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.943948 30680 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.890892 30860 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:08.920892 30800 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:08.927760 30888 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:08.947062 30860 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.928272 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2258) took 1887 ms. Trace:
I20260709 13:10:08.929332 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.950739 27412 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:08.900568 30895 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.832659 30801 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:10:08.857120 30892 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:10:08.950449 27268 rpcz_store.cc:276] 0709 13:10:07.040608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.040775 (+   167us) service_pool.cc:224] Handling call
0709 13:10:07.041070 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:07.401386 (+360316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.401420 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:07.424030 (+ 22610us) log.cc:844] Serialized 52 byte log entry
0709 13:10:07.791614 (+367584us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:07.791898 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.792099 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.792172 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.909210 (+1117038us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:08.927909 (+ 18699us) raft_consensus.cc:1685] finished
0709 13:10:08.928025 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.928200 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62583,"prepare.queue_time_us":1193,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":45512,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":14289,"spinlock_wait_cycles":47511936,"thread_start_us":544527,"threads_started":2,"wal-append.queue_time_us":425113}
I20260709 13:10:08.958880 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2274) took 1146 ms. Trace:
I20260709 13:10:08.862531 30868 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.939412 30934 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:08.959508 27261 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:08.938407 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.985117 27261 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:08.959399 27343 rpcz_store.cc:276] 0709 13:10:07.812336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.833648 (+ 21312us) service_pool.cc:224] Handling call
0709 13:10:07.934652 (+101004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:07.937207 (+  2555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.958619 (+1021412us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002887d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:08.958796 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231672704}
I20260709 13:10:08.904033 30729 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:10:08.893380 30889 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:08.922920 30900 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:08.954665 30851 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.281s	user 0.011s	sys 0.004s
W20260709 13:10:08.989123 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 404586us
I20260709 13:10:08.984359 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:08.988288 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69044.5us
I20260709 13:10:09.002069 27413 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:08.996428 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:08.980798 30767 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:08.955155 30885 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:08.952337 30850 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:08.979339 30655 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:09.010901 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.021s	sys 0.025s
I20260709 13:10:09.010460 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:09.003836 27338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.041s	sys 0.059s
W20260709 13:10:09.033864 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.021s	sys 0.025s
W20260709 13:10:09.034018 27338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.046s	sys 0.060s
W20260709 13:10:09.016881 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.013s	sys 0.033s
I20260709 13:10:09.004949 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.018263 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.035621 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.036214 27412 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:08.973670 30948 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.037038 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:09.038620 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.013s	sys 0.034s
I20260709 13:10:08.992133 27261 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.039623 27261 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:09.029071 30885 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.955904 30895 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.042165 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:09.044176 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:09.047084 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:09.050710 28010 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:09.028757 30851 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:09.046278 30885 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.054028 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:09.056291 27416 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:09.033557 30655 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:09.040624 30759 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.046309 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:09.059813 30680 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.062568 28008 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:09.062497 30922 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.052042 30861 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.063581 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:09.065042 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.004280 30848 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.064335 30922 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.072793 30955 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:09.072877 30925 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:09.073338 30955 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.073452 30868 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.073752 30955 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.053186 30851 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.072093 30797 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:10:09.075347 30797 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:09.075404 30895 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:09.075773 30797 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:09.075592 30655 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.061717 30759 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.078881 27261 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:09.080157 30759 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:09.082784 30909 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:10:09.070924 30861 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.001168 30939 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.087682 27408 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:09.071924 30970 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:10:09.092051 30758 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.086182 30925 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:10:09.094558 30850 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.092583 30758 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.095523 30889 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.097172 30758 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.097318 30922 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:09.109956 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.112211 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.113065 27264 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:09.114172 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.115026 27264 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:09.116426 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.117210 27265 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.118630 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.119800 27268 raft_consensus.cc:2410] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 3.
I20260709 13:10:09.161392 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.129343 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.131458 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.164973 27268 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:09.168033 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.174271 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.177132 27268 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:09.100663 30947 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.192049 30947 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.195873 30801 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.196709 30801 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.200372 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.201710 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.202782 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.181660 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.205320 27263 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:09.212715 27264 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:09.102058 30861 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.186318 30900 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.186800 30934 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.184279 30892 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.183555 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.224555 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.241057 27266 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 7: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:09.240844 27259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.001s	sys 0.041s
I20260709 13:10:09.228449 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:09.241748 27259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.001s	sys 0.042s
I20260709 13:10:09.227532 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.161154 30896 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:09.251737 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.104532 30758 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.231319 30800 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.233446 27336 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:09.235805 30941 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.115723 30850 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.236135 27414 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:10:09.238081 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.238282 27265 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:09.210601 30947 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.229049 30889 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:09.245946 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:09.249446 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.230290 27341 pending_rounds.cc:85] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:10:09.115507 30948 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.305508 30948 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.203311 30895 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:10:09.258899 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:09.310828 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.255873 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.242969 30934 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.239926 30900 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:09.310009 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 64150.2us
I20260709 13:10:09.312456 27268 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.317682 27268 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:09.318071 27233 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8.
I20260709 13:10:09.256167 30758 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.244894 30892 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.260738 30800 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.325997 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:09.326224 30800 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.326586 27340 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.258626 30885 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.328672 27342 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:09.329080 27342 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:09.315805 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.302381 27341 pending_rounds.cc:107] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:09.324167 30892 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:09.330343 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.331732 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:09.318629 27268 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.348594 27268 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.345726 27341 raft_consensus.cc:2889] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.319700 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:09.356318 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.359023 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:09.345511 27337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.013s	sys 0.050s
W20260709 13:10:09.361743 27337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.013s	sys 0.051s
I20260709 13:10:09.329824 27342 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.283686 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.365422 27342 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.313668 30947 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:09.263546 30859 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.004s
I20260709 13:10:09.275018 30941 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:09.381155 27161 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 212) took 23042 ms (client timeout 15000 ms). Trace:
I20260709 13:10:09.304119 30850 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.330325 30885 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.377660 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.384397 27336 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:09.324167 30758 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:09.373543 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 479204us
I20260709 13:10:09.364840 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:09.369910 27265 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:09.389876 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:09.391327 27380 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.708s (SENT)
I20260709 13:10:09.371240 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:09.392405 30892 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:09.392547 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.886s (SENT)
I20260709 13:10:09.393868 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:09.381754 27161 rpcz_store.cc:269] 0709 13:09:46.339218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.352645 (+ 13427us) service_pool.cc:224] Handling call
0709 13:10:09.381062 (+23028417us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:02.167019 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:02.184288 (+ 17269us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:02.184339 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:10:02.184359 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:02.242116 (+ 57757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:02.242212 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:02.242241 (+    29us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:10:02.246452 (+  4211us) tablet.cc:701] Row locks acquired
0709 13:10:02.246492 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:10:02.246651 (+   159us) write_op.cc:270] Start()
0709 13:10:02.246806 (+   155us) write_op.cc:276] Timestamp: P: 1783602602246594 usec, L: 0
0709 13:10:02.246834 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:10:02.247546 (+   712us) log.cc:844] Serialized 7152 byte log entry
0709 13:10:03.983989 (+1736443us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:04.149728 (+165739us) op_driver.cc:464] REPLICATION: finished
0709 13:10:04.212361 (+ 62633us) write_op.cc:301] APPLY: starting
0709 13:10:04.212452 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:04.212851 (+   399us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:04.212890 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:04.218471 (+  5581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:04.218923 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:10:04.218997 (+    74us) write_op.cc:312] APPLY: finished
0709 13:10:04.339121 (+120124us) log.cc:844] Serialized 125 byte log entry
0709 13:10:04.359480 (+ 20359us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:04.385924 (+ 26444us) write_op.cc:454] Released schema lock
0709 13:10:04.387743 (+  1819us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:04.461992 (+ 74249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:04.471506 (+  9514us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4223542,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":62336,"apply.run_cpu_time_us":8992,"apply.run_wall_time_us":208813,"num_ops":18,"prepare.queue_time_us":309016,"prepare.run_cpu_time_us":32351,"prepare.run_wall_time_us":871295,"raft.queue_time_us":21793,"raft.run_cpu_time_us":12602,"raft.run_wall_time_us":58064,"replication_time_us":1902773,"spinlock_wait_cycles":44647680,"thread_start_us":1074241,"threads_started":4,"wal-append.queue_time_us":809352,"wal-append.run_cpu_time_us":18080,"wal-append.run_wall_time_us":2386766}]]}
I20260709 13:10:09.322476 30801 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.394636 27268 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:09.404320 27268 pending_rounds.cc:85] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:10:09.404714 27268 pending_rounds.cc:107] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:09.405035 27268 raft_consensus.cc:2889] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.399856 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:09.375480 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2282) took 1557 ms. Trace:
I20260709 13:10:09.363224 30910 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.401590 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:09.405530 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.444496 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.505822 27265 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:10:09.459681 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.506032 27268 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:09.507139 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:09.379887 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 450040us
I20260709 13:10:09.255812 30896 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.438761 27342 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:09.519532 27342 pending_rounds.cc:85] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 4
I20260709 13:10:09.394141 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.376209 30888 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.368237 30769 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.384016 30800 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.066s
W20260709 13:10:09.501753 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 100283us
I20260709 13:10:09.401506 30758 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.406927 27340 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:09.525942 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.527014 27340 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:09.527962 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.528604 27340 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:09.407047 30934 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:09.456547 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.442001 28012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.020s	sys 0.017s
I20260709 13:10:09.377911 30973 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.377665 30710 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.368315 30965 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:09.496968 27337 rpcz_store.cc:276] 0709 13:10:07.817641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.996467 (+178826us) service_pool.cc:224] Handling call
0709 13:10:07.996806 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.192624 (+195818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.192672 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.193397 (+   725us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.515811 (+322414us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.373956 (+858145us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.375069 (+  1113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.375190 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.375244 (+    54us) raft_consensus.cc:1685] finished
0709 13:10:09.375259 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.375408 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162,"prepare.queue_time_us":163101,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":5326,"raft.queue_time_us":209627,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":18413,"thread_start_us":1291517,"threads_started":3,"wal-append.queue_time_us":659060}
I20260709 13:10:09.564114 27337 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:09.376039 30947 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:09.497869 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 99617.9us
W20260709 13:10:09.398912 30914 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.030s	sys 0.016s
I20260709 13:10:09.444834 27163 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 9 to 11, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.520022 27342 pending_rounds.cc:107] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:09.396924 30925 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.442322 30885 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.606602 30885 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.607067 30885 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:09.375826 30930 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:10:09.530836 30758 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.616676 30758 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.533506 27343 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:09.533872 28012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.022s	sys 0.018s
W20260709 13:10:09.472339 27334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.034s
W20260709 13:10:09.533520 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.624002 27334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.013s	sys 0.034s
W20260709 13:10:09.624215 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.625999 30729 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.626531 30697 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:09.626727 30889 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:09.627964 30729 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:09.628486 30729 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:09.629335 30729 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.511032 30910 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.630412 30910 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:09.630803 30910 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.631718 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2268) took 2587 ms. Trace:
I20260709 13:10:09.632099 27262 rpcz_store.cc:276] 0709 13:10:07.044569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.202437 (+157868us) service_pool.cc:224] Handling call
0709 13:10:07.202771 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.510428 (+1307657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.631464 (+1121036us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000b86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:09.631657 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2774913280}
I20260709 13:10:09.535910 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:09.607004 30896 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:09.635530 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 100006us
I20260709 13:10:09.636066 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2286) took 1702 ms. Trace:
I20260709 13:10:09.636241 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:09.636462 27261 rpcz_store.cc:276] 0709 13:10:07.933547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.225677 (+292130us) service_pool.cc:224] Handling call
0709 13:10:08.258657 (+ 32980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.079494 (+820837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.635847 (+556353us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001d97d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:09.636013 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611477888}
W20260709 13:10:09.638263 27260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1389) took 2224 ms (client timeout 2502 ms). Trace:
W20260709 13:10:09.537467 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:09.638667 27260 rpcz_store.cc:269] 0709 13:10:07.413405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.669877 (+256472us) service_pool.cc:224] Handling call
0709 13:10:09.638090 (+1968213us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b540031e7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:09.638209 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154508672}
I20260709 13:10:09.638983 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:09.525391 30860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.017s	sys 0.020s
W20260709 13:10:09.640095 30860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.017s	sys 0.020s
I20260709 13:10:09.539237 27340 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:10:09.641180 30800 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:09.641595 30800 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.519263 30813 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.641932 30800 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:09.642452 30813 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.636235 30896 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:09.645546 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.535701 30934 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.646459 30934 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:09.647749 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:09.649668 30934 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.646032 30896 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.650149 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:09.650425 30896 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.651566 30869 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:09.652139 30869 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.653371 27409 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:10:09.659668 27343 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:09.524586 30888 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.587498 27342 raft_consensus.cc:2889] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:09.344774 30918 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:09.603449 30948 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.518584 30868 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:09.684327 30868 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.684805 30868 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:09.627911 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 454) took 1793 ms. Trace:
I20260709 13:10:09.685349 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 584) took 1504 ms. Trace:
I20260709 13:10:09.519465 30801 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:09.688711 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49841.5us
I20260709 13:10:09.685302 28010 rpcz_store.cc:276] 0709 13:10:07.834850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.835027 (+   177us) service_pool.cc:224] Handling call
0709 13:10:09.627749 (+1792722us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400492fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:09.627853 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442763008}
I20260709 13:10:09.661594 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2287) took 1827 ms. Trace:
I20260709 13:10:09.641917 27260 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:09.691977 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.668253 27262 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:09.670867 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:09.645609 30813 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.676276 27163 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 7, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.679319 30760 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.673874 30934 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.679888 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:09.670456 30910 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.683774 30869 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:09.684460 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:09.600836 30914 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.030s	sys 0.024s
I20260709 13:10:09.686798 27411 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:09.562955 30965 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:09.685940 28009 rpcz_store.cc:276] 0709 13:10:08.180819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.181159 (+   340us) service_pool.cc:224] Handling call
0709 13:10:08.181630 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:08.783890 (+602260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.685108 (+901218us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54007f0dd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:09.685287 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383668608}
I20260709 13:10:09.570585 30947 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:09.560176 27415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.010s	sys 0.004s
W20260709 13:10:09.717381 27415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.010s	sys 0.004s
I20260709 13:10:09.689870 27342 rpcz_store.cc:276] 0709 13:10:07.834069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.085416 (+251347us) service_pool.cc:224] Handling call
0709 13:10:08.085729 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.328575 (+1242846us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b54000652a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82ba8dc0 00007fbd82c331c0 00007fbd82c34231 00007fbd82c30d8f 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c
0709 13:10:09.661087 (+332512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.661514 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95558400}
W20260709 13:10:09.698392 30983 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:10:09.695315 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.719978 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2287) took 1785 ms. Trace:
I20260709 13:10:09.723284 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.724594 27262 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:09.725823 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.712126 30760 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.699421 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:09.674381 30935 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:09.659026 30900 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.674561 30860 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.686507 30969 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:10:09.716370 27416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.017s
I20260709 13:10:09.569730 30892 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:10:09.718727 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.651039 27417 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:09.548379 30973 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.752732 27262 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:10:09.720934 30759 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 13:10:09.835987 30759 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:09.755386 27416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.017s
I20260709 13:10:09.758292 27163 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:09.823593 27267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.026s	sys 0.072s
I20260709 13:10:09.707769 30896 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.732683 30801 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.717918 30948 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.763144 27342 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
W20260709 13:10:09.834283 27339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.021s	sys 0.054s
W20260709 13:10:09.715801 30939 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.002s	sys 0.015s
W20260709 13:10:09.838707 27267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.031s	sys 0.073s
I20260709 13:10:09.734747 30850 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.844695 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:09.856537 27342 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:09.857894 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:09.858284 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.858626 27342 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
W20260709 13:10:09.844698 27339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.021s	sys 0.054s
I20260709 13:10:09.860968 27163 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 4 to 7, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.859822 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:09.845984 30861 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.614s	user 0.013s	sys 0.008s
I20260709 13:10:09.715858 30934 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:09.853413 30939 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.005s	sys 0.015s
W20260709 13:10:09.846415 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 456584us
I20260709 13:10:09.876336 30939 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.876879 30939 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.877303 30882 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.879348 30939 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.881441 30861 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.837415 27262 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:09.884123 30861 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.867869 27163 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 6, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 6 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:09.885396 27163 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:09.722297 27259 rpcz_store.cc:276] 0709 13:10:07.934628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.410024 (+475396us) service_pool.cc:224] Handling call
0709 13:10:08.410433 (+   409us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:08.447967 (+ 37534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.448013 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:08.478225 (+ 30212us) log.cc:844] Serialized 78 byte log entry
0709 13:10:09.242239 (+764014us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:09.691322 (+449083us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.719031 (+ 27709us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.719365 (+   334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.719640 (+   275us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.719701 (+    61us) raft_consensus.cc:1685] finished
0709 13:10:09.719716 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.719904 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18088,"raft.queue_time_us":30752,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":44754,"thread_start_us":1093242,"threads_started":2,"wal-append.queue_time_us":1017116}
I20260709 13:10:09.837195 30973 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:09.756433 30941 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:09.900816 30896 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.892758 30760 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:09.901957 30764 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:09.897950 27163 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 7, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.902385 30764 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:09.902762 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2280) took 2085 ms. Trace:
I20260709 13:10:09.900533 30661 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.897799 30797 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.845770 30801 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.903211 27338 rpcz_store.cc:276] 0709 13:10:07.817061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.984453 (+167392us) service_pool.cc:224] Handling call
0709 13:10:07.984837 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.292967 (+308130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.293006 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.299637 (+  6631us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.034363 (+734726us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:09.054550 (+ 20187us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.054792 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.054890 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.902547 (+847657us) raft_consensus.cc:1685] finished
0709 13:10:09.902568 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:09.902696 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51913,"prepare.queue_time_us":20001,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":1240,"raft.queue_time_us":141123,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":67871,"spinlock_wait_cycles":1380608,"thread_start_us":933108,"threads_started":2,"wal-append.queue_time_us":998129}
I20260709 13:10:09.900650 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:09.919775 27338 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:09.922503 27338 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:09.926198 27338 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:09.825887 30860 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.928481 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:09.986647 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.981536 27259 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
W20260709 13:10:09.913133 30767 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.004s
I20260709 13:10:09.989048 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:09.989360 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:09.990523 27259 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.919217 30801 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.906620 30797 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:09.965888 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.995308 27410 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:09.858817 30948 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.917806 30896 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:09.917768 30850 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:09.990118 30987 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:09.985167 30941 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.984211 30934 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:09.980537 30758 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:09.866035 30965 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:09.908000 30885 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:09.903507 30764 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.018085 28011 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:09.992972 30892 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:09.999444 30759 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.007249 30895 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.984129 30929 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:10:10.032097 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2281) took 2214 ms. Trace:
I20260709 13:10:09.991087 30839 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:10:10.028267 27265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.044s
W20260709 13:10:10.058576 27265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.000s	sys 0.044s
I20260709 13:10:10.060766 27336 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:10.062062 27259 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:10.058425 27334 rpcz_store.cc:276] 0709 13:10:07.817377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.987625 (+170248us) service_pool.cc:224] Handling call
0709 13:10:07.987975 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.070833 (+ 82858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.070869 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.090862 (+ 19993us) log.cc:844] Serialized 26 byte log entry
0709 13:10:08.950100 (+859238us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180045ca60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:09.624604 (+674504us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:09.625007 (+   403us) log.cc:844] Serialized 14 byte log entry
0709 13:10:09.625267 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.625373 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:09.886240 (+260867us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:10.031878 (+145638us) raft_consensus.cc:1685] finished
0709 13:10:10.031901 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.032037 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40177,"prepare.queue_time_us":3847,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":177230,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":54213,"spinlock_wait_cycles":35808896,"thread_start_us":756682,"threads_started":2,"wal-append.queue_time_us":1597643}
I20260709 13:10:10.064030 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:10.035359 30862 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.035782 30888 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:10.068169 30934 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:10.071696 30852 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:10.025204 30941 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.013049 30896 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.020022 30850 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.047423 30892 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.032763 30758 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.087272 27338 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:10.089847 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.091503 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.092994 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.107512 28007 raft_consensus.cc:2368] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9.
I20260709 13:10:10.093815 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.094211 28006 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:10.096738 30934 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:10.083886 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:10.054621 30764 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.111032 28014 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:10.111235 27231 leader_election.cc:400] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9.
I20260709 13:10:10.111681 27231 leader_election.cc:403] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:10.106814 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.113974 28009 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:10.101286 27306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.011s	sys 0.052s
W20260709 13:10:10.116197 27306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.052s
I20260709 13:10:10.072618 30851 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.056740 30965 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.107512 27341 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:10.056272 30910 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.122361 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.079501 30862 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.123809 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.125131 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.126349 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.093712 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.130983 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.131779 27338 raft_consensus.cc:2376] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8. Re-sending same reply.
I20260709 13:10:10.132810 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.134073 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.135074 27341 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:10.109714 27307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.022s
I20260709 13:10:10.115725 27334 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:10:10.136041 27307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.002s	sys 0.022s
I20260709 13:10:10.061482 30800 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.136888 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.105062 30892 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.063016 30895 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.140760 27338 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:10.086432 30837 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.138767 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:10.139947 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.154608 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.153311 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.156787 27338 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:10.157883 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 495) took 1052 ms. Trace:
I20260709 13:10:10.158063 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.158447 27267 rpcz_store.cc:276] 0709 13:10:09.105138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.105291 (+   153us) service_pool.cc:224] Handling call
0709 13:10:09.179412 (+ 74121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.179845 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.179885 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.180431 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.853547 (+673116us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:09.853594 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.853662 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.157624 (+303962us) raft_consensus.cc:1685] finished
0709 13:10:10.157655 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.157811 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":1986,"thread_start_us":600326,"threads_started":1,"wal-append.queue_time_us":794444}
I20260709 13:10:10.159024 27338 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:10.128652 30759 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9.
W20260709 13:10:10.146057 30848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.027s	sys 0.052s
W20260709 13:10:10.184469 30994 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:10.188687 30758 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.192112 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:10.196444 27263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.012s	sys 0.021s
W20260709 13:10:10.198004 27263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.013s	sys 0.021s
I20260709 13:10:10.204526 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.205946 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:10.190785 30848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.027s	sys 0.052s
I20260709 13:10:10.210392 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.181727 30890 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.178720 30929 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.181329 30721 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:10.219628 27338 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:10.216835 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:10.220438 27335 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.019s
W20260709 13:10:10.220095 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.002s	sys 0.033s
W20260709 13:10:10.220566 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.222643 27335 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.015s	sys 0.019s
W20260709 13:10:10.224314 27340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.008s	sys 0.020s
W20260709 13:10:10.223560 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.002s	sys 0.033s
W20260709 13:10:10.225327 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 598970us
I20260709 13:10:10.201838 30758 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.200413 30860 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.231021 28010 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:10:10.231509 27381 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.014s	sys 0.013s
W20260709 13:10:10.231916 27381 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.013s
W20260709 13:10:10.224730 27340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.008s	sys 0.020s
I20260709 13:10:10.223615 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.239043 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:10.248373 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.222445 30917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.017s
I20260709 13:10:10.218093 30837 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:10.260000 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2284) took 2441 ms. Trace:
I20260709 13:10:10.262354 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.215691 30910 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.217768 30839 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.220175 30929 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:10.267347 30930 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.279428 30929 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.279704 30930 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:10.280144 30930 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:10.282467 27981 connection.cc:256] RPC call timeout handler was delayed by -1.0597318879999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260709 13:10:10.283562 30998 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.283785 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.284289 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 508) took 1423 ms. Trace:
I20260709 13:10:10.284121 30998 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.284991 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:10.270303 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.286070 30813 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:10.286374 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.286772 30813 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.272034 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.221832 30890 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.287372 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.287591 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:10.271588 27414 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:10.262487 27335 rpcz_store.cc:276] 0709 13:10:07.818145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.042388 (+224243us) service_pool.cc:224] Handling call
0709 13:10:08.054157 (+ 11769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.232279 (+178122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.232313 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.232827 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.327483 (+1094656us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b180032da60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:09.573641 (+246158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:09.603644 (+ 30003us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.224529 (+620885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.227041 (+  2512us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.227120 (+    79us) raft_consensus.cc:1685] finished
0709 13:10:10.259741 (+ 32621us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.259936 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27153,"prepare.queue_time_us":32373,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":175335,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":12544,"spinlock_wait_cycles":13090176,"thread_start_us":1043245,"threads_started":3,"wal-append.queue_time_us":1354130}
I20260709 13:10:10.288748 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:10.289031 30890 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.271541 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.289338 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.289661 27412 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:10.289762 27417 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.290459 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.291844 30973 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.292667 30862 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:10.278880 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.277086 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.295007 30697 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.295367 30813 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:10.296392 30813 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.296824 30697 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.297286 30697 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:10.276539 30837 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:10.289885 27335 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.292742 30973 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:10.300302 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:10.275852 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.298785 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.287652 27408 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:10.350441 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:10.350471 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50286.1us
I20260709 13:10:10.359637 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.361543 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.361711 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.297657 30697 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:10.259631 30917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.017s
I20260709 13:10:10.228672 30997 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.373441 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.375134 28015 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:10.368583 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.005s	sys 0.012s
I20260709 13:10:10.309784 27417 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:10:10.377811 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.005s	sys 0.012s
I20260709 13:10:10.284657 27411 rpcz_store.cc:276] 0709 13:10:08.860902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.861014 (+   112us) service_pool.cc:224] Handling call
0709 13:10:09.686600 (+825586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.716229 (+ 29629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.284098 (+567869us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540027cc50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:10.284229 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1808698240}
I20260709 13:10:10.259914 30859 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:10.391219 27342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.017s	sys 0.010s
W20260709 13:10:10.391681 27342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.018s	sys 0.010s
I20260709 13:10:10.394752 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.395639 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.396662 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.266093 30948 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.345466 30909 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.286330 30998 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.370814 30910 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:10.401136 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.012s	sys 0.011s
I20260709 13:10:10.229606 30721 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.264317 30767 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.135s
I20260709 13:10:10.298600 30760 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:10:10.220963 30934 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.408844 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2294) took 1183 ms. Trace:
I20260709 13:10:10.415431 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.454715 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.426409 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.425688 27335 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:10.402935 30860 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:10.409960 30909 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.405951 30910 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.406423 30858 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.402907 30718 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:10.417670 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.479439 27411 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:10.426412 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.400938 30917 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:10.449905 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.456671 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.483850 27338 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.483946 27335 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
W20260709 13:10:10.411672 27266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.004s	sys 0.015s
I20260709 13:10:10.414335 31005 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:10.453801 27339 rpcz_store.cc:276] 0709 13:10:09.225359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.229059 (+  3700us) service_pool.cc:224] Handling call
0709 13:10:09.229428 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.234062 (+  4634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.234120 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.239737 (+  5617us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.860578 (+620841us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.369527 (+508949us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.408349 (+ 38822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.408501 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.408604 (+   103us) raft_consensus.cc:1685] finished
0709 13:10:10.408624 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.408795 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49196,"prepare.queue_time_us":36786,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":45790,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":7779,"thread_start_us":1089220,"threads_started":2,"wal-append.queue_time_us":760687}
I20260709 13:10:10.491787 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.410583 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.459367 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.492764 27339 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:10.459758 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.012s	sys 0.015s
I20260709 13:10:10.400367 30885 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.458231 30896 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.479655 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.508314 30769 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:10.485618 27266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.004s	sys 0.015s
I20260709 13:10:10.427708 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:10.474614 30680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.016s
W20260709 13:10:10.510062 30680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.007s	sys 0.017s
W20260709 13:10:10.516232 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 105869us
I20260709 13:10:10.475809 30910 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.520581 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.422816 30764 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:10:10.541031 27338 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:10.620183 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.621069 27338 raft_consensus.cc:2393] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:10.622018 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.622658 27338 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:10.545557 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:10.473184 30860 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.549475 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.478902 30718 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:10.582929 30800 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:10.555488 31003 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:10:10.557031 30891 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:10.558348 31002 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:10:10.558465 31007 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:10.559513 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 502) took 1447 ms. Trace:
I20260709 13:10:10.658146 27263 rpcz_store.cc:276] 0709 13:10:09.112129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.244040 (+131911us) service_pool.cc:224] Handling call
0709 13:10:09.617645 (+373605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.617853 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:10.221558 (+603705us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.491905 (+270347us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.491958 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.492010 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.492070 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.559338 (+ 67268us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54001b8fd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:10.559458 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57253,"prepare.queue_time_us":444813,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3686,"raft.queue_time_us":95,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":17904,"spinlock_wait_cycles":830227200,"thread_start_us":872611,"threads_started":2}
W20260709 13:10:10.564181 30947 consensus_meta.cc:287] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 13:10:10.569018 30909 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.569859 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.492715 30850 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:10.550701 27335 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:10.480700 30837 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:10.577224 27410 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 1945) took 1770 ms (client timeout 1940 ms). Trace:
W20260709 13:10:10.686724 27410 rpcz_store.cc:269] 0709 13:10:08.806446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.810818 (+  4372us) service_pool.cc:224] Handling call
0709 13:10:10.576935 (+1766117us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400086954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:10.577114 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720197888}
I20260709 13:10:10.578845 27343 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:10:10.583969 31009 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:10:10.587775 28011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 456) took 2752 ms (client timeout 1733 ms). Trace:
I20260709 13:10:10.652689 30760 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:10.592371 30721 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:10.694777 28011 rpcz_store.cc:269] 0709 13:10:07.835389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.835597 (+   208us) service_pool.cc:224] Handling call
0709 13:10:10.587530 (+2751933us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b540006d6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:10.587673 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4501176064}
I20260709 13:10:10.599900 30697 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.695273 30760 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:10.602315 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.586892 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:10.697050 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 110289us
I20260709 13:10:10.697184 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:10.608017 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.542333 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:10.697043 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2300) took 1465 ms. Trace:
I20260709 13:10:10.543061 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:10.623643 28014 raft_consensus.cc:2376] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9. Re-sending same reply.
I20260709 13:10:10.483140 30917 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.663357 30925 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:10.624819 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.703786 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2299) took 1476 ms. Trace:
I20260709 13:10:10.704165 27338 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
W20260709 13:10:10.704172 27267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.039s
W20260709 13:10:10.547775 30985 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.687s	user 0.005s	sys 0.000s
I20260709 13:10:10.704365 27340 rpcz_store.cc:276] 0709 13:10:09.226998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.641550 (+414552us) service_pool.cc:224] Handling call
0709 13:10:09.641951 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.654720 (+ 12769us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:09.654768 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.674169 (+ 19401us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.233643 (+559474us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.233680 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.578248 (+344568us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54001fc554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:10.578317 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.697402 (+119085us) raft_consensus.cc:1685] finished
0709 13:10:10.697423 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.703723 (+  6300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30835,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":19759,"spinlock_wait_cycles":28309376,"thread_start_us":548669,"threads_started":1,"wal-append.queue_time_us":778853}
I20260709 13:10:10.484670 30858 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.658070 31007 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:10.723862 27233 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.030s	sys 0.038s
I20260709 13:10:10.599974 30655 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.603093 30888 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.619561 30407 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.575999 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 1997) took 1303 ms. Trace:
I20260709 13:10:10.731741 27336 rpcz_store.cc:276] 0709 13:10:09.272940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.393817 (+120877us) service_pool.cc:224] Handling call
0709 13:10:10.575678 (+1181861us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540025bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:10.575905 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241463552}
I20260709 13:10:10.525204 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:10.651149 30868 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.001s
W20260709 13:10:10.685377 27265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.040s
W20260709 13:10:10.742211 27265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.012s	sys 0.040s
W20260709 13:10:10.598145 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.516013 31005 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.698361 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:10.699447 27415 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.010s	sys 0.048s
W20260709 13:10:10.747532 27415 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.010s	sys 0.049s
W20260709 13:10:10.624804 27337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.004s	sys 0.024s
W20260709 13:10:10.748173 27337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.004s	sys 0.024s
W20260709 13:10:10.699050 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 156778us
W20260709 13:10:10.700565 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 350695us
I20260709 13:10:10.698776 27342 rpcz_store.cc:276] 0709 13:10:09.232091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.865056 (+632965us) service_pool.cc:224] Handling call
0709 13:10:09.865558 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.865901 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.865935 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.871315 (+  5380us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.392169 (+520854us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.392613 (+   444us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.392820 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.392894 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.696837 (+303943us) raft_consensus.cc:1685] finished
0709 13:10:10.696857 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.696990 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8803,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3805,"raft.queue_time_us":14990,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":5557,"spinlock_wait_cycles":82773888,"thread_start_us":520395,"threads_started":1,"wal-append.queue_time_us":823334}
I20260709 13:10:10.698673 27412 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:10.697978 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:10.757125 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:10.757488 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59563.6us
I20260709 13:10:10.641045 30895 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.705070 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.628118 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:10.707327 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.762432 27338 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
W20260709 13:10:10.618269 31011 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:10:10.707330 27267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.026s	sys 0.039s
I20260709 13:10:10.712673 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.647490 30764 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:10.703828 30917 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.703754 30925 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:10.715550 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 578) took 3455 ms. Trace:
I20260709 13:10:10.716297 30858 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:10.720248 30729 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:10.723906 27259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.038s	sys 0.023s
W20260709 13:10:10.726951 27233 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.030s	sys 0.038s
I20260709 13:10:10.641250 30892 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:10.728629 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 439919us
I20260709 13:10:10.699007 31008 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:10.642577 30852 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:10.777989 28012 rpcz_store.cc:276] 0709 13:10:07.260123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.260407 (+   284us) service_pool.cc:224] Handling call
0709 13:10:07.264886 (+  4479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.787528 (+522642us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:07.787557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.921787 (+1134230us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b2c00012878. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:10:08.933104 (+ 11317us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.623580 (+690476us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:09.623641 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:09.623744 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.400569 (+776825us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:10.715305 (+314736us) raft_consensus.cc:1685] finished
0709 13:10:10.715324 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.715472 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35899,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":48223872,"thread_start_us":1075741,"threads_started":2,"wal-append.queue_time_us":784171}
I20260709 13:10:10.736425 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:10.802772 27336 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:10.704723 30870 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:10.709272 30661 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.739925 27339 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:10.759660 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:10.540068 30900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.015s
I20260709 13:10:10.762475 27413 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:10.828677 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.769107 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2288) took 1644 ms. Trace:
I20260709 13:10:10.685788 30947 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.770422 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:10.770764 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.771003 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.732337 30859 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:10.772725 30839 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.773304 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:10.777298 27340 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:10.772137 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2306) took 1191 ms. Trace:
W20260709 13:10:10.797243 27259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.038s	sys 0.026s
I20260709 13:10:10.791518 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:10.797715 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 601842us
I20260709 13:10:10.731262 30718 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.788789 30764 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:10.798348 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.799590 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:10.917443 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 117946us
I20260709 13:10:10.801003 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 1951) took 1898 ms. Trace:
I20260709 13:10:10.847075 30914 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.667783 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:10.920644 27335 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:10.802166 30852 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:10.770256 30955 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.696s	user 0.015s	sys 0.000s
I20260709 13:10:10.805137 27336 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:10.842659 30900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.012s	sys 0.015s
W20260709 13:10:10.943701 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:10.825953 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66414.7us
I20260709 13:10:10.735945 30407 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:10.739280 30888 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:10.788769 30929 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:10:10.775585 30977 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:10.762300 30868 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.829787 27265 rpcz_store.cc:276] 0709 13:10:09.124864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.508311 (+383447us) service_pool.cc:224] Handling call
0709 13:10:09.508627 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.508862 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:10.133063 (+624201us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.768476 (+635413us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.768677 (+   201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.768738 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.768809 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.768897 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.769037 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25358,"prepare.queue_time_us":547027,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":101,"raft.queue_time_us":6397,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":10188,"spinlock_wait_cycles":5281664,"thread_start_us":1144126,"threads_started":2}
I20260709 13:10:10.956141 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:10.956925 27265 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.833081 30697 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:10.904762 27411 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.905419 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:10.866488 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2293) took 1706 ms. Trace:
I20260709 13:10:10.907379 27267 rpcz_store.cc:276] 0709 13:10:09.581003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.184382 (+603379us) service_pool.cc:224] Handling call
0709 13:10:10.184715 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:10.184935 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:10.185174 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.771761 (+586587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.771810 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.771867 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.771948 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.772063 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83346,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":50305,"raft.queue_time_us":88,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12765,"thread_start_us":586204,"threads_started":1,"wal-append.queue_time_us":700391}
I20260709 13:10:10.910269 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:10.772114 30797 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.004s
I20260709 13:10:10.803534 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:10.921803 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.018s	sys 0.046s
W20260709 13:10:10.975464 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.046s
W20260709 13:10:10.975775 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 596605us
I20260709 13:10:10.890867 30760 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.918462 27415 rpcz_store.cc:276] 0709 13:10:08.903174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.903336 (+   162us) service_pool.cc:224] Handling call
0709 13:10:08.914157 (+ 10821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:08.914555 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:08.914592 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:08.915089 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:10:09.717851 (+802762us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:10.766565 (+1048714us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.778397 (+ 11832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.778469 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.778507 (+    38us) raft_consensus.cc:1685] finished
0709 13:10:10.778518 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.800931 (+ 22413us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97565,"prepare.queue_time_us":177588,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":32,"raft.queue_time_us":22510,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":28389,"thread_start_us":1814021,"threads_started":2,"wal-append.queue_time_us":964077}
W20260709 13:10:10.981519 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.925997 27410 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:10:10.880209 30930 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:10:10.825259 27339 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:10.947578 27417 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:10.948065 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2303) took 1378 ms. Trace:
W20260709 13:10:10.906793 30972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.001s	sys 0.013s
I20260709 13:10:10.948411 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:11.007625 27262 rpcz_store.cc:276] 0709 13:10:09.569650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.836779 (+267129us) service_pool.cc:224] Handling call
0709 13:10:09.837078 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.837296 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:09.933845 (+ 96549us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.525292 (+591447us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.947684 (+422392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:10.947747 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:10.947799 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.947864 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.948004 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55448,"prepare.queue_time_us":79295,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":13040,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3898,"spinlock_wait_cycles":18206976,"thread_start_us":889871,"threads_started":2,"wal-append.queue_time_us":886258}
W20260709 13:10:11.009539 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61333.1us
I20260709 13:10:11.010349 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:10.826560 30870 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:10.849001 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:10.965672 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.012732 27413 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:10.973135 27412 raft_consensus.cc:2410] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:10:10.968526 28012 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:10.927243 30973 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:11.019366 27265 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:10.805303 31008 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.006398 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.021634 27267 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:11.011387 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.012784 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:11.017066 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.020503 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:10.971827 30718 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.024156 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.026473 27339 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:10.955225 30977 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:11.015861 30972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.004s	sys 0.013s
W20260709 13:10:11.040555 31017 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:10:11.041443 31019 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
W20260709 13:10:11.042284 31016 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
W20260709 13:10:11.043416 31026 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:10:11.044425 31021 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:10:11.047266 30407 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:10.916306 30925 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:11.048583 31003 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260709 13:10:11.049325 31005 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.051527 30973 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:11.052523 30870 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.018142 30919 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:10.954847 30895 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:10:11.002822 30918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36144 (request call id 15) took 21068 ms. Trace:
W20260709 13:10:11.027949 30801 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.014s	user 0.007s	sys 0.006s
I20260709 13:10:11.056960 30977 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:10.949232 30955 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.026755 30697 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:10:11.023362 27265 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:10.972218 27261 rpcz_store.cc:276] 0709 13:10:09.160064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.637324 (+477260us) service_pool.cc:224] Handling call
0709 13:10:09.637619 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.709536 (+ 71917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.709567 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.715030 (+  5463us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.201084 (+486054us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.201125 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.201200 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:10.866194 (+664994us) raft_consensus.cc:1685] finished
0709 13:10:10.866219 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:10.866412 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74159,"raft.queue_time_us":72122,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3705,"thread_start_us":466291,"threads_started":1,"wal-append.queue_time_us":808527}
I20260709 13:10:11.173276 27260 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.175727 27261 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.176618 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1421) took 1279 ms. Trace:
I20260709 13:10:11.177049 27261 rpcz_store.cc:276] 0709 13:10:09.897128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.174233 (+1277105us) service_pool.cc:224] Handling call
0709 13:10:11.174993 (+   760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.176282 (+  1289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.176526 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.178966 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2301) took 1946 ms. Trace:
I20260709 13:10:11.179534 27343 rpcz_store.cc:276] 0709 13:10:09.232402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.893854 (+661452us) service_pool.cc:224] Handling call
0709 13:10:10.578475 (+684621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.687791 (+109316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.178473 (+490682us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540025bcd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.178751 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573580160}
I20260709 13:10:11.181080 27409 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:11.181365 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2020) took 1083 ms. Trace:
I20260709 13:10:11.182021 27334 rpcz_store.cc:276] 0709 13:10:10.097362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.287132 (+189770us) service_pool.cc:224] Handling call
0709 13:10:11.180843 (+893711us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.181122 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011883904}
I20260709 13:10:11.157403 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2289) took 2031 ms. Trace:
I20260709 13:10:11.183523 27264 rpcz_store.cc:276] 0709 13:10:09.125141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.617853 (+492712us) service_pool.cc:224] Handling call
0709 13:10:09.618201 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.684258 (+ 66057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.684292 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.684857 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.508058 (+823201us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:10.508104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.509424 (+  1320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.156385 (+646961us) raft_consensus.cc:1685] finished
0709 13:10:11.156453 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.156969 (+   516us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65618,"raft.queue_time_us":70040,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":14739,"thread_start_us":822809,"threads_started":1,"wal-append.queue_time_us":1027578}
I20260709 13:10:11.158354 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2304) took 1588 ms. Trace:
W20260709 13:10:11.160027 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.161806 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 195002us
I20260709 13:10:11.162072 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2298) took 1935 ms. Trace:
W20260709 13:10:11.163259 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 181512us
I20260709 13:10:11.067194 27411 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:11.058568 27412 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:10:11.074357 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.032589 30852 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.032073 30860 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.085142 30882 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:10:11.284248 30769 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.287045 31044 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:11.287681 30769 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.288111 30882 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:11.287938 31044 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.288693 30882 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:11.079576 30914 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:10:11.291628 30852 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.088969 30925 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.005386 30930 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.969923 30929 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:10.855661 31007 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.307330 31007 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.307865 30930 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.113023 31008 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.308831 30929 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.116207 30973 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.173305 27265 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:10:11.311878 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2307) took 1621 ms. Trace:
I20260709 13:10:11.312333 27265 rpcz_store.cc:276] 0709 13:10:09.690480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.171627 (+1481147us) service_pool.cc:224] Handling call
0709 13:10:11.172521 (+   894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.311460 (+138939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.311758 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:11.187534 27266 rpcz_store.cc:276] 0709 13:10:09.570089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.882784 (+312695us) service_pool.cc:224] Handling call
0709 13:10:09.883124 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:09.883320 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:10.509280 (+625960us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.928283 (+419003us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.156616 (+228333us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.157349 (+   733us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.157535 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.157610 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:11.157792 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.157943 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.158164 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":466,"prepare.queue_time_us":243044,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":84,"raft.queue_time_us":226243,"raft.run_wall_time_us":27656,"spinlock_wait_cycles":27556352,"thread_start_us":1269851,"threads_started":3,"wal-append.queue_time_us":591168}
I20260709 13:10:11.193717 27337 rpcz_store.cc:276] 0709 13:10:09.226688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.565325 (+338637us) service_pool.cc:224] Handling call
0709 13:10:09.565743 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.567890 (+  2147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.567939 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.570430 (+  2491us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.748660 (+1178230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:10.748722 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.748817 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.161282 (+412465us) raft_consensus.cc:1685] finished
0709 13:10:11.161331 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.161690 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1737,"raft.queue_time_us":41391,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":1051376,"threads_started":1,"wal-append.queue_time_us":1175891}
I20260709 13:10:11.093184 30918 rpcz_store.cc:276] 0709 13:09:49.885452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:49.890282 (+  4830us) service_pool.cc:224] Handling call
0709 13:09:49.908085 (+ 17803us) log.cc:844] Serialized 513 byte log entry
0709 13:09:50.190790 (+282705us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b18000bd280. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82b8ab0b 00007fbd82c0fb63 00007fbd82c37752 00007fbd87bf7d29
0709 13:09:50.502671 (+311881us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18000bd280. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:10.928040 (+20425369us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":541,"mutex_wait_us":554457,"raft.queue_time_us":207490,"raft.run_cpu_time_us":3276,"raft.run_wall_time_us":182602,"spinlock_wait_cycles":99790592,"thread_start_us":63224,"threads_started":1,"wal-append.queue_time_us":80407,"wal-append.run_cpu_time_us":2036,"wal-append.run_wall_time_us":1008542}
I20260709 13:10:11.200842 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:11.315035 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 114537us
I20260709 13:10:11.315527 30918 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.316222 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:11.318097 30918 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:11.204553 30764 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.201987 30760 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:11.229287 30947 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.238016 28013 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:10:11.240939 30759 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.243088 27412 pending_rounds.cc:85] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 7
I20260709 13:10:11.244331 27413 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:11.107681 30892 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.097963 30801 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.303491 30758 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.325737 30758 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.326464 30801 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.264923 31039 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:11.327790 31039 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.328577 30758 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.267328 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1418) took 1585 ms. Trace:
I20260709 13:10:11.329246 27267 rpcz_store.cc:276] 0709 13:10:09.662915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.160413 (+1497498us) service_pool.cc:224] Handling call
0709 13:10:11.161325 (+   912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.234390 (+ 73065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.234428 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.234500 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.248441 (+ 13941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.248532 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.248684 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43906,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":189,"thread_start_us":72116,"threads_started":1}
I20260709 13:10:11.331712 27341 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:11.331514 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.332634 27267 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:11.333592 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2021) took 1236 ms. Trace:
I20260709 13:10:11.277173 30837 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:11.277311 30868 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.268577 30955 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:11.303303 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.304628 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.290439 30882 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.097445 30919 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:11.318171 31029 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.432s	user 0.000s	sys 0.001s
W20260709 13:10:11.227684 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 142952us
I20260709 13:10:11.319800 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.379717 30919 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.380992 27266 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:11.330799 31039 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.339488 27335 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.334285 30837 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:11.385710 30917 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.010s
I20260709 13:10:11.386015 30837 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.333978 27341 rpcz_store.cc:276] 0709 13:10:10.097624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.138449 (+ 40825us) service_pool.cc:224] Handling call
0709 13:10:11.333352 (+1194903us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54003309d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.333524 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705144576}
I20260709 13:10:11.386243 30917 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:11.386654 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 68311.1us
I20260709 13:10:11.337802 27412 pending_rounds.cc:107] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:11.388048 27412 raft_consensus.cc:2889] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.389950 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:11.319978 30947 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.390468 30764 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:11.342348 30758 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.391099 30947 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.391710 30758 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:11.394479 30758 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:11.344107 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.344558 30767 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.345968 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:11.397395 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51735.3us
I20260709 13:10:11.397656 30862 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:11.398375 30862 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:11.399391 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:11.351027 31008 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.399622 30862 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.400343 30972 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.400652 30697 raft_consensus.cc:1064] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:10:11.400856 30972 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.401331 30972 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.351434 30868 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.356796 30941 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:11.357168 30965 consensus_meta.cc:287] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.217s	user 0.001s	sys 0.020s
W20260709 13:10:11.358611 30910 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.008s
W20260709 13:10:11.359730 31027 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.272s	user 0.003s	sys 0.001s
W20260709 13:10:11.365937 31031 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.483s	user 0.001s	sys 0.001s
I20260709 13:10:11.411083 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1424) took 1424 ms. Trace:
I20260709 13:10:11.377118 30882 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.412978 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2305) took 1842 ms. Trace:
I20260709 13:10:11.408072 27408 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:11.413843 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.413425 27259 rpcz_store.cc:276] 0709 13:10:09.570429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.062836 (+492407us) service_pool.cc:224] Handling call
0709 13:10:10.068441 (+  5605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:10.068952 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.068981 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:10.069449 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.913176 (+843727us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:10.913228 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:10.913315 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.308544 (+395229us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:11.412452 (+103908us) raft_consensus.cc:1685] finished
0709 13:10:11.412471 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.412766 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":998,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":3946240,"thread_start_us":843311,"threads_started":1,"wal-append.queue_time_us":932962}
I20260709 13:10:11.416137 30870 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.416631 30917 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.416606 30870 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.417340 30870 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.409821 30910 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.411604 27261 rpcz_store.cc:276] 0709 13:10:09.986460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.178201 (+1191741us) service_pool.cc:224] Handling call
0709 13:10:11.178821 (+   620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.206110 (+ 27289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.206165 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.232602 (+ 26437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.284286 (+ 51684us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.284334 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.284424 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.410803 (+126379us) raft_consensus.cc:1685] finished
0709 13:10:11.410837 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.411004 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32781,"raft.queue_time_us":36211,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":8631,"thread_start_us":50940,"threads_started":1,"wal-append.queue_time_us":175954}
I20260709 13:10:11.425446 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.427028 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.428412 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.429174 27259 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:11.430063 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.431131 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.431257 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:11.394500 30947 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.435935 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.436749 27265 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:11.442665 30860 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.437172 30697 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.443794 27263 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:11.446668 27259 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 5: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:11.447299 27266 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:11.458335 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.457906 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.461318 30888 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:11.474459 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65610.5us
I20260709 13:10:11.476547 30769 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.479592 30769 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.481683 30910 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.482343 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1533) took 1023 ms. Trace:
I20260709 13:10:11.483640 27412 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:10:11.486024 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.488673 30977 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.490579 28015 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.496202 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.496882 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.498567 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.486937 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 502) took 1301 ms. Trace:
I20260709 13:10:11.482836 27408 rpcz_store.cc:276] 0709 13:10:10.458954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.459083 (+   129us) service_pool.cc:224] Handling call
0709 13:10:11.482091 (+1023008us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b54000be0d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.482279 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2096257792}
I20260709 13:10:11.501009 27335 rpcz_store.cc:276] 0709 13:10:10.186017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.921323 (+735306us) service_pool.cc:224] Handling call
0709 13:10:11.337462 (+416139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.383954 (+ 46492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.486673 (+102719us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54003309d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.486835 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949868928}
I20260709 13:10:11.499851 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.503451 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.512136 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.512989 27266 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:11.510696 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1429) took 1111 ms. Trace:
I20260709 13:10:11.513799 27263 rpcz_store.cc:276] 0709 13:10:10.397977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.905088 (+507111us) service_pool.cc:224] Handling call
0709 13:10:11.502348 (+597260us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540011e4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:11.508758 (+  6410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078772608}
I20260709 13:10:11.518028 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.510720 30769 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.533686 30721 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.534147 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.529105 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.541528 30661 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:11.541898 30800 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.542979 30800 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.546089 30885 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.547719 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:11.549218 30885 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.550184 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:11.553730 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2302) took 2305 ms. Trace:
I20260709 13:10:11.554175 27260 rpcz_store.cc:276] 0709 13:10:09.248780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.735986 (+487206us) service_pool.cc:224] Handling call
0709 13:10:09.736349 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.174234 (+1437885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.553424 (+379190us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003147d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:11.553667 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302769536}
I20260709 13:10:11.555756 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.556314 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.557195 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.557520 30892 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.557858 30797 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:11.558354 30797 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:11.558307 30892 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.558832 27260 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.558998 30797 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.562691 30896 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:11.564335 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 66087.9us
I20260709 13:10:11.564807 30870 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.565413 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.559229 31044 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.534421 30721 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.559845 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1408) took 2444 ms. Trace:
I20260709 13:10:11.560874 30892 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:11.557456 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57831.2us
I20260709 13:10:11.519606 30862 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:11.537230 27265 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:11.542109 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1417) took 1870 ms. Trace:
I20260709 13:10:11.585378 27259 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:11.588490 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:11.577570 27268 rpcz_store.cc:276] 0709 13:10:09.115041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:09.507949 (+392908us) service_pool.cc:224] Handling call
0709 13:10:09.508327 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:09.557926 (+ 49599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:09.557973 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:09.558600 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:10:10.027289 (+468689us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:10.487228 (+459939us) log.cc:844] Serialized 14 byte log entry
0709 13:10:10.488607 (+  1379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.048201 (+559594us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b240011d0c8. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7f9ca9c4 00007fbd7f9c8acb 00007fbd7fb83dc9 00007fbd7fb83a55 00007fbd7fb8309d 00007fbd827b510e 00007fbd827cc88c 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221
0709 13:10:11.265703 (+217502us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b180030a0c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419
0709 13:10:11.559373 (+293670us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b540008b454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:11.559416 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.559479 (+    63us) raft_consensus.cc:1685] finished
0709 13:10:11.559490 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.559666 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17434,"prepare.queue_time_us":181972,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1917,"raft.queue_time_us":4145,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":45168,"spinlock_wait_cycles":175671680,"thread_start_us":894828,"threads_started":2,"wal-append.queue_time_us":790519}
W20260709 13:10:11.594175 31066 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:11.578027 30661 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:11.595757 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:11.598783 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:11.599514 30891 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.013s
I20260709 13:10:11.600335 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:11.603022 30729 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.800s	user 0.013s	sys 0.007s
I20260709 13:10:11.583863 27262 rpcz_store.cc:276] 0709 13:10:09.662652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.022505 (+1359853us) service_pool.cc:224] Handling call
0709 13:10:11.022844 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.297582 (+274738us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:11.339803 (+ 42221us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.375892 (+ 36089us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:11.376709 (+   817us) log.cc:844] Serialized 52 byte log entry
0709 13:10:11.376868 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:11.377130 (+   262us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.419983 (+ 42853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.438023 (+ 18040us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.529363 (+ 91340us) raft_consensus.cc:1685] finished
0709 13:10:11.529386 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.532620 (+  3234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211369,"prepare.queue_time_us":40787,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":229746,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":7933,"thread_start_us":85993,"threads_started":2,"wal-append.queue_time_us":100272}
I20260709 13:10:11.604758 30972 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.605216 27410 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:11.610852 30769 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.566531 30759 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:11.625774 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.633262 27266 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:11.633888 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 50506.8us
I20260709 13:10:11.632727 30965 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.640705 30892 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:11.641114 30965 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.642505 27417 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:11.632879 31058 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.642933 30682 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.638998 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.650027 31032 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:11.630954 30769 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.650530 27265 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:11.650669 30655 consensus_meta.cc:287] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.917s	user 0.016s	sys 0.006s
I20260709 13:10:11.651539 30655 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:11.652004 27267 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:11.652130 27265 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:11.652554 30655 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:11.652907 30655 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:11.653321 27267 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:11.653477 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.654384 30910 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:11.654942 30910 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:11.643527 28013 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 LEARNER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:11.656070 30910 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.657800 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 508) took 1372 ms. Trace:
I20260709 13:10:11.658176 27264 rpcz_store.cc:276] 0709 13:10:10.285297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.280922 (+995625us) service_pool.cc:224] Handling call
0709 13:10:11.281411 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.656835 (+375424us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:11.656867 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.656925 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.656981 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.657601 (+   620us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54002efc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:11.657637 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.657752 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862484864}
I20260709 13:10:11.659353 30850 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:11.659886 30850 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.662102 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.664301 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.664539 30800 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.666215 31041 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:11.666133 30759 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.667053 31041 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:11.667249 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.668772 27263 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.613323 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:11.607111 30972 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.639844 30977 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.550174 30885 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.643301 31058 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.691764 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:11.650565 31032 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:11.676412 30870 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.696903 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.709679 28012 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:11.643536 30682 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.681169 30800 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.720579 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.724941 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:11.707401 30882 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:11.726311 27413 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
W20260709 13:10:11.727586 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 162393us
W20260709 13:10:11.730844 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68965.7us
I20260709 13:10:11.732755 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.733614 27408 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:10:11.735365 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.735735 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:11.736451 27335 raft_consensus.cc:2376] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9. Re-sending same reply.
I20260709 13:10:11.737609 30759 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:11.737898 31067 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:10:11.739142 31041 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:11.743988 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.734055 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 138383us
I20260709 13:10:11.754307 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:11.755430 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2018) took 1658 ms. Trace:
I20260709 13:10:11.755841 27338 rpcz_store.cc:276] 0709 13:10:10.096911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.763387 (+666476us) service_pool.cc:224] Handling call
0709 13:10:10.763791 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.506329 (+742538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.506379 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.506936 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.574240 (+ 67304us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.574692 (+   452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.582608 (+  7916us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.755093 (+172485us) raft_consensus.cc:1685] finished
0709 13:10:11.755111 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.755272 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739223,"raft.queue_time_us":784524,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":276,"thread_start_us":66740,"threads_started":1,"wal-append.queue_time_us":217656}
W20260709 13:10:11.757958 31062 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:10:11.759663 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 501) took 1604 ms. Trace:
I20260709 13:10:11.760239 31058 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.760115 27340 rpcz_store.cc:276] 0709 13:10:10.155416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.904331 (+748915us) service_pool.cc:224] Handling call
0709 13:10:10.918609 (+ 14278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.723362 (+804753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.727286 (+  3924us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.731433 (+  4147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.731473 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.759283 (+ 27810us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.759483 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":605066,"raft.queue_time_us":634900,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"thread_start_us":160229,"threads_started":1}
I20260709 13:10:11.727604 30882 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.762521 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.763218 27261 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
W20260709 13:10:11.764832 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.767732 31049 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:11.768548 30919 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.769289 31049 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.769124 30919 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.769768 31049 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:11.771344 30680 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.773644 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:11.774093 30885 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.777576 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:11.758004 31032 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.787515 31032 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.789772 30965 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.780915 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.790771 27264 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.781574 30850 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:11.781862 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.792301 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:11.793450 27266 pending_rounds.cc:85] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:10:11.801993 27266 pending_rounds.cc:107] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:10:11.802242 27266 raft_consensus.cc:2889] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:11.731118 30721 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:11.699872 30655 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.762534 30882 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.806730 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:11.804279 27263 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:11.807068 30977 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:11.752671 30797 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.858852 27261 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:11.860970 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:11.868117 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.865197 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.851272 30930 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.879966 27413 raft_consensus.cc:2368] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:11.882728 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.861449 30977 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.883867 28006 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:11.818987 30800 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:11.859723 30919 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.803761 30680 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:11.915906 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 142379us
I20260709 13:10:11.917290 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.917164 31007 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:11.919140 31007 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:11.919615 31007 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:11.888195 30977 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:11.920199 31073 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:11.920682 31007 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:11.921358 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 145897us
I20260709 13:10:11.922116 31007 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:11.922307 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.924803 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.925920 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.927156 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.927551 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.927709 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.928045 27417 raft_consensus.cc:2393] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:11.928795 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.929719 27409 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:10:11.930346 30852 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.930827 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.896241 30721 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:10:11.896503 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 170655us
I20260709 13:10:11.897032 30800 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:11.896068 31074 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:10:11.900473 30885 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:11.902626 30655 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:11.904019 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.959877 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.905328 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:11.906215 31078 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:11.929493 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.899832 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:11.950007 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.917146 27981 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:11.943945 27263 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.954278 27264 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:11.927222 27414 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:10:11.962558 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45530.8us
I20260709 13:10:11.866290 30870 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:10:11.964147 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:11.968443 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:11.971987 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:11.931088 31070 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260709 13:10:11.933477 30682 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:11.979003 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:11.953040 30930 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.932574 30797 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:11.983547 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:11.984264 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 84731.9us
I20260709 13:10:11.930965 30852 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:11.998195 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:11.967150 30862 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:11.999450 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 144651us
I20260709 13:10:12.000241 27411 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:12.001714 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.006147 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:11.982313 30919 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:12.012279 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 90131.6us
I20260709 13:10:11.970980 30721 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:12.014482 27409 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:12.018649 30892 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.019222 30800 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:11.992141 30930 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.019876 27410 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:12.020223 30661 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:11.997888 30965 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.023756 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 279105us
I20260709 13:10:12.024305 30914 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:12.026418 30870 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:12.012504 30919 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:11.974943 30885 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.030018 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:12.042498 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.049486 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:12.049310 30965 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.060817 30965 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:12.046837 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:12.063782 27414 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:12.041102 30800 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.031716 30862 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:12.045070 30661 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:12.071897 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 92734.9us
I20260709 13:10:12.075390 27263 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:12.044806 30930 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.052907 30914 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.078199 27259 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.078955 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:12.007822 31041 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.099336 30914 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.037765 30680 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:12.105129 31075 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:10:12.106801 31075 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.107326 31075 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:12.107936 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:12.095726 30661 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.108295 31075 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.109210 28006 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:12.109761 30661 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.110509 30862 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.096233 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.096824 30977 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.114502 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.115252 30977 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:12.116446 30860 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:12.116824 30860 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:12.098352 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:12.117671 30860 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.099011 31041 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.119225 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 504) took 1849 ms. Trace:
I20260709 13:10:12.120415 31041 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.119596 27336 rpcz_store.cc:276] 0709 13:10:10.186614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.969725 (+783111us) service_pool.cc:224] Handling call
0709 13:10:10.975668 (+  5943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.716264 (+740596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.723426 (+  7162us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:11.764151 (+ 40725us) log.cc:844] Serialized 26 byte log entry
0709 13:10:11.884409 (+120258us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:11.884455 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.900142 (+ 15687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.030553 (+130411us) raft_consensus.cc:1685] finished
0709 13:10:12.030572 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.035942 (+  5370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":544174,"raft.queue_time_us":577337,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":150,"thread_start_us":282296,"threads_started":2,"wal-append.queue_time_us":264107}
I20260709 13:10:12.121006 30769 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:12.121555 30769 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:12.081875 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.092696 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:12.123701 27267 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.109994 31075 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.082417 30800 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.136147 30972 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.135733 30769 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.191766 30972 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.192606 30930 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.137269 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:12.147315 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104877us
I20260709 13:10:12.150003 30919 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:12.155900 31051 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:12.163589 30721 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.168931 30885 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:12.179425 31086 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 13:10:12.193971 30972 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:12.194845 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.195087 27268 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:10:12.202711 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71638.1us
I20260709 13:10:12.205586 27414 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:12.188673 30852 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:12.238346 27411 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:12.240440 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:12.241885 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.242895 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:12.244612 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:12.293812 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.249444 27262 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:12.303723 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:12.305152 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 315811us
W20260709 13:10:12.344262 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.304610 27268 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:12.357405 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.238585 30885 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.247399 31041 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.363749 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.255578 30919 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:12.359185 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63724.1us
I20260709 13:10:12.190979 30914 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.297014 30972 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:12.374495 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.377911 28012 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:12.379534 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:12.383908 31088 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:12.384897 30882 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:10:12.381875 30930 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:12.386860 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 142433us
W20260709 13:10:12.388849 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.389636 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 281110us
I20260709 13:10:12.397468 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:12.400053 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151033us
I20260709 13:10:12.414166 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2016) took 2304 ms. Trace:
I20260709 13:10:12.373529 31041 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.391795 30655 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.414650 27342 rpcz_store.cc:276] 0709 13:10:10.096447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.758287 (+661840us) service_pool.cc:224] Handling call
0709 13:10:10.758685 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:11.646032 (+887347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.669084 (+ 23052us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:11.721174 (+ 52090us) log.cc:844] Serialized 52 byte log entry
0709 13:10:11.955343 (+234169us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:12.389711 (+434368us) log.cc:844] Serialized 14 byte log entry
0709 13:10:12.390152 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.401053 (+ 10901us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.401106 (+    53us) raft_consensus.cc:1685] finished
0709 13:10:12.401121 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.401269 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":768410,"raft.queue_time_us":794939,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":630262,"threads_started":3,"wal-append.queue_time_us":295041}
I20260709 13:10:12.392793 31088 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:12.424192 30887 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:12.425714 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44675.7us
I20260709 13:10:12.394279 30860 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.457347 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:12.458745 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.469142 31032 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.469667 31032 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.470013 31032 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.388453 30972 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.390364 30882 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:12.481861 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52831.9us
I20260709 13:10:12.405786 31073 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.483829 27263 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:10:12.485351 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 377487us
I20260709 13:10:12.476056 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:12.489651 28009 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:12.490572 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.492471 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64442.3us
I20260709 13:10:12.495327 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:12.495986 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 70720.7us
I20260709 13:10:12.496803 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:12.507541 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.492413 31089 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:12.489579 30655 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.507807 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:12.511574 31105 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:12.516702 31105 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:12.517230 31090 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:10:12.517330 31105 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.518970 31097 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.523962 30718 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:12.526772 27268 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.527513 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:12.528086 27260 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:10:12.532979 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.532995 31104 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.533164 31088 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:12.538388 31049 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.003s
I20260709 13:10:12.538857 31049 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.540414 28006 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.541494 31049 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.547308 30718 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.510377 30910 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:10:12.561743 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61768.6us
I20260709 13:10:12.562510 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:12.560426 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 68584.4us
I20260709 13:10:12.565457 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.571889 30887 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:12.572059 31097 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.572247 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:12.572788 30887 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:12.574154 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:12.574414 30972 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:12.560534 30977 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:10:12.575343 31104 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.576171 30977 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.557489 30930 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:10:12.579731 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:12.580289 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:12.580543 28006 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:12.581477 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:12.576574 30977 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:12.573979 30887 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.585570 27260 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
W20260709 13:10:12.566677 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.599s (SENT) [suppressed 21 similar messages]
I20260709 13:10:12.593712 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:12.582335 31032 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.594311 27263 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.595049 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:12.583402 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.538892 30800 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.599458 27266 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:12.560669 30910 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.604159 30910 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.619181 28013 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.632439 30972 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:12.632320 30718 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:12.634611 30800 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.635270 30930 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:12.635725 30930 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:12.635740 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:12.636790 30930 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.638417 30930 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.592768 30655 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:12.649235 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.572816 31097 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:12.576184 31104 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:12.642554 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 528109us
I20260709 13:10:12.659703 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.664971 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:12.679299 27267 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.001s
I20260709 13:10:12.635293 30661 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:12.691623 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:12.713294 28006 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:12.692067 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.602212 30882 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.566365 31092 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:10:12.700085 27267 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:12.715632 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 192067us
I20260709 13:10:12.598588 30965 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:10:12.595746 30760 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:10:12.715080 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.656687 30852 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:12.639822 30860 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:12.713294 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91879.2us
I20260709 13:10:12.718026 27338 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:12.759428 27337 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:12.760200 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 177465us
W20260709 13:10:12.764451 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.764937 27336 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:12.641415 31049 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:10:12.655853 30680 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
W20260709 13:10:12.765796 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106725us
I20260709 13:10:12.713639 30914 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:12.746717 31104 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:12.784814 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.758273 30852 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:12.784365 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 215103us
I20260709 13:10:12.787073 27263 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
W20260709 13:10:12.820477 30892 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.001s
I20260709 13:10:12.820990 30892 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.822022 30910 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.822551 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:12.770848 31075 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:12.823566 30914 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:12.823875 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.824203 30914 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:12.824649 27341 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:12.825613 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.825351 30914 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.826247 27341 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:12.827637 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:12.828601 27335 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:12.829227 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:12.830660 31116 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:12.830868 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:12.832017 27335 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:12.832425 30769 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:12.833243 31107 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:10:12.758152 31041 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.765530 30800 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:12.816222 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45732.9us
W20260709 13:10:12.792845 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.840696 27342 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:12.839646 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.836508 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:12.770213 30860 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:12.845955 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.769997 30655 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:12.782045 30972 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:12.857090 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 75961.1us
I20260709 13:10:12.855329 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:12.858002 27267 raft_consensus.cc:2368] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10.
I20260709 13:10:12.856680 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:12.836184 30852 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:12.850476 27337 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
W20260709 13:10:12.868049 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85675.6us
I20260709 13:10:12.867092 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:12.872689 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:12.872846 27268 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:12.855389 31116 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.857120 30769 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.862929 30797 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.856585 30655 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:12.902081 27981 leader_election.cc:400] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10.
I20260709 13:10:12.902609 27981 leader_election.cc:403] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.903254 28009 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:12.890713 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 324044us
I20260709 13:10:12.893954 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:12.894686 30769 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.894908 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:12.895726 31101 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:10:12.895573 30977 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.896631 31105 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.893996 30910 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.921990 27416 raft_consensus.cc:2368] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10.
I20260709 13:10:12.894850 27341 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:12.899597 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.906347 27335 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:12.864769 31113 raft_consensus.cc:2764] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:12.854188 30800 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:12.923206 31104 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.931954 30800 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:12.925359 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54040.2us
W20260709 13:10:12.933840 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50971.6us
W20260709 13:10:12.917683 27380 leader_election.cc:336] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.634s (SENT)
I20260709 13:10:12.929294 30860 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.929515 31113 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:12.941777 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.942804 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.913058 30655 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:12.963477 30919 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:10:12.966001 30977 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.967291 27412 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:10:12.967779 27412 pending_rounds.cc:85] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 8
I20260709 13:10:12.968066 27412 pending_rounds.cc:107] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:12.968340 27412 raft_consensus.cc:2889] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.915437 30797 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.971637 31117 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.972353 31114 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:12.973282 27335 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:12.974294 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.974830 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:12.974956 27335 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:12.975683 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.976126 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.976385 27342 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:12.976733 27335 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:12.977106 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:12.977342 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.977761 27260 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:12.977921 27342 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:12.977970 27335 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:10:12.978874 31105 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.978951 31041 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:12.979511 27335 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:12.979604 31041 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:12.980630 31041 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:12.953076 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:12.976828 30910 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:12.983641 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:12.940647 31049 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10.
W20260709 13:10:12.988768 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 199623us
W20260709 13:10:12.982856 31112 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:13.042908 27338 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:13.045459 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:13.054004 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:13.057272 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.971666 30797 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:12.912642 31116 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.065235 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:12.872462 31097 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:13.090451 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 188726us
I20260709 13:10:13.088934 27341 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:13.100849 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.101819 27338 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:13.103323 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.043915 31114 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:13.101505 27341 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
W20260709 13:10:13.111553 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46439.9us
W20260709 13:10:13.122552 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.125448 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 146945us
I20260709 13:10:13.127206 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:13.143142 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 273244us
I20260709 13:10:13.144068 27341 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.129558 27260 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:10:13.136770 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 219146us
W20260709 13:10:13.141589 28009 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 598) took 1423 ms (client timeout 1605 ms). Trace:
I20260709 13:10:13.147377 27338 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:13.137562 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:12.972378 31117 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.142779 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:13.145251 28009 rpcz_store.cc:269] 0709 13:10:11.707225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.713552 (+  6327us) service_pool.cc:224] Handling call
0709 13:10:13.130499 (+1416947us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:13.130641 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757316864}
I20260709 13:10:13.155349 27980 leader_election.cc:400] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10.
W20260709 13:10:13.158723 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 183981us
I20260709 13:10:13.118984 31032 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:13.161856 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.165676 27233 leader_election.cc:400] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:13.167335 27233 leader_election.cc:403] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:10:13.168838 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56617.9us
I20260709 13:10:13.171221 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:13.174487 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.149791 30965 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:13.145874 30760 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:13.175750 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.181603 27342 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.068365 30972 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.184399 27416 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:13.187283 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.181512 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.193497 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:13.191408 27411 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:13.198835 27338 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:13.124490 31114 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.205760 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.172544 31073 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:13.175326 31104 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:13.209683 27163 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 129) took 24884 ms (client timeout 15000 ms). Trace:
I20260709 13:10:13.185573 30965 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.186224 30760 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.167003 30914 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:10:13.220450 30930 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.005s
I20260709 13:10:13.221199 31141 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:13.221588 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 84399.1us
I20260709 13:10:13.221802 31141 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.222376 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:13.224200 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.225116 31105 raft_consensus.cc:2764] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:13.225781 31105 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.221071 30930 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:13.228940 31114 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:13.229076 31123 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:10:13.203012 30800 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.231374 31131 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:10:13.234709 27343 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.235049 27343 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:13.235743 27343 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.236783 27343 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.237109 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.237913 31124 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.239255 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.240037 31124 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:13.242266 27340 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:13.231427 30800 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.243691 30800 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.192373 31007 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.230877 30889 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.243899 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.265652 27341 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:13.207249 31032 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:13.288322 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:13.296175 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 115777us
I20260709 13:10:13.213176 31091 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:13.219973 30965 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:13.257198 30760 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:13.330180 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.335378 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 91591.5us
I20260709 13:10:13.336335 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.340261 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:13.203408 30885 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:10:13.293305 31032 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.343266 31127 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:13.357980 31032 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:13.358342 31127 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:13.359203 31041 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:13.359377 31127 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.295523 31124 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:13.360672 31127 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.365281 30885 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:13.365731 30885 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:13.366006 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:13.366530 30885 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.302739 30889 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.370939 30885 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.373553 30889 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:13.288964 31007 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.202595 31118 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.253s
I20260709 13:10:13.302716 31091 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.299831 30910 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:13.286577 31123 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:10:13.355417 27336 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:13.392212 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 187897us
I20260709 13:10:13.296324 30769 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:13.211704 27163 rpcz_store.cc:269] 0709 13:09:48.200802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:48.203018 (+  2216us) service_pool.cc:224] Handling call
0709 13:10:12.989302 (+24786284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:10.848196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:11.056404 (+208208us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:11.060330 (+  3926us) write_op.cc:435] Acquired schema lock
0709 13:10:11.064008 (+  3678us) tablet.cc:662] Decoding operations
0709 13:10:11.119134 (+ 55126us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:11.119239 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:11.119276 (+    37us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:11.119973 (+   697us) tablet.cc:701] Row locks acquired
0709 13:10:11.119987 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:10:11.120106 (+   119us) write_op.cc:270] Start()
0709 13:10:11.120195 (+    89us) write_op.cc:276] Timestamp: P: 1783602611120065 usec, L: 0
0709 13:10:11.120210 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:10:11.121044 (+   834us) log.cc:844] Serialized 3306 byte log entry
0709 13:10:11.266980 (+145936us) op_driver.cc:464] REPLICATION: finished
0709 13:10:11.466819 (+199839us) write_op.cc:301] APPLY: starting
0709 13:10:11.499261 (+ 32442us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:11.499604 (+   343us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:11.501959 (+  2355us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:11.610397 (+108438us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2e32a 00007fbd82bb3f14 00007fbd82bb3ec3 00007fbd82bb3e38 00007fbd82bb3df3 00007fbd82bb30dc 00007fbd82bdce16 00007fbd82bc4cbb 00007fbd82baf39d 00007fbd82bb2d75
0709 13:10:11.884586 (+274189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:12.039114 (+154528us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:10:12.039199 (+    85us) write_op.cc:312] APPLY: finished
0709 13:10:12.039670 (+   471us) log.cc:844] Serialized 65 byte log entry
0709 13:10:12.039896 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.040093 (+   197us) write_op.cc:454] Released schema lock
0709 13:10:12.040162 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:12.049459 (+  9297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:12.049492 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1574079,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":166261,"apply.run_cpu_time_us":12040,"apply.run_wall_time_us":596140,"num_ops":8,"prepare.queue_time_us":743719,"prepare.run_cpu_time_us":7842,"prepare.run_wall_time_us":443687,"raft.queue_time_us":932,"raft.run_cpu_time_us":9558,"raft.run_wall_time_us":483160,"replication_time_us":146507,"spinlock_wait_cycles":109374208,"thread_start_us":734206,"threads_started":4,"wal-append.queue_time_us":3000,"wal-append.run_cpu_time_us":5573,"wal-append.run_wall_time_us":2124717}]]}
I20260709 13:10:13.384554 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:13.387840 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44182.9us
I20260709 13:10:13.292522 31136 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:10:13.255077 31073 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.396045 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.401839 27411 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:10:13.398216 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.403781 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.406159 27343 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:10:13.394073 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.409756 27343 pending_rounds.cc:85] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 7
I20260709 13:10:13.414098 27343 pending_rounds.cc:107] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:10:13.414438 27343 raft_consensus.cc:2889] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.392712 31091 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:13.418507 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.395128 30862 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:13.381448 30889 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:13.440176 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.391369 30919 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:13.394145 30797 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:10:13.450716 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.396656 30910 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:13.454804 31132 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:13.459555 31130 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:13.459911 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:13.465489 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 305989us
I20260709 13:10:13.471676 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.472426 27340 raft_consensus.cc:2368] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:13.428781 31116 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:13.477809 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.482609 27342 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:13.485461 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.490283 27336 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:13.438344 30914 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:13.492758 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.481210 30889 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:13.470268 31130 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:13.487336 30769 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.510761 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.511569 27341 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:13.514251 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.516088 27342 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:13.517560 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:13.518128 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:13.520470 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.500706 31088 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:13.521029 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.501493 30889 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:13.524525 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:13.525527 28013 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:13.507494 31117 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:13.527316 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.537714 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.539778 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.521392 31141 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:13.548249 31007 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:13.524283 31072 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:13.545140 31125 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:10:13.555050 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.572561 30760 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:13.573671 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.574800 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:13.575109 30977 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.001s
I20260709 13:10:13.575637 27413 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:13.575912 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.576494 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.530555 31088 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:13.578421 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:13.578235 31088 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.555703 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.579452 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:13.563499 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 45424.8us
I20260709 13:10:13.583801 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:13.556304 31121 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:13.556485 31130 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:13.563730 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.564543 31120 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:10:13.565632 30852 consensus_meta.cc:287] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.690s	user 0.004s	sys 0.004s
I20260709 13:10:13.521595 30800 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:13.569761 30655 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.004s
I20260709 13:10:13.527086 31032 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.591946 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:13.593247 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:13.594543 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:13.595196 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:13.654016 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.597513 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:13.597711 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:13.655284 27263 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:13.597730 30889 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:13.600281 27409 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:13.600445 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.670735 27409 pending_rounds.cc:85] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 4
I20260709 13:10:13.574894 30760 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:13.603989 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.615664 30914 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.603031 27343 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:10:13.742231 27343 pending_rounds.cc:85] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:10:13.742684 27343 pending_rounds.cc:107] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:10:13.743021 27343 raft_consensus.cc:2889] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:13.529356 31144 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:13.618101 31120 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:13.606842 31149 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:10:13.657673 27263 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:13.671195 27409 pending_rounds.cc:107] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:13.671613 27336 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:13.673828 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:13.654412 27413 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:13.655144 27268 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:13.693717 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:13.604440 27411 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:13.740782 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.609719 31121 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:13.630276 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:13.618178 31141 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:13.750332 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.670720 31041 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.177s
I20260709 13:10:13.631685 30852 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.066041 27412 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 13:10:13.828192 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.753299 27409 raft_consensus.cc:2889] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.053587 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:13.838449 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:13.914055 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 313691us
I20260709 13:10:14.079003 27265 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:14.079202 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:14.079782 27413 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:14.083968 30889 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.647859 30655 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.088501 27260 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:14.042286 31117 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.090415 31117 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:14.053880 31154 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:10:13.858479 30760 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:14.093577 30760 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.097388 27410 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:13.747846 30885 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:13.855232 31007 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:13.847134 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:14.144150 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65045.9us
I20260709 13:10:14.146586 31117 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.134815 27268 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:14.153672 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.149554 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:14.240725 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 91270.1us
I20260709 13:10:14.241654 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:14.162693 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.165624 27265 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:10:14.167403 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.243547 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.243618 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.168073 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.113299 31124 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.064469 30800 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.080448 31141 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:14.203992 27261 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:14.076098 31097 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.147444 30655 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.151644 31151 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.215438 31158 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.170552 31144 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.220155 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.269273 27335 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:14.068171 31120 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.231676 31121 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.233335 30760 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.236702 31032 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.250252 27336 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:14.250347 27411 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:13.870752 31146 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.593s
I20260709 13:10:14.255445 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:14.283567 27264 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:13.751860 30914 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.170302 31007 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.265302 27265 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:14.292078 27263 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:14.258000 31117 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.166018 30977 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:10:14.223419 30900 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:14.248521 31091 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.810s	user 0.004s	sys 0.007s
W20260709 13:10:14.274963 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 644769us
I20260709 13:10:14.252334 31161 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:14.289314 27261 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:14.260874 31141 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.320216 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:14.322516 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:14.326682 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:14.322094 31161 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:14.327615 31161 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.275023 31158 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.321389 31091 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.256017 31124 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.336865 31091 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.337404 31124 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.280203 31129 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:10:14.274048 30655 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:14.342818 30769 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.012s
I20260709 13:10:14.343439 30769 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.344300 30769 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.318034 31121 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.345872 30914 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.348860 31144 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.349898 31144 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:14.289814 31097 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.269089 31151 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.353461 31097 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.354436 27341 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:14.342288 30655 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.355291 31007 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.357188 30655 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.359722 31158 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.327872 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.369141 27339 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:14.344843 30769 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.371765 27336 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:14.587119 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 528) took 1170 ms. Trace:
W20260709 13:10:14.622228 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.638144 27343 rpcz_store.cc:276] 0709 13:10:13.416609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.453628 (+ 37019us) service_pool.cc:224] Handling call
0709 13:10:13.453909 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.800241 (+346332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.586784 (+786543us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:14.587027 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342198144}
I20260709 13:10:14.638823 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.512944 31173 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.639566 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:14.403033 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 166628us
I20260709 13:10:14.640074 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.629446 31146 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:14.628995 31041 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.379982 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:14.394490 31072 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.823s	user 0.006s	sys 0.006s
I20260709 13:10:14.641074 31041 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.395709 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.553061 27264 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:14.642673 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 529) took 1180 ms. Trace:
I20260709 13:10:14.360998 31144 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:14.643728 31041 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.640700 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.381264 31124 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:14.595777 30965 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.203s	user 0.013s	sys 0.000s
I20260709 13:10:14.645313 30862 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:14.389820 31163 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:10:14.370774 31120 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.645714 30965 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:14.635290 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 327901us
I20260709 13:10:14.641911 31072 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:14.589066 27337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.013s
W20260709 13:10:14.651736 27337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.001s	sys 0.014s
I20260709 13:10:14.393380 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.652771 27335 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:14.390113 31127 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.029s	user 0.008s	sys 0.004s
W20260709 13:10:14.453778 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.444118 31097 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:14.641515 27261 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:14.643146 27338 rpcz_store.cc:276] 0709 13:10:13.462439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.462923 (+   484us) service_pool.cc:224] Handling call
0709 13:10:13.486135 (+ 23212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.501383 (+ 15248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.501416 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:13.509260 (+  7844us) log.cc:844] Serialized 26 byte log entry
0709 13:10:13.797059 (+287799us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:13.797124 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:13.797230 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:14.401211 (+603981us) raft_consensus.cc:1685] finished
0709 13:10:14.401231 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.642606 (+241375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5514,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10845,"thread_start_us":254827,"threads_started":1,"wal-append.queue_time_us":740623}
I20260709 13:10:14.533603 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:14.619524 27231 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.827s (SENT)
I20260709 13:10:14.370267 30885 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.645622 30910 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.653072 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2323) took 2014 ms. Trace:
I20260709 13:10:14.659642 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:14.653688 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.512498 30977 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.645329 27343 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:14.667661 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.670100 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:14.670730 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.656527 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.687121 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:14.687975 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.678963 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.649852 31041 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.699832 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:14.700474 27265 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:14.700474 27413 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.703450 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.654134 31130 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:14.645509 31124 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.709859 27264 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:14.683594 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.703539 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.711843 27260 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:14.704466 27342 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:14.689698 27335 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:14.696748 27263 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:14.660753 27337 rpcz_store.cc:276] 0709 13:10:12.638261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.923469 (+285208us) service_pool.cc:224] Handling call
0709 13:10:13.548404 (+624935us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:13.548555 (+   151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.548839 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:13.549279 (+   440us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.652212 (+1102933us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.652497 (+   285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:14.652554 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:14.652612 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.652842 (+   230us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.652955 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123256,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":368942,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":33665,"spinlock_wait_cycles":4338304,"thread_start_us":773963,"threads_started":2,"wal-append.queue_time_us":704484}
I20260709 13:10:14.641016 31146 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.708266 27417 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:14.719580 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.720387 27339 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:14.733537 27261 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:14.731498 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.728418 27341 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 8: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:14.738224 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.739006 27338 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.740801 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:14.741652 27342 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:14.748261 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 58443.7us
I20260709 13:10:14.644045 31144 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.699342 30910 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:14.751771 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 132299us
I20260709 13:10:14.640116 31173 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.778656 31173 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.779367 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:14.756089 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:14.792196 27410 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:14.759351 30862 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.793541 30862 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:14.794503 31109 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.945s	user 0.010s	sys 0.003s
I20260709 13:10:14.796154 30862 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.760617 31144 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:14.761175 31091 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.761453 30900 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:14.797309 31091 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.798053 30852 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.763278 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:14.800046 28009 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:14.721771 31130 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.767344 31124 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.813655 27336 raft_consensus.cc:2410] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:14.815322 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:14.768682 30965 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:14.770362 31073 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.772996 31141 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.710911 30769 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.778573 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:14.750876 30889 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.731989 31127 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:14.780648 31146 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:14.755517 31163 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:14.781641 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:14.780989 31161 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.806150 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.874414 27335 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:14.808552 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.702906 31041 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.750303 27308 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:14.814630 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.018s	sys 0.021s
W20260709 13:10:14.876119 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.018s	sys 0.022s
W20260709 13:10:14.876528 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 629065us
I20260709 13:10:14.680060 31097 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:14.844703 28006 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:14.906999 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:14.699548 30977 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:14.848862 31073 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.855526 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:14.878324 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 128642us
I20260709 13:10:14.886926 27338 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
W20260709 13:10:14.900717 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 98148.5us
I20260709 13:10:14.904848 27342 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:14.877307 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:14.835726 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.830263 30718 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:14.844728 31144 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:14.924517 27337 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:10:14.937757 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 109010us
W20260709 13:10:14.947423 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 70220.5us
I20260709 13:10:14.963279 27343 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:14.862133 31115 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:14.906381 31091 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.908794 31093 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:15.000172 27413 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:14.923959 30900 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:14.928522 30718 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:14.937995 31124 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.018730 27262 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:14.856886 30889 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.026103 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:14.938179 31144 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:15.047374 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73827.7us
W20260709 13:10:15.056054 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 107483us
I20260709 13:10:14.991372 30852 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:14.990702 31172 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.990430 31072 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:15.050982 28009 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:14.999310 31115 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.024906 30900 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.059579 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:15.065865 31124 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.066309 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.081281 27264 raft_consensus.cc:2410] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:15.066619 30852 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.066715 31097 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:14.991117 31073 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.067525 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.067611 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:14.929649 31127 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.084378 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:15.096777 27343 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:15.053787 31146 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.055400 31179 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.055197 31130 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:15.151690 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67445.6us
I20260709 13:10:15.061162 31144 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.097672 30852 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.159752 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:15.095592 31177 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:10:15.162957 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.163735 27337 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:15.164008 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.030606 31093 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.174252 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:15.163738 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.075994 31174 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.175416 27262 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.096705 30900 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.168164 31173 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:15.193580 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.162046 31097 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:15.200968 31093 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.151420 31188 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:10:15.202287 30977 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.203580 31130 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:15.204649 31136 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:15.205418 31194 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.097509 30910 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:10:15.073410 30972 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:10:15.098284 31120 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:10:15.233609 30965 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:15.234092 30965 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.212555 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2344) took 1469 ms. Trace:
I20260709 13:10:15.233713 31194 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.235073 30965 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.234835 27266 rpcz_store.cc:276] 0709 13:10:13.743533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.743869 (+   336us) service_pool.cc:224] Handling call
0709 13:10:13.801165 (+ 57296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.842085 (+ 40920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.842130 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.664397 (+822267us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b4c00117e40. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd80efda20 00007fbd80f0ea29 00007fbd80ed4644 00007fbd80efbf2d 00007fbd80efbb93 00007fbd82c2c18b 00007fbd82c2ccb5 00007fbd82c2e004 00007fbd82c2d729 00007fbd82c32d96 00007fbd82c27adb
0709 13:10:14.665587 (+  1190us) log.cc:844] Serialized 572 byte log entry
0709 13:10:14.821758 (+156171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:14.821805 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.821887 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.208340 (+386453us) raft_consensus.cc:1685] finished
0709 13:10:15.208357 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.212486 (+  4129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147814144,"thread_start_us":155666,"threads_started":1,"wal-append.queue_time_us":540205}
I20260709 13:10:15.237154 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.237794 27266 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:15.238672 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.140904 31172 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:15.190312 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 131033us
I20260709 13:10:15.095151 31072 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.191747 30769 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:15.192049 31182 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:15.250094 30972 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.251078 30972 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:15.251480 30972 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.252107 31072 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.228448 31136 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.252399 30972 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.253698 30972 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.253618 31136 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.254688 31136 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.257068 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:15.172672 31146 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.210003 31173 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:15.183396 31175 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:10:15.178826 30718 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.246568 27262 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:15.247641 27266 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:10:15.256883 31130 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:15.273162 27337 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:15.196732 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 117837us
I20260709 13:10:15.167416 31179 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.260273 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:15.272347 27266 pending_rounds.cc:85] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 3
I20260709 13:10:15.274560 27266 pending_rounds.cc:107] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:10:15.274864 27266 raft_consensus.cc:2889] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:15.265388 31197 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:15.279951 30718 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.289397 27262 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:15.290737 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.293449 27262 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:15.196278 31174 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.240944 30885 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:15.281823 30852 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.269763 31173 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.270913 31161 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:15.305295 27259 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.273406 31141 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.241675 31097 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.325563 30889 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:15.327698 31073 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.330008 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1550) took 1756 ms. Trace:
I20260709 13:10:15.332388 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.298834 31194 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.306877 31131 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:15.330440 27414 rpcz_store.cc:276] 0709 13:10:13.573503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.574949 (+  1446us) service_pool.cc:224] Handling call
0709 13:10:13.575309 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:13.620336 (+ 45027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:13.620370 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.066609 (+446239us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.365896 (+299287us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:14.365943 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.366016 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.329752 (+963736us) raft_consensus.cc:1685] finished
0709 13:10:15.329774 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.329922 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137464,"raft.queue_time_us":53903,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":40718,"thread_start_us":146358,"threads_started":1,"wal-append.queue_time_us":1077488}
I20260709 13:10:15.338418 27266 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:15.269446 31182 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:15.330811 31097 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:15.345255 31193 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:15.347438 31124 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.222900 31115 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:15.350988 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51240.1us
I20260709 13:10:15.351763 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:15.318128 31197 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.355955 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.318499 31146 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.322181 31199 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:15.310998 30885 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.393716 27266 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:15.394057 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:15.349363 31131 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.404080 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.418780 27264 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:15.404561 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 544) took 2463 ms. Trace:
I20260709 13:10:15.405200 31174 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.411336 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.421154 27268 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.416996 30900 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.424189 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.425421 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.419355 27416 rpcz_store.cc:276] 0709 13:10:12.941716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.962339 (+ 20623us) service_pool.cc:224] Handling call
0709 13:10:12.990355 (+ 28016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.186474 (+196119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.404297 (+2217823us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54000bd6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:15.404467 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421012864}
I20260709 13:10:15.341179 31072 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:10:15.426049 27266 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:15.429352 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:15.431198 28009 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.395540 31097 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.393285 31124 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:15.397727 31194 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.400903 31199 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:15.436926 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:15.443799 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:15.432920 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:15.437801 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.401501 31127 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.398809 31203 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.440631 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.423511 31131 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.445255 27266 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:15.441430 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:15.450147 28009 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:15.478261 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.533318 27266 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:15.558980 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 117624us
I20260709 13:10:15.560009 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:15.571272 28014 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:15.557823 31203 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.437335 31115 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.572296 30852 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:15.446846 31174 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.592226 31197 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:15.563951 31201 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:10:15.530469 31175 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.558266 31073 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:15.560477 31127 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:15.575249 31194 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.579901 31188 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:15.440156 31097 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.612766 31203 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.440428 31124 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.451363 31091 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.158s
W20260709 13:10:15.634120 31200 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260709 13:10:15.633589 31206 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:10:15.558099 31126 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:15.636934 31126 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:15.637521 31126 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:15.638741 31126 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.643729 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2060) took 1112 ms. Trace:
I20260709 13:10:15.644158 31126 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.651818 31199 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.653594 31199 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.660611 27334 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.644194 27336 rpcz_store.cc:276] 0709 13:10:14.531426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.639831 (+108405us) service_pool.cc:224] Handling call
0709 13:10:15.643511 (+1003680us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002887d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:15.643668 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367605120}
I20260709 13:10:15.624830 31188 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:15.692498 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 248773us
I20260709 13:10:15.692988 31188 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.693653 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:15.694610 31210 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:15.671587 31179 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:15.672827 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.677127 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.696090 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:15.696698 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:15.697556 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.682629 31124 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.684037 30885 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.603951 27266 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
W20260709 13:10:15.685758 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.680810 31097 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.620991 31175 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.699527 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:15.700138 27336 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:15.701345 27264 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:15.702672 31175 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.706746 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.709630 27266 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:15.722692 31144 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:10:15.725044 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.726089 27266 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:15.726717 27259 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:15.676019 27334 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:15.758829 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:15.759863 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63250.2us
I20260709 13:10:15.760923 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:15.761606 27268 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:15.641070 31172 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.800257 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.795193 31210 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:15.801173 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:15.803704 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73576.7us
I20260709 13:10:15.803954 27266 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:15.804491 27380 leader_election.cc:336] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.777s (SENT)
I20260709 13:10:15.805028 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:15.801398 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 361486us
I20260709 13:10:15.756743 31203 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.802642 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:15.804189 27268 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:10:15.807703 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:15.795557 30889 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.814639 27380 leader_election.cc:336] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.818s (SENT)
I20260709 13:10:15.816609 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:15.815847 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:15.803297 31172 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:15.801019 30885 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:15.759639 31144 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.823401 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.805962 31210 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.806965 31072 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.828734 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:15.830582 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:15.835501 31202 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:15.836259 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.836115 31202 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.838635 31202 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.815339 31203 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:15.840430 31185 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.689s	user 0.000s	sys 0.009s
I20260709 13:10:15.841575 31130 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:15.842172 31203 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.829180 31210 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.844170 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:15.831754 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:15.845423 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.845654 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:15.845885 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:15.846112 27336 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:15.846695 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 532) took 2173 ms. Trace:
I20260709 13:10:15.847349 31072 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.834079 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.850205 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.850433 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:15.851528 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:15.916553 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 96455.5us
I20260709 13:10:15.917507 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:15.832582 31144 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.832774 27413 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:15.832540 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.833433 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:15.834039 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.879s (SENT)
W20260709 13:10:15.921200 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 87190.8us
W20260709 13:10:15.921922 27380 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.088s (SENT)
I20260709 13:10:15.922333 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:15.844360 31130 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.923202 31199 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:15.923446 31130 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.926424 31130 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:15.851682 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.852152 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.852303 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.852815 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.928536 27408 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:15.853286 27262 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
W20260709 13:10:15.928869 27380 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.105s (SENT)
I20260709 13:10:15.847114 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:15.851250 27414 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.824579 31211 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:15.930954 31211 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:15.831705 31208 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:10:15.934314 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.855775 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2070) took 1181 ms. Trace:
I20260709 13:10:15.847108 27340 rpcz_store.cc:276] 0709 13:10:13.673190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:13.673384 (+   194us) service_pool.cc:224] Handling call
0709 13:10:13.777891 (+104507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.444687 (+666796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.444731 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.636026 (+191295us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.869357 (+233331us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:14.869393 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.869463 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.839760 (+970297us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:15.846355 (+  6595us) raft_consensus.cc:1685] finished
0709 13:10:15.846377 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.846605 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":294815,"raft.queue_time_us":431439,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":19310,"spinlock_wait_cycles":120663424,"thread_start_us":604190,"threads_started":2,"wal-append.queue_time_us":418924}
I20260709 13:10:15.860344 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:15.860574 31180 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.795s	user 0.016s	sys 0.003s
W20260709 13:10:15.865368 31173 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:10:15.828768 31197 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.850414 31072 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.867744 31151 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:15.803458 31097 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:10:15.807619 31155 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:15.854998 31174 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:15.805274 31124 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:10:15.873284 31142 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:15.877569 27260 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:15.880998 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:15.881918 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:15.883304 31172 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:15.884040 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 558) took 1021 ms. Trace:
I20260709 13:10:15.888886 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.858634 27165 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:15.883668 31210 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.892328 30900 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.960147 27335 raft_consensus.cc:2368] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:15.960704 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2069) took 1286 ms. Trace:
I20260709 13:10:15.961119 27335 rpcz_store.cc:276] 0709 13:10:14.673914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.888584 (+1214670us) service_pool.cc:224] Handling call
0709 13:10:15.960643 (+ 72059us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:15.959813 27417 rpcz_store.cc:276] 0709 13:10:14.862935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.863055 (+   120us) service_pool.cc:224] Handling call
0709 13:10:14.937453 (+ 74398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:15.186405 (+248952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:15.186451 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:15.186510 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:15.186562 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.883795 (+697233us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400317c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:15.883848 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.883979 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571918080}
I20260709 13:10:15.961895 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2346) took 1811 ms. Trace:
I20260709 13:10:15.961731 27165 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:15.962633 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.962908 31216 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:10:15.963580 27417 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:15.963932 27165 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:15.903967 31189 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.731s	user 0.010s	sys 0.000s
I20260709 13:10:15.902209 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:15.906620 31041 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:15.908334 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:15.908780 31091 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.909161 30885 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.817842 30882 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:10:15.910126 31088 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:15.968916 30862 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:15.991453 30862 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.991961 30862 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.991616 31172 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.964604 31210 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:15.953827 31072 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.952142 31097 consensus_queue.cc:1243] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:15.911819 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:15.998581 27263 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:15.915832 27233 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:15.824950 31207 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:15.926924 30718 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:10:16.005270 31207 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.932596 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:16.008167 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.008576 31041 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.009521 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.935117 27408 raft_consensus.cc:2368] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:15.939244 27343 rpcz_store.cc:276] 0709 13:10:14.674217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.703667 (+ 29450us) service_pool.cc:224] Handling call
0709 13:10:15.855607 (+1151940us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002db754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:15.855719 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522387712}
I20260709 13:10:15.933785 31211 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.933895 31202 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:16.011477 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 95773.9us
I20260709 13:10:16.011765 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.010928 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.946362 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.013391 27412 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:16.013523 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.950517 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:15.956203 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 74356.9us
W20260709 13:10:15.954775 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73855.8us
I20260709 13:10:15.955925 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.015230 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.015674 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:15.957743 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2052) took 1565 ms. Trace:
I20260709 13:10:15.948043 27409 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:15.960453 30900 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:15.870987 27259 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:16.015862 27411 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:16.020639 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.020905 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.021451 27334 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:16.022015 27411 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:15.949997 31197 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:15.897836 31184 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.712s	user 0.002s	sys 0.013s
I20260709 13:10:16.030001 27263 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:16.018574 27410 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:16.031476 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.032506 27411 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:16.017669 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.968957 31116 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:16.032521 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:15.946041 31173 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.965412 27342 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:16.035923 27410 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:15.964573 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:15.824216 31093 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.931131 31131 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:15.968698 27338 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:15.962318 27267 rpcz_store.cc:276] 0709 13:10:14.150835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.151019 (+   184us) service_pool.cc:224] Handling call
0709 13:10:14.204020 (+ 53001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.204478 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.204521 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.210904 (+  6383us) log.cc:844] Serialized 26 byte log entry
0709 13:10:14.363612 (+152708us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:14.363650 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.363727 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.813433 (+1449706us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:15.961590 (+148157us) raft_consensus.cc:1685] finished
0709 13:10:15.961612 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.961835 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114800,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":24524,"spinlock_wait_cycles":324503808,"thread_start_us":82692,"threads_started":1,"wal-append.queue_time_us":762422}
I20260709 13:10:16.017033 27339 rpcz_store.cc:276] 0709 13:10:14.392392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.395330 (+  2938us) service_pool.cc:224] Handling call
0709 13:10:15.957525 (+1562195us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b540013f454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:15.957661 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178622336}
I20260709 13:10:15.988430 27260 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:10:15.819382 30889 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:15.953619 31142 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.829707 31127 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.000355 27414 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:16.011605 31202 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:15.927692 31136 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.673s	user 0.014s	sys 0.000s
I20260709 13:10:16.014372 27408 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:15.962354 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.016010 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:16.065188 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 262602us
I20260709 13:10:16.019063 27336 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:15.954110 31155 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.034415 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.070328 27335 raft_consensus.cc:2410] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:10:16.018101 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.022653 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.072134 27334 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:15.986178 27268 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:10:16.018810 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 115614us
I20260709 13:10:16.065886 27340 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.016881 27383 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.026908 31197 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.077802 31207 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.079389 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 607) took 1319 ms. Trace:
I20260709 13:10:16.080191 31144 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.080057 30860 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:16.080876 31144 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.081809 30889 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.083317 31041 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.083853 31041 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.062656 27165 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 7 to 8, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 8 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.086035 31041 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:16.086728 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69934.8us
I20260709 13:10:16.036360 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2067) took 1363 ms. Trace:
I20260709 13:10:16.001570 31072 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:16.087940 27342 rpcz_store.cc:276] 0709 13:10:14.673235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.901918 (+1228683us) service_pool.cc:224] Handling call
0709 13:10:16.036300 (+134382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.086830 30889 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.086377 27165 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 5 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 6 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.094419 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.095037 27339 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.070590 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:16.089246 27412 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:16.067046 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:16.079816 28013 rpcz_store.cc:276] 0709 13:10:14.759755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.759899 (+   144us) service_pool.cc:224] Handling call
0709 13:10:14.760492 (+   593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:14.760867 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:14.760894 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:14.762107 (+  1213us) log.cc:844] Serialized 572 byte log entry
0709 13:10:14.942008 (+179901us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:14.942048 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.942114 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.903204 (+961090us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:16.069724 (+166520us) raft_consensus.cc:1685] finished
0709 13:10:16.069747 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.079298 (+  9551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81522048,"thread_start_us":146940,"threads_started":1,"wal-append.queue_time_us":312016}
I20260709 13:10:16.017490 30718 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:16.092370 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.092818 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.099907 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:16.082334 30862 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.093587 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.053647 31151 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.090591 27409 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 5.
I20260709 13:10:16.105175 27335 raft_consensus.cc:2410] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:16.093611 27413 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:16.063644 31142 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:16.123235 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.122936 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2358) took 1053 ms. Trace:
I20260709 13:10:16.039865 31116 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:16.068009 31073 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.990432 31091 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.120690 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.068199 31093 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:16.130573 27334 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:16.067598 31202 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.131341 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2353) took 1063 ms. Trace:
I20260709 13:10:16.131879 27334 rpcz_store.cc:276] 0709 13:10:15.067550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.107011 (+1039461us) service_pool.cc:224] Handling call
0709 13:10:16.131262 (+ 24251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.132850 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.119663 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.133224 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.133607 27335 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.133901 27263 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:16.134148 27410 raft_consensus.cc:2410] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:16.134204 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2351) took 1067 ms. Trace:
I20260709 13:10:16.134761 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.124257 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:16.124166 27337 rpcz_store.cc:276] 0709 13:10:15.069096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.178792 (+109696us) service_pool.cc:224] Handling call
0709 13:10:16.122646 (+943854us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b5400289bd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:16.122856 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146819840}
I20260709 13:10:16.136847 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.121353 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:16.106695 27231 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.573s (SENT)
I20260709 13:10:16.138288 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.115872 27338 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:16.107635 31141 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.079919 31131 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:16.134865 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 249116us
I20260709 13:10:16.127763 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.142645 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.143424 27265 raft_consensus.cc:2393] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:16.120816 31136 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.162802 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.134790 27335 rpcz_store.cc:276] 0709 13:10:15.066976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.132576 (+1065600us) service_pool.cc:224] Handling call
0709 13:10:16.134147 (+  1571us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:16.164031 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57392.7us
I20260709 13:10:16.164212 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.164402 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:16.164754 27231 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.624s (SENT)
I20260709 13:10:16.140707 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.165198 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.129422 31174 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.173710 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.132050 31210 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:16.140709 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.181510 27262 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.144033 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.139108 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2068) took 1465 ms. Trace:
W20260709 13:10:16.145500 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.182533 27338 rpcz_store.cc:276] 0709 13:10:14.673572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:15.908058 (+1234486us) service_pool.cc:224] Handling call
0709 13:10:16.139051 (+230993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.182992 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:16.183641 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.134927 31130 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:16.121440 31115 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.002s
I20260709 13:10:16.140965 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.206085 27267 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:16.121769 30889 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:16.165040 27335 raft_consensus.cc:2376] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8. Re-sending same reply.
I20260709 13:10:16.207262 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.208003 27335 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:16.208760 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.174659 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:16.174919 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 256208us
I20260709 13:10:16.106535 31041 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.178640 27334 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.217861 27263 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.219139 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:16.219435 27343 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:16.104143 30718 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.186431 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.234005 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.189051 27165 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:16.235926 27165 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 1 to 5, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 5 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:10:16.237661 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 225025us
I20260709 13:10:16.190574 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.161725 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:16.192425 31173 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:16.174015 31175 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.162837 31126 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:16.240398 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.240571 31126 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.241637 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:16.241910 27233 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.799s (SENT)
I20260709 13:10:16.242398 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.243281 31126 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.147986 31141 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:16.244441 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.244812 31141 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.242811 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.238333 27165 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 5, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 5 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.195948 30885 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.197009 31091 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:16.197111 31151 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.251909 31151 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.252020 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:16.203807 27340 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.255883 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2355) took 1187 ms. Trace:
I20260709 13:10:16.174695 27261 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:16.257093 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.257903 27261 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:16.255370 31173 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:10:16.184031 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.256260 27340 rpcz_store.cc:276] 0709 13:10:15.068147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.015749 (+947602us) service_pool.cc:224] Handling call
0709 13:10:16.255822 (+240073us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:16.212517 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47801us
I20260709 13:10:16.262516 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:16.263273 27231 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.837s (SENT)
I20260709 13:10:16.263360 27340 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:16.263720 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.136795 31144 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:16.221815 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 386986us
I20260709 13:10:16.162860 31161 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.244067 31175 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.179857 31174 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.265256 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.254956 27165 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:16.252308 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.266433 27335 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.305577 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2364) took 1097 ms. Trace:
I20260709 13:10:16.269162 27265 raft_consensus.cc:2410] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:16.306360 27335 rpcz_store.cc:276] 0709 13:10:15.207862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.208529 (+1000667us) service_pool.cc:224] Handling call
0709 13:10:16.305516 (+ 96987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.307380 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.163641 31147 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.307937 27335 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:16.270056 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.309170 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.176438 31136 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:16.177203 31073 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:16.297705 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 136110us
I20260709 13:10:16.305002 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.321177 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:16.321435 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 138517us
I20260709 13:10:16.276942 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:16.323414 27262 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.310791 27342 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.324045 27261 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:16.324618 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2369) took 1044 ms. Trace:
I20260709 13:10:16.325102 27342 rpcz_store.cc:276] 0709 13:10:15.280546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.210182 (+929636us) service_pool.cc:224] Handling call
0709 13:10:16.324538 (+114356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.313745 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:16.314571 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 62353.8us
I20260709 13:10:16.326431 28013 raft_consensus.cc:2368] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12.
I20260709 13:10:16.327243 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.316237 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.318048 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:16.194537 31072 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.261427 31203 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.360137 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.360826 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.322672 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.220165 31210 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:16.362772 31210 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.362808 27262 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:16.364758 27417 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:16.329874 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.366447 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:16.367517 27417 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.367581 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.368281 27335 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.333575 27265 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:16.335193 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.336553 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.337452 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.371323 27416 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:16.342242 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.298379 31129 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.291109 31173 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:16.304247 31194 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:10:16.328974 31144 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:16.328429 30885 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:16.313867 31174 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.328644 31091 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.348439 31175 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.351522 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.352212 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.352635 31179 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.286365 31097 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.355397 31219 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:16.355752 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:16.356192 31188 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 13:10:16.356410 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.374300 31129 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:16.358636 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.358810 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.328778 31161 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:16.371250 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.442679 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2348) took 1376 ms. Trace:
I20260709 13:10:16.443122 27336 rpcz_store.cc:276] 0709 13:10:15.066169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.370970 (+1304801us) service_pool.cc:224] Handling call
0709 13:10:16.442601 (+ 71631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.344172 27267 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:16.371016 27260 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 5.
I20260709 13:10:16.414075 31091 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.287634 31130 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:16.426560 31216 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:16.404662 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 82080.4us
I20260709 13:10:16.458035 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:16.405622 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 326949us
I20260709 13:10:16.329840 31136 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.409446 27334 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:16.261277 31041 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.304390 31116 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:16.417912 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 75786.7us
I20260709 13:10:16.464439 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.398012 31126 raft_consensus.cc:2764] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:16.420917 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.439906 31129 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:16.467226 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 140088us
I20260709 13:10:16.285288 30718 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.374537 31173 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:16.439235 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.398460 31115 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.446202 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.479750 27410 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:16.386950 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.337409 31147 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.433830 30862 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:16.449132 30889 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.452265 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.461231 31216 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:16.455669 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 192436us
W20260709 13:10:16.490609 27231 leader_election.cc:336] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.959s (SENT)
I20260709 13:10:16.402642 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:16.421470 31179 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:16.461015 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2349) took 1394 ms. Trace:
I20260709 13:10:16.504549 27339 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:16.444387 31141 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.511982 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.513592 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.515484 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.429441 27417 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:16.470609 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.471074 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:16.477052 31172 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:16.517025 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46035.6us
I20260709 13:10:16.475178 31155 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.474557 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.431821 31211 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:16.523232 31220 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:10:16.523037 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.524340 31207 raft_consensus.cc:2764] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:16.524823 31211 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:16.525202 31230 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.525666 31230 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:16.526124 31230 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.527184 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.527799 27409 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:16.529100 31211 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:16.529791 31175 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.505012 31216 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.532686 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.533316 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.480973 27340 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.466285 27335 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:16.337747 31093 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:16.483269 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.455439 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.534148 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.539278 27336 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.440173 31188 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.488497 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:16.511722 31179 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.435768 31097 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.512393 31118 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:16.504637 27334 rpcz_store.cc:276] 0709 13:10:15.066436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.132844 (+1066408us) service_pool.cc:224] Handling call
0709 13:10:16.460945 (+328101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.505383 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2078) took 1184 ms. Trace:
I20260709 13:10:16.562369 27339 rpcz_store.cc:276] 0709 13:10:15.320624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.059358 (+738734us) service_pool.cc:224] Handling call
0709 13:10:16.505315 (+445957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.459494 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:16.563834 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 104420us
I20260709 13:10:16.506634 27414 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:16.569119 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.569983 27339 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:16.466929 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:16.482409 31116 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.474459 27380 leader_election.cc:400] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12.
I20260709 13:10:16.574777 27380 leader_election.cc:403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.454465 31091 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.514789 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.520186 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:16.579993 27267 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:16.544152 31207 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:16.538318 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 67795.6us
I20260709 13:10:16.585736 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.585879 27233 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:16.538659 27259 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.461014 31215 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.541230 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:16.546620 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.493093 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:16.588280 27410 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:16.389662 31073 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.505491 31217 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.462940 28006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:16.560353 27266 raft_consensus.cc:1217] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-10.6]   Dedup: 5.4->[8.5-10.6]
I20260709 13:10:16.516948 31172 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.572582 27408 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:16.561518 31115 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:16.575752 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2074) took 1255 ms. Trace:
I20260709 13:10:16.601804 27339 rpcz_store.cc:276] 0709 13:10:15.319974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.563152 (+1243178us) service_pool.cc:224] Handling call
0709 13:10:16.575693 (+ 12541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.576484 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:16.576960 27308 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.573419 27415 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:16.568320 27340 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:16.535112 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.604439 27335 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.605847 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.581344 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:16.584241 27342 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:16.590481 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:16.591675 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50577.1us
I20260709 13:10:16.542865 31199 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:16.573282 30977 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:16.618292 27335 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:16.542079 31211 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.599483 27408 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:16.595151 27266 pending_rounds.cc:85] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:10:16.543040 31197 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:10:16.573616 31123 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:16.592558 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46027.6us
I20260709 13:10:16.597622 31072 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:16.596654 30680 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:16.596719 27336 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:16.619835 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.622920 28008 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:16.517338 31161 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.571404 31118 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.683108 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.683323 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.684489 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:16.685923 27266 pending_rounds.cc:107] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:10:16.624313 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:16.598585 31219 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:16.692725 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.607031 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.703354 27266 raft_consensus.cc:2889] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:16.703981 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 97020.2us
I20260709 13:10:16.704687 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.600777 31172 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.696914 28009 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.705858 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.706017 27339 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:16.554359 31130 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.708422 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.623780 27410 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:16.709559 27340 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:16.607987 31159 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12.
I20260709 13:10:16.543951 31173 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:16.734130 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.696985 31072 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.704970 27308 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:16.736392 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.736505 31219 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:16.734869 27336 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:16.692054 31123 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:16.739869 27337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2350) took 1673 ms (client timeout 2105 ms). Trace:
W20260709 13:10:16.763414 27337 rpcz_store.cc:269] 0709 13:10:15.066689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.137336 (+1070647us) service_pool.cc:224] Handling call
0709 13:10:16.715377 (+578041us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002db254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:16.739809 (+ 24432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053213568}
I20260709 13:10:16.704545 31203 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:16.693912 31231 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.623036 31126 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:16.753458 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.769722 27339 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:16.709215 31088 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.698637 27335 raft_consensus.cc:2410] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:10:16.710690 31210 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:16.594476 31215 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:16.779717 31224 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:10:16.738127 31198 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:10:16.781106 31219 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.782527 31073 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:16.733311 31041 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:16.783663 31232 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:10:16.600871 31115 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.762233 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:16.764955 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 537) took 2135 ms. Trace:
I20260709 13:10:16.789844 27339 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:16.790462 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2062) took 2135 ms. Trace:
I20260709 13:10:16.790839 27339 rpcz_store.cc:276] 0709 13:10:14.655297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.770409 (+2115112us) service_pool.cc:224] Handling call
0709 13:10:16.789679 (+ 19270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.790234 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.790410 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.610074 30900 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.708464 30965 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:16.767948 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63041.2us
I20260709 13:10:16.756342 27416 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:16.798437 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:16.732075 31226 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.767628 31123 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:16.777628 31229 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:10:16.778770 31194 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:16.751441 31222 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:16.772420 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 186613us
I20260709 13:10:16.915946 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:16.757491 31221 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
W20260709 13:10:16.785847 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 271106us
I20260709 13:10:16.920282 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.788389 27340 rpcz_store.cc:276] 0709 13:10:14.629400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.763984 (+2134584us) service_pool.cc:224] Handling call
0709 13:10:16.764416 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.764642 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.764669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.764709 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.764746 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.764803 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.764898 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.763506 31072 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:16.762847 30885 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:16.796502 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 202914us
I20260709 13:10:16.789686 31115 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:16.739679 31211 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:16.784492 31210 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:16.790503 31173 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:16.874568 31238 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:16.877178 31141 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.878626 31147 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:16.786760 31231 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:16.789567 31203 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:16.800895 31202 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260709 13:10:16.799005 31144 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:16.907569 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2356) took 1839 ms. Trace:
W20260709 13:10:16.954094 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.907912 27339 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:16.769022 31242 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:16.927081 31250 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:16.930406 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:16.941784 31142 consensus_meta.cc:287] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.806s	user 0.003s	sys 0.007s
I20260709 13:10:16.942924 31118 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.945106 31188 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:16.948340 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:16.922670 31222 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:16.954366 27335 rpcz_store.cc:276] 0709 13:10:15.068454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.806766 (+1738312us) service_pool.cc:224] Handling call
0709 13:10:16.807129 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.907198 (+100069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.907227 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.907281 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:16.907317 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.907373 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:16.907508 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.949108 31194 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:16.955013 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2076) took 1634 ms. Trace:
I20260709 13:10:16.960810 28014 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:16.935487 31210 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:16.866444 31124 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:16.572889 31155 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 5 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:16.965556 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.024843 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:16.965857 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 493157us
I20260709 13:10:17.026264 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.013128 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 534) took 2517 ms. Trace:
I20260709 13:10:17.017562 27339 rpcz_store.cc:276] 0709 13:10:15.320297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.791792 (+1471495us) service_pool.cc:224] Handling call
0709 13:10:16.865762 (+ 73970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.954600 (+ 88838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.954954 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:16.962309 31207 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.020900 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 72652.8us
I20260709 13:10:16.962505 31242 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:17.028383 27334 rpcz_store.cc:276] 0709 13:10:14.495971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.755363 (+2259392us) service_pool.cc:224] Handling call
0709 13:10:16.783525 (+ 28162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.783739 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:16.784016 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.012596 (+228580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.012673 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.012740 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.012849 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.013044 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2232,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":5316,"thread_start_us":228074,"threads_started":1}
I20260709 13:10:16.970890 31097 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:16.962459 31245 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:17.043236 27231 leader_election.cc:400] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:17.030735 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:17.019934 31136 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.005s
I20260709 13:10:17.016593 31147 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:17.033190 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.047420 27413 raft_consensus.cc:2376] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8. Re-sending same reply.
I20260709 13:10:17.044659 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:17.019851 31222 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.049671 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:16.962610 31202 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:17.093961 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60861.2us
I20260709 13:10:17.019709 31124 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:17.095148 27416 raft_consensus.cc:2376] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10. Re-sending same reply.
I20260709 13:10:17.079599 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.096894 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.100996 27231 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.092841 27339 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:17.108978 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.004873 31142 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.031576 31252 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.113154 27341 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.031631 31118 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:17.126430 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.077461 31245 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.104571 31124 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.070799 31147 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.104936 31175 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:17.127948 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.105337 31197 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.038007 31207 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.077620 31136 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.111100 31250 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.107676 31141 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:17.195214 28013 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:17.169915 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43560.9us
I20260709 13:10:17.209208 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.131675 31254 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:17.194928 31230 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.668s	user 0.029s	sys 0.003s
W20260709 13:10:17.170681 31233 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.181s	user 0.000s	sys 0.002s
W20260709 13:10:17.222566 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 94692.7us
I20260709 13:10:17.198041 31147 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.217208 31175 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.225102 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.225109 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:17.208607 30718 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.000s
I20260709 13:10:17.235391 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.235334 30718 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.233101 31249 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.236949 31249 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.237744 30718 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:17.202764 31161 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:17.168582 31246 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:17.238042 31249 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:17.231199 31151 consensus_meta.cc:287] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.979s	user 0.007s	sys 0.013s
I20260709 13:10:17.241299 31151 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.240754 31211 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:17.226799 31123 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.244314 30718 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.245222 31161 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:17.245673 31123 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:17.246366 31161 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.247922 27411 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:17.250772 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.251623 30718 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.243849 31151 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:17.252851 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.253466 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:17.254505 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.255740 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.256469 31252 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.257537 31243 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:17.257201 31252 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.259611 31136 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.260347 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.259603 31252 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.261225 31252 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:17.261662 31210 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.262890 30718 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:17.263425 31254 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.264266 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.266032 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2374) took 1101 ms. Trace:
I20260709 13:10:17.266546 27337 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:17.266431 27334 rpcz_store.cc:276] 0709 13:10:16.164885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.037043 (+872158us) service_pool.cc:224] Handling call
0709 13:10:17.092361 (+ 55318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.096786 (+  4425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.096820 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.097390 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:10:17.216793 (+119403us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.216860 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.220848 (+  3988us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.265810 (+ 44962us) raft_consensus.cc:1685] finished
0709 13:10:17.265828 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.265971 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3861,"raft.queue_time_us":4760,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5608,"thread_start_us":53984,"threads_started":1,"wal-append.queue_time_us":99601}
I20260709 13:10:17.137506 31118 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.211427 31141 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.235575 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.281927 28009 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:10:17.226691 31216 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.005s
I20260709 13:10:17.292650 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.210721 31250 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.134476 31203 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.313087 28014 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:17.295751 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.296833 27334 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:17.329730 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2376) took 1164 ms. Trace:
I20260709 13:10:17.330188 27334 rpcz_store.cc:276] 0709 13:10:16.165413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.268361 (+1102948us) service_pool.cc:224] Handling call
0709 13:10:17.296596 (+ 28235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.329441 (+ 32845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.329660 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.293026 28008 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:17.331585 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.113613 31231 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.203984 31194 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.279389 31252 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.279364 31244 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:17.342947 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2352) took 2275 ms (client timeout 1832 ms). Trace:
I20260709 13:10:17.288944 31141 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:17.343458 27343 rpcz_store.cc:269] 0709 13:10:15.067275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.011535 (+944260us) service_pool.cc:224] Handling call
0709 13:10:17.342759 (+1331224us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540014bed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.342880 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302384896}
I20260709 13:10:17.228384 31175 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.352221 31253 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.353258 31202 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:17.359114 31172 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.601s	user 0.003s	sys 0.005s
I20260709 13:10:17.359972 31172 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:17.364248 31179 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.800s	user 0.007s	sys 0.003s
I20260709 13:10:17.364477 31115 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.364764 31179 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.365437 31172 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.366778 31115 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:17.368166 31091 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.774s	user 0.015s	sys 0.000s
I20260709 13:10:17.368613 31091 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.371462 28015 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:10:17.371753 31258 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:10:17.372115 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:17.372699 27413 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:17.349000 31240 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:10:17.373803 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.376142 31118 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.377166 31179 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.377800 31179 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.296087 31250 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.233501 31230 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.365754 27415 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:17.365916 27264 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:17.384320 27413 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:17.295740 31216 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.370949 31091 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:17.397593 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1573) took 1542 ms. Trace:
I20260709 13:10:17.399391 28006 raft_consensus.cc:606] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.399724 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1458) took 1282 ms. Trace:
I20260709 13:10:17.417618 28006 raft_consensus.cc:614] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.417702 27259 rpcz_store.cc:276] 0709 13:10:16.116833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.128446 (+ 11613us) service_pool.cc:224] Handling call
0709 13:10:16.128749 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.586863 (+458114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.399495 (+812632us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54001b8fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.399639 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942340864}
I20260709 13:10:17.399725 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.395848 27417 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:17.421021 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2010) took 1562 ms. Trace:
I20260709 13:10:17.421519 27417 rpcz_store.cc:276] 0709 13:10:15.858958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.544084 (+685126us) service_pool.cc:224] Handling call
0709 13:10:17.395257 (+851173us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:17.395470 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.420654 (+ 25184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.420946 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5262720}
W20260709 13:10:17.422850 27231 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.706s (SENT)
I20260709 13:10:17.416591 27412 rpcz_store.cc:276] 0709 13:10:15.855501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.132929 (+277428us) service_pool.cc:224] Handling call
0709 13:10:17.397341 (+1264412us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540036ae54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.397486 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2686176128}
I20260709 13:10:17.348927 31246 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:17.399108 31116 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.002s
I20260709 13:10:17.351377 31244 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:17.378407 31179 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.399792 31142 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.342097 31147 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.365480 31242 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.350526 31252 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.342303 31245 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.434290 31210 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.588209 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.590615 31244 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:17.509271 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:17.572119 31174 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.139s	user 0.013s	sys 0.000s
I20260709 13:10:17.592988 31144 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:17.565395 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:17.594574 31174 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.592509 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 550) took 1115 ms. Trace:
I20260709 13:10:17.594667 31144 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.595935 27338 raft_consensus.cc:2368] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9.
I20260709 13:10:17.596817 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:17.596938 27338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2366) took 2370 ms (client timeout 2244 ms). Trace:
W20260709 13:10:17.597530 27338 rpcz_store.cc:269] 0709 13:10:15.226632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.233606 (+1006974us) service_pool.cc:224] Handling call
0709 13:10:17.596729 (+1363123us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002891d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.596875 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3130077440}
I20260709 13:10:17.598482 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.595782 27264 rpcz_store.cc:276] 0709 13:10:16.476642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.476826 (+   184us) service_pool.cc:224] Handling call
0709 13:10:16.489532 (+ 12706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.390242 (+900710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.592236 (+201994us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b5400308ed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.592448 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015131008}
I20260709 13:10:17.599663 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.600242 27262 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:17.600318 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.601395 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:17.602227 30965 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.766s	user 0.005s	sys 0.005s
I20260709 13:10:17.602348 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.602783 27416 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
W20260709 13:10:17.603191 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 850969us
I20260709 13:10:17.603467 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2380) took 1436 ms. Trace:
I20260709 13:10:17.602860 27264 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.604127 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.605412 31252 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.607232 31202 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.607749 31202 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:17.608537 31174 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.608639 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:17.466058 31216 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:17.609661 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.510s (SENT) [suppressed 41 similar messages]
I20260709 13:10:17.609848 31216 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:17.555498 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:17.611632 27334 raft_consensus.cc:1240] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:17.611920 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 56507.8us
I20260709 13:10:17.525163 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 476) took 1068 ms. Trace:
I20260709 13:10:17.613575 28013 rpcz_store.cc:276] 0709 13:10:16.456663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.456790 (+   127us) service_pool.cc:224] Handling call
0709 13:10:17.516424 (+1059634us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54004d30d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.525068 (+  8644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607305472}
I20260709 13:10:17.533514 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.603870 27338 rpcz_store.cc:276] 0709 13:10:16.166614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.598411 (+1431797us) service_pool.cc:224] Handling call
0709 13:10:17.598725 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.598908 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.598931 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.598969 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:17.599005 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.599061 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.603409 (+  4348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.466241 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 533) took 2973 ms. Trace:
I20260709 13:10:17.616786 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.486833 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 535) took 2990 ms. Trace:
I20260709 13:10:17.617519 28008 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
I20260709 13:10:17.617789 27336 rpcz_store.cc:276] 0709 13:10:14.496270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.758776 (+2262506us) service_pool.cc:224] Handling call
0709 13:10:16.777154 (+ 18378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:16.785112 (+  7958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.785146 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:16.785191 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:16.785239 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.486542 (+701303us) spinlock_profiling.cc:243] Waited 7.78 ms on lock 0x7b54003304d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.486599 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.486767 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17893760}
I20260709 13:10:17.576742 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.620229 27268 raft_consensus.cc:2368] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
W20260709 13:10:17.437685 27980 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.016s
W20260709 13:10:17.621476 27980 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.013s	sys 0.021s
W20260709 13:10:17.622519 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 807396us
W20260709 13:10:17.587477 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.244s (SENT)
I20260709 13:10:17.617029 27341 rpcz_store.cc:276] 0709 13:10:14.495601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.024160 (+1528559us) service_pool.cc:224] Handling call
0709 13:10:16.024562 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.124314 (+1099752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.465960 (+341646us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540013f954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.466163 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2495901056}
I20260709 13:10:17.610759 31216 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:17.556176 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:17.630255 27264 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
W20260709 13:10:17.637560 27411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1570) took 1783 ms (client timeout 2356 ms). Trace:
I20260709 13:10:17.637418 31249 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:17.638206 30972 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:17.638085 27411 rpcz_store.cc:269] 0709 13:10:15.854541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.091972 (+237431us) service_pool.cc:224] Handling call
0709 13:10:17.637350 (+1545378us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540010f254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.637499 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2628217088}
I20260709 13:10:17.638636 31249 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:17.639094 31249 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.639001 30972 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.553968 31175 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:17.611984 31256 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.413s	user 0.003s	sys 0.000s
I20260709 13:10:17.641397 27340 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:17.650267 27338 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:17.672363 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 541) took 1441 ms. Trace:
I20260709 13:10:17.672787 27338 rpcz_store.cc:276] 0709 13:10:16.231006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.616589 (+1385583us) service_pool.cc:224] Handling call
0709 13:10:17.629301 (+ 12712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.672012 (+ 42711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.672302 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.652382 27341 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:17.653590 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 43920.5us
I20260709 13:10:17.674283 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 544) took 1362 ms. Trace:
I20260709 13:10:17.674420 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.674777 27341 rpcz_store.cc:276] 0709 13:10:16.312073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.627485 (+1315412us) service_pool.cc:224] Handling call
0709 13:10:17.651957 (+ 24472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.674031 (+ 22074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.674230 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:17.631042 31216 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:17.655957 30882 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:17.656633 31041 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:17.467031 31129 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.978s	user 0.009s	sys 0.003s
I20260709 13:10:17.688311 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:17.514528 31248 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.736s	user 0.004s	sys 0.000s
I20260709 13:10:17.683269 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:17.696606 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.664189 27411 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:17.664793 27262 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:17.699860 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:17.650588 31198 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.596993 31215 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.654489 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.511394 31207 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.679955 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:17.681165 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.592552 31179 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.640010 31252 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:17.683249 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.711301 27268 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:17.672369 31175 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.668891 31254 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.670485 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:17.631407 31203 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:17.687274 31129 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.662482 27978 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:17.668025 27383 leader_election.cc:400] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
I20260709 13:10:17.680395 31249 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.704715 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:17.705109 31237 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.914s	user 0.002s	sys 0.003s
I20260709 13:10:17.705314 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 538) took 3060 ms. Trace:
I20260709 13:10:17.608574 31202 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.670449 31141 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.714982 31252 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:17.705837 31231 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:17.669584 31242 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:17.711038 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:17.726996 31218 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:17.765183 27411 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:17.705331 30885 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:10:17.669926 31210 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.773064 31210 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:17.773833 31072 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.004s
I20260709 13:10:17.774325 31072 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.684897 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:17.720911 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 555) took 1180 ms. Trace:
I20260709 13:10:17.464735 31124 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:17.720870 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 203393us
I20260709 13:10:17.775431 27267 rpcz_store.cc:276] 0709 13:10:16.542108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.580709 (+ 38601us) service_pool.cc:224] Handling call
0709 13:10:16.581045 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:16.584263 (+  3218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:16.584309 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:16.584899 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:10:16.747850 (+162951us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:16.749716 (+  1866us) log.cc:844] Serialized 14 byte log entry
0709 13:10:16.790669 (+ 40953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:16.790777 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.513800 (+723023us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:17.706550 (+192750us) raft_consensus.cc:1685] finished
0709 13:10:17.720618 (+ 14068us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.720829 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81833,"prepare.queue_time_us":1707,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":36623,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":15532,"spinlock_wait_cycles":15524736,"thread_start_us":93961,"threads_started":2,"wal-append.queue_time_us":160215}
I20260709 13:10:17.781356 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.782970 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:17.724974 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54617.7us
W20260709 13:10:17.729043 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74628.9us
W20260709 13:10:17.729988 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67579us
I20260709 13:10:17.785519 27233 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:17.785693 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.786546 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.731684 27383 leader_election.cc:403] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:17.704751 31088 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.735580 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.736866 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.738569 27337 rpcz_store.cc:276] 0709 13:10:14.644537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.764462 (+2119925us) service_pool.cc:224] Handling call
0709 13:10:16.788624 (+ 24162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.267029 (+478405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.705069 (+438040us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b5400260054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.705248 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098694528}
I20260709 13:10:17.426000 31130 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.245s
I20260709 13:10:17.738349 31268 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:17.743075 31270 log.cc:927] Time spent T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: Append to log took a long time: real 0.195s	user 0.005s	sys 0.000s
I20260709 13:10:17.742857 31203 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.743902 31249 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.744191 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.728936 30889 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:17.733165 31253 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:17.745414 31179 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:17.748090 31129 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:17.748577 31175 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.503281 31246 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.748857 27409 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.768330 31218 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:17.725917 31277 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:17.758836 27410 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:17.760402 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.761976 31041 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:17.762405 31271 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.282s	user 0.002s	sys 0.004s
I20260709 13:10:17.683549 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.806985 31118 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.788486 27342 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:17.788494 27417 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 6: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:17.789345 27268 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:17.835813 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:17.836481 27263 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:17.837355 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:17.787432 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 119560us
W20260709 13:10:17.839605 31265 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.380s	user 0.000s	sys 0.011s
I20260709 13:10:17.839926 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:17.840823 31147 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.841950 31203 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:17.843137 31141 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.843778 31141 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.844194 31124 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.807744 31253 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.795418 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.847003 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1472) took 1310 ms. Trace:
W20260709 13:10:17.847340 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 52019us
I20260709 13:10:17.847393 27266 rpcz_store.cc:276] 0709 13:10:16.536569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.537043 (+   474us) service_pool.cc:224] Handling call
0709 13:10:16.560181 (+ 23138us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:10:17.035061 (+474880us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:17.117391 (+ 82330us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.318501 (+201110us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.637075 (+318574us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:17.644497 (+  7422us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.644696 (+   199us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:17.644989 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.659503 (+ 14514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.659603 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.770041 (+110438us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:17.846782 (+ 76741us) raft_consensus.cc:1685] finished
0709 13:10:17.846805 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:17.846950 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9872,"prepare.queue_time_us":88100,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":116,"raft.queue_time_us":158795,"raft.run_cpu_time_us":491,"raft.run_wall_time_us":32928,"spinlock_wait_cycles":99183360,"thread_start_us":703625,"threads_started":3,"wal-append.queue_time_us":207144}
I20260709 13:10:17.849963 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:17.812263 31179 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:17.717782 31198 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.733438 31211 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:17.819306 31277 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:17.763520 31252 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:17.808750 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 121258us
I20260709 13:10:17.814224 31257 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:10:17.810725 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:17.731645 31254 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:17.813021 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.012745 27338 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:17.813759 27336 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:17.815361 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:18.014456 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:17.998998 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:18.015348 27337 raft_consensus.cc:2368] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11.
I20260709 13:10:18.015589 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:18.016244 27413 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:18.017154 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:18.018163 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:18.018709 27413 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:17.787130 31116 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:17.799077 31173 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.797420 31088 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:17.797164 31174 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:17.733268 30882 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:17.801194 31230 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:17.811298 31207 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.796029 27267 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 8: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:17.853683 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2079) took 2532 ms. Trace:
I20260709 13:10:17.855998 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2378) took 1690 ms. Trace:
I20260709 13:10:18.047420 27334 rpcz_store.cc:276] 0709 13:10:16.166020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.332036 (+1166016us) service_pool.cc:224] Handling call
0709 13:10:17.611389 (+279353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.612220 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.855820 (+243600us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002891d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.855942 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616422272}
I20260709 13:10:17.857632 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:18.047363 27340 rpcz_store.cc:276] 0709 13:10:15.320797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.927180 (+1606383us) service_pool.cc:224] Handling call
0709 13:10:16.927623 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.671868 (+744245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.853347 (+181479us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54001680d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:17.853607 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1640774016}
I20260709 13:10:17.845786 31253 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:17.928246 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.088582 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:17.816561 30889 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:17.980986 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:18.041627 31173 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:17.995113 27268 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:17.802634 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1581) took 1468 ms. Trace:
I20260709 13:10:17.821399 31175 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.002302 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:17.809260 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:18.091802 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:18.092257 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 283064us
I20260709 13:10:18.092533 27340 raft_consensus.cc:2376] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:18.093832 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:17.981652 31231 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:17.858985 31161 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:17.980244 31179 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.983500 30965 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.035702 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:17.981135 31210 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:17.833897 31041 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:18.042315 28014 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 479) took 1556 ms (client timeout 1510 ms). Trace:
I20260709 13:10:18.002270 31277 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.044881 27413 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
W20260709 13:10:18.109014 28014 rpcz_store.cc:269] 0709 13:10:16.485435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.485557 (+   122us) service_pool.cc:224] Handling call
0709 13:10:18.042106 (+1556549us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400601654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:18.042235 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956611328}
I20260709 13:10:18.046231 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.116494 27337 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:18.117291 28011 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:18.120005 27410 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:18.122987 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 336466us
I20260709 13:10:18.076180 28006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35486 (request call id 0) took 1632 ms. Trace:
I20260709 13:10:18.081135 31209 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:18.084143 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:18.146819 27264 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 6: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:18.086910 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:18.090893 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:18.149457 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58652.1us
W20260709 13:10:18.149457 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 405314us
I20260709 13:10:17.981968 31147 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:18.090605 27414 rpcz_store.cc:276] 0709 13:10:16.334683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.452016 (+117333us) service_pool.cc:224] Handling call
0709 13:10:17.802464 (+1350448us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54000e8b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:17.802580 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50123008}
I20260709 13:10:18.036685 30972 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:18.015834 31124 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:10:18.105111 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:18.106312 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:18.152518 27340 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:18.125590 27268 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:18.153251 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.153438 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.154155 27340 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.154615 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:18.155478 31147 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:18.155874 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:18.156451 28013 raft_consensus.cc:2376] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9. Re-sending same reply.
I20260709 13:10:18.127830 27413 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:18.156862 31147 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.044881 27417 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:18.136624 27338 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:18.126808 28006 rpcz_store.cc:276] 0709 13:10:16.456266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.456436 (+   170us) service_pool.cc:224] Handling call
0709 13:10:18.075909 (+1619473us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54004d3d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2b853 00007fbd87bf960a 00007fbd8117f7d4 00007fbd8117f762 00007fbd8117f691 00007fbd8117f60c 00007fbd8117e8c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:18.076052 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849242496}
I20260709 13:10:18.159994 30882 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:18.160142 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.160887 30882 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:18.161844 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.163223 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.099928 30885 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.164325 27261 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:18.101080 31161 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:18.184562 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 56318.5us
I20260709 13:10:18.192427 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:18.189487 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:18.044741 31174 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.190894 27410 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:18.108407 31231 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:18.106261 31230 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:18.120374 31253 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:18.090052 31207 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.206911 27266 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:18.162153 30882 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.200379 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:18.107096 31073 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:10:18.103324 31175 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.202917 27340 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:18.237643 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:18.220052 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1585) took 1688 ms. Trace:
I20260709 13:10:18.191685 31072 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:18.231539 27338 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:18.195437 31244 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:18.239442 27415 rpcz_store.cc:276] 0709 13:10:16.531209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.731770 (+200561us) service_pool.cc:224] Handling call
0709 13:10:16.762221 (+ 30451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.389792 (+627571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.219693 (+829901us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54000e8654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:18.219975 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1387388672}
I20260709 13:10:18.240478 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:18.203913 30889 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.204099 31173 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.266878 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:18.247668 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2385) took 1915 ms. Trace:
I20260709 13:10:18.290292 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 564) took 2389 ms. Trace:
I20260709 13:10:18.282162 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2089) took 1852 ms. Trace:
I20260709 13:10:18.247561 27334 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:18.327953 27338 rpcz_store.cc:276] 0709 13:10:16.332022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.246767 (+1914745us) service_pool.cc:224] Handling call
0709 13:10:18.247020 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.247209 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.247249 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.247311 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:18.247366 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.247445 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.247591 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.289373 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:18.323915 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 230422us
I20260709 13:10:18.257776 27263 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:18.278137 27264 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.329814 27408 rpcz_store.cc:276] 0709 13:10:15.900572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.685540 (+784968us) service_pool.cc:224] Handling call
0709 13:10:17.803113 (+1117573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.803437 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.803463 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:17.803501 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.803531 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.803585 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.290090 (+486505us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000e8b50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:18.290229 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569576832}
I20260709 13:10:18.329952 27342 rpcz_store.cc:276] 0709 13:10:16.429788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.735656 (+305868us) service_pool.cc:224] Handling call
0709 13:10:18.281897 (+1546241us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:18.282090 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299714816}
I20260709 13:10:18.243584 31290 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:10:18.341099 31290 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:18.341646 31290 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.330914 27338 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:18.335125 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:18.332413 27264 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:18.343631 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2082) took 1915 ms. Trace:
I20260709 13:10:18.344688 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:18.345477 27264 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:18.323652 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.344178 27338 rpcz_store.cc:276] 0709 13:10:16.427998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.330130 (+1902132us) service_pool.cc:224] Handling call
0709 13:10:18.330578 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.343208 (+ 12630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.343513 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.353163 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:18.354617 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:18.355780 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:18.206152 31161 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:18.356292 27338 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:18.358530 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2084) took 1930 ms. Trace:
I20260709 13:10:18.287946 31174 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:18.358948 27338 rpcz_store.cc:276] 0709 13:10:16.428504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.351409 (+1922905us) service_pool.cc:224] Handling call
0709 13:10:18.351892 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.358245 (+  6353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.358472 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:18.281239 31269 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.816s	user 0.005s	sys 0.015s
W20260709 13:10:18.275043 31281 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:10:18.394132 27342 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:18.333360 31280 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:10:18.246937 31202 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.290100 31291 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:18.399953 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2083) took 1971 ms. Trace:
I20260709 13:10:18.411077 27342 rpcz_store.cc:276] 0709 13:10:16.428240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.335954 (+1907714us) service_pool.cc:224] Handling call
0709 13:10:18.393879 (+ 57925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.399644 (+  5765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.399885 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.286176 31073 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:18.209290 31230 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.246501 31244 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:18.397118 31297 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:18.402119 31174 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:18.409514 31299 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:18.352910 31250 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.912s	user 0.012s	sys 0.001s
I20260709 13:10:18.283190 27335 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:10:18.357111 31198 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:18.393339 31124 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:18.489220 27342 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:18.499857 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2388) took 2004 ms. Trace:
I20260709 13:10:18.500214 27342 rpcz_store.cc:276] 0709 13:10:16.495770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.412289 (+1916519us) service_pool.cc:224] Handling call
0709 13:10:18.488802 (+ 76513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.499515 (+ 10713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.499786 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.399951 31300 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:18.544852 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:18.410300 31217 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:18.594121 27342 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:18.594888 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2007) took 2736 ms. Trace:
I20260709 13:10:18.344023 31290 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:18.543145 31175 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:18.484192 31254 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:18.410770 31291 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.595497 27409 rpcz_store.cc:276] 0709 13:10:15.858003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.528418 (+670415us) service_pool.cc:224] Handling call
0709 13:10:16.528705 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.816373 (+1287668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.594506 (+778133us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540027d154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:18.594798 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805528448}
I20260709 13:10:18.495599 31303 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.356916 31231 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.648736 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2384) took 1093 ms. Trace:
I20260709 13:10:18.543911 31041 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:18.423123 31202 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:10:18.649425 27265 rpcz_store.cc:276] 0709 13:10:17.554885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.556320 (+  1435us) service_pool.cc:224] Handling call
0709 13:10:17.556643 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:17.556999 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.557031 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:17.564880 (+  7849us) log.cc:844] Serialized 52 byte log entry
0709 13:10:17.784161 (+219281us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:17.784217 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.784352 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:18.648361 (+864009us) raft_consensus.cc:1685] finished
0709 13:10:18.648398 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.648645 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":801,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10837,"thread_start_us":186198,"threads_started":1,"wal-append.queue_time_us":404184}
I20260709 13:10:18.449417 31073 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:18.608224 30972 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.739815 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1476) took 1008 ms. Trace:
I20260709 13:10:18.747943 27265 rpcz_store.cc:276] 0709 13:10:17.731301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.738653 (+1007352us) service_pool.cc:224] Handling call
0709 13:10:18.739105 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.739376 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.739414 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.739469 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:18.739516 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.739591 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.739740 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.501109 31250 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.833508 27259 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:18.835530 30972 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.837950 30972 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:18.660338 31244 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.755100 31073 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:18.775457 31298 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260709 13:10:18.624189 31257 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.167s
I20260709 13:10:18.634903 31291 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:18.496924 31299 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:18.732609 31287 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.532s	user 0.000s	sys 0.002s
I20260709 13:10:18.817957 31207 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:18.661353 31303 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:18.556856 31300 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:18.829754 31222 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.721s	user 0.007s	sys 0.005s
I20260709 13:10:18.734431 31091 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:10:18.492364 31297 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:18.872295 27338 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.047s
W20260709 13:10:18.929425 27338 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.047s
I20260709 13:10:18.747594 31226 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:18.888521 27264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.036s	sys 0.077s
I20260709 13:10:18.932379 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1481) took 1152 ms. Trace:
W20260709 13:10:18.932871 27264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.037s	sys 0.077s
I20260709 13:10:18.868081 31211 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:18.933074 27263 rpcz_store.cc:276] 0709 13:10:17.765079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.837121 (+ 72042us) service_pool.cc:224] Handling call
0709 13:10:18.916747 (+1079626us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54001b94d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:18.916924 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965527296}
I20260709 13:10:18.480675 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:18.914783 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:18.934890 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 454341us
I20260709 13:10:18.936173 27267 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:18.937218 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1484) took 1164 ms. Trace:
I20260709 13:10:18.937767 27267 rpcz_store.cc:276] 0709 13:10:17.772486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.930768 (+1158282us) service_pool.cc:224] Handling call
0709 13:10:18.931244 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.936863 (+  5619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.937144 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:18.893579 31147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.013s	sys 0.030s
I20260709 13:10:18.943737 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 565) took 1133 ms. Trace:
W20260709 13:10:18.894663 31252 consensus_meta.cc:287] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.000s
I20260709 13:10:18.944581 27263 rpcz_store.cc:276] 0709 13:10:17.809977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.942767 (+1132790us) service_pool.cc:224] Handling call
0709 13:10:18.943209 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.943399 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.943425 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.943469 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:18.943501 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.943566 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:18.943671 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:18.947968 27263 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:10:18.940420 30882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.021s	sys 0.038s
W20260709 13:10:18.919016 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.002s	sys 0.010s
W20260709 13:10:18.918552 27306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.019s	sys 0.023s
W20260709 13:10:18.918040 27411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.002s	sys 0.044s
W20260709 13:10:18.912894 27337 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 13:10:18.834877 31250 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:18.887799 31242 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.107s	user 0.010s	sys 0.003s
I20260709 13:10:18.935884 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:18.919116 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.010s	sys 0.005s
W20260709 13:10:18.894075 31144 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.298s	user 0.013s	sys 0.000s
W20260709 13:10:18.918915 31097 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.002s	sys 0.012s
W20260709 13:10:18.943857 31147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.014s	sys 0.032s
I20260709 13:10:18.951957 27409 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:18.918792 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.015s	sys 0.033s
I20260709 13:10:19.003509 27410 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:10:19.008111 27409 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:19.009285 27306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.019s	sys 0.023s
W20260709 13:10:19.010154 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.008s
W20260709 13:10:19.010596 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.004s	sys 0.008s
W20260709 13:10:19.008185 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.012s	sys 0.005s
I20260709 13:10:19.011451 27337 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:19.011813 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 819419us
I20260709 13:10:19.012249 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2394) took 1352 ms. Trace:
I20260709 13:10:19.012703 27337 rpcz_store.cc:276] 0709 13:10:17.659951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.035645 (+375694us) service_pool.cc:224] Handling call
0709 13:10:19.012175 (+976530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:18.953845 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.003s	sys 0.010s
W20260709 13:10:19.014441 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 658685us
W20260709 13:10:19.015097 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.020s
I20260709 13:10:19.022390 27412 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:10:19.008231 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.016s	sys 0.033s
W20260709 13:10:18.953801 30882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.023s	sys 0.039s
W20260709 13:10:19.015714 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.014s	sys 0.021s
I20260709 13:10:19.024029 27417 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
W20260709 13:10:19.024106 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 1.17414e+06us
W20260709 13:10:19.030531 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 546820us
I20260709 13:10:19.031322 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:18.948906 31306 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:19.008152 27411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.007s	sys 0.049s
I20260709 13:10:18.949170 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 566) took 1128 ms. Trace:
W20260709 13:10:18.981514 31118 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 1.133s	user 0.008s	sys 0.004s
I20260709 13:10:19.015314 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:19.009855 27409 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.040408 27409 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:19.041062 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:18.974117 31303 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:18.955868 31230 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:19.015575 31097 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.003s	sys 0.013s
I20260709 13:10:19.042248 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:19.034593 27263 rpcz_store.cc:276] 0709 13:10:17.820434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.947113 (+1126679us) service_pool.cc:224] Handling call
0709 13:10:18.947513 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.948603 (+  1090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.949099 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:19.000245 31202 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:18.978385 31300 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:19.048781 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 574) took 1368 ms. Trace:
I20260709 13:10:19.024932 31129 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.034101 31249 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.223s	user 0.011s	sys 0.002s
I20260709 13:10:18.929085 31222 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.063948 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:19.076342 27411 rpcz_store.cc:276] 0709 13:10:17.680606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.766228 (+ 85622us) service_pool.cc:224] Handling call
0709 13:10:17.766646 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:17.766926 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:17.852161 (+ 85235us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.047632 (+1195471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.047778 (+   146us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:19.047921 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.048162 (+   241us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.048499 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5214,"prepare.queue_time_us":276607,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":15964,"thread_start_us":1236768,"threads_started":2,"wal-append.queue_time_us":1187535}
I20260709 13:10:18.945417 31211 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:19.042383 31246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.005s	sys 0.060s
I20260709 13:10:19.040104 31217 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.085355 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 545) took 2757 ms. Trace:
I20260709 13:10:18.945029 31226 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:19.072610 31194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.016s
I20260709 13:10:19.097510 27340 rpcz_store.cc:276] 0709 13:10:16.327980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.246388 (+1918408us) service_pool.cc:224] Handling call
0709 13:10:18.246758 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.246958 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:18.685300 (+438342us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.085015 (+399715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.085070 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.085124 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.085189 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.085296 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71223,"prepare.queue_time_us":735768,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":31529,"thread_start_us":765738,"threads_started":2}
I20260709 13:10:19.098769 31217 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:19.085983 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 43817.6us
I20260709 13:10:18.988097 31304 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:10:19.089656 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.089648 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:19.088395 27409 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:19.046732 31174 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.950870 31252 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.050660 31072 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:19.015998 31144 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:19.056768 31203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.027s	sys 0.053s
I20260709 13:10:19.059719 31306 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:19.086268 31129 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.099092 31293 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:19.113770 31226 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.078204 30882 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:10:19.120626 31209 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:19.123623 27343 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:19.094151 28008 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:19.045029 31118 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10.
I20260709 13:10:19.095764 28006 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:19.052703 31147 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:19.126597 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:19.126966 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:19.107486 27265 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:19.295517 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.160645 28006 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:19.358716 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 258326us
W20260709 13:10:19.093941 31246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.060s
W20260709 13:10:19.107791 31203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.027s	sys 0.053s
I20260709 13:10:19.095956 31202 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:19.109664 31277 consensus_meta.cc:287] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.000s
W20260709 13:10:19.139626 31179 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.007s
I20260709 13:10:19.107827 31297 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:19.109056 31306 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:19.304500 30889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.022s
I20260709 13:10:19.104506 31242 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:19.105513 31174 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:19.390136 31088 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 1.344s	user 0.009s	sys 0.005s
I20260709 13:10:19.109064 31144 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.104326 31211 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:19.362439 31161 consensus_meta.cc:287] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.951s	user 0.012s	sys 0.000s
I20260709 13:10:19.107079 31252 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.133014 31207 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.402498 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:19.375356 31194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.000s	sys 0.017s
I20260709 13:10:19.125948 31299 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.373826 28006 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.359463 31300 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:19.101192 31217 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:19.362555 31226 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:19.358322 31072 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:19.381597 31295 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.007s	sys 0.015s
W20260709 13:10:19.414189 31173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.033s
I20260709 13:10:19.465220 28006 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:19.419982 30889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.013s	sys 0.022s
I20260709 13:10:19.376065 31301 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:10:19.410482 31179 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.392659 31277 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:19.686156 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.162s	sys 0.233s
I20260709 13:10:19.679904 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 491) took 1671 ms. Trace:
I20260709 13:10:19.688644 28011 rpcz_store.cc:276] 0709 13:10:18.008461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.016167 (+  7706us) service_pool.cc:224] Handling call
0709 13:10:18.038960 (+ 22793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.117677 (+ 78717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.679632 (+1561955us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54000307d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:19.679826 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179439360}
I20260709 13:10:19.609670 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 557) took 1979 ms. Trace:
W20260709 13:10:19.696791 27410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.013s	sys 0.004s
W20260709 13:10:19.697427 27410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.014s	sys 0.004s
W20260709 13:10:19.686599 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.162s	sys 0.233s
W20260709 13:10:19.538565 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 178983us
W20260709 13:10:19.429926 31244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.041s	sys 0.071s
W20260709 13:10:19.708042 31244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.048s	sys 0.080s
W20260709 13:10:19.455536 27416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.023s	sys 0.033s
W20260709 13:10:19.708644 27416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.023s	sys 0.041s
I20260709 13:10:19.709494 31131 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:19.582180 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.086s	sys 0.116s
W20260709 13:10:19.710278 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.093s	sys 0.147s
W20260709 13:10:19.710655 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 671077us
W20260709 13:10:19.707108 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 771277us
I20260709 13:10:19.711576 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:19.696744 27268 rpcz_store.cc:276] 0709 13:10:17.630517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.153391 (+522874us) service_pool.cc:224] Handling call
0709 13:10:18.153700 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.504046 (+350346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.504096 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:18.504175 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:18.504240 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.609424 (+1105184us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54002efc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:19.609465 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.609602 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805202816}
I20260709 13:10:19.577627 27155 maintenance_manager.cc:419] P 1dbd25262fd84bb38e8451d89b086534: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033347
W20260709 13:10:19.755543 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1600066820000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27290000000000003s for a response
W20260709 13:10:19.756067 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1252502919999188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:10:19.756942 31252 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.757666 27260 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:19.436950 31246 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:19.678687 31316 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 13:10:19.680033 31309 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:10:19.592484 31253 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.383s	user 0.013s	sys 0.000s
W20260709 13:10:19.636452 31311 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.539s	user 0.001s	sys 0.000s
W20260709 13:10:19.730672 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.740965 27337 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:19.415388 31306 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:19.696569 31097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.003s	sys 0.013s
I20260709 13:10:19.747462 27267 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:19.695544 31173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.016s	sys 0.033s
W20260709 13:10:19.686582 31295 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.011s	sys 0.018s
I20260709 13:10:19.751845 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 547) took 3272 ms. Trace:
I20260709 13:10:19.756991 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:19.430363 31174 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:19.526067 31226 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:19.460361 31088 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.532439 31299 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.762385 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:19.765069 27380 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.020s
W20260709 13:10:19.891929 27380 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.020s
W20260709 13:10:19.892270 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 660570us
I20260709 13:10:19.683838 31222 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.642773 31129 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:19.849578 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.026s	sys 0.059s
I20260709 13:10:19.712261 31268 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:19.724519 31175 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:19.757786 31252 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.728408 31304 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:19.430688 31242 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.908917 31242 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:19.909288 31293 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.910017 31222 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:19.909889 31293 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.521490 31207 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.913380 31207 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.864447 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:19.898478 31321 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.496s
I20260709 13:10:19.915737 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:19.464614 31161 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.916819 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2399) took 2215 ms. Trace:
I20260709 13:10:19.916735 31268 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.917306 27264 rpcz_store.cc:276] 0709 13:10:17.701329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.346995 (+645666us) service_pool.cc:224] Handling call
0709 13:10:18.347325 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.347601 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:18.347624 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.348064 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:10:18.933359 (+585295us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:18.933415 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:18.933507 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:19.916595 (+983088us) raft_consensus.cc:1685] finished
0709 13:10:19.916616 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.916761 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61603,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":584884,"threads_started":1,"wal-append.queue_time_us":747981}
I20260709 13:10:19.918448 31161 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:19.533222 31300 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.919425 31175 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.414338 31318 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.442s
I20260709 13:10:19.878280 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:19.879442 27338 rpcz_store.cc:276] 0709 13:10:16.479093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.363893 (+1884800us) service_pool.cc:224] Handling call
0709 13:10:18.364279 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.364542 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:18.930121 (+565579us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.751295 (+821174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.751404 (+   109us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.751474 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.751578 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.751759 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2045,"prepare.queue_time_us":649594,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":64387,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":65202,"spinlock_wait_cycles":144419712,"thread_start_us":1385763,"threads_started":3,"wal-append.queue_time_us":601923}
I20260709 13:10:19.882858 31072 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:19.883657 31324 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
W20260709 13:10:19.883939 31274 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.855s	user 0.008s	sys 0.021s
W20260709 13:10:19.887823 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 180112us
W20260709 13:10:19.894621 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.027s	sys 0.060s
I20260709 13:10:19.608942 31216 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:19.895442 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.858291 31144 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:19.879236 31097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.004s	sys 0.014s
I20260709 13:10:19.872022 31203 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.855682 31246 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:19.897583 27380 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.983s (SENT)
W20260709 13:10:19.883703 31266 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 2.377s	user 0.020s	sys 0.037s
W20260709 13:10:19.904740 31310 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.792s	user 0.002s	sys 0.000s
I20260709 13:10:19.904646 31226 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:19.905664 31331 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.906167 31332 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.909423 31217 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.910588 31222 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:19.913782 31252 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:19.916042 31321 consensus_queue.cc:1243] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:10:19.878449 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58763us
W20260709 13:10:19.865842 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.017s	sys 0.045s
I20260709 13:10:19.880198 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 567) took 1877 ms. Trace:
I20260709 13:10:20.079582 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.173786 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:19.926164 27268 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:20.173491 27263 rpcz_store.cc:276] 0709 13:10:18.002550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.054129 (+1051579us) service_pool.cc:224] Handling call
0709 13:10:19.054548 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.054801 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:19.479506 (+424705us) log.cc:844] Serialized 14 byte log entry
0709 13:10:19.879870 (+400364us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:19.879909 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:19.879936 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.879980 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:19.880141 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1065472,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":99,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":1603,"thread_start_us":785228,"threads_started":2,"wal-append.queue_time_us":630221}
I20260709 13:10:20.128037 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.092974 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:20.175043 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.019s	sys 0.047s
W20260709 13:10:20.175673 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 278109us
I20260709 13:10:20.177853 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.077461 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:19.961855 28013 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:20.177570 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:20.137256 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 380327us
I20260709 13:10:20.176352 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.120340 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.145352 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2400) took 2431 ms. Trace:
I20260709 13:10:20.179088 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:20.179448 27231 leader_election.cc:400] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11.
I20260709 13:10:20.076447 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.180001 27231 leader_election.cc:403] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:20.179674 27260 rpcz_store.cc:276] 0709 13:10:17.714311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.410018 (+695707us) service_pool.cc:224] Handling call
0709 13:10:18.410397 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.758132 (+1347735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.145045 (+386913us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540031e554. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:20.145275 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3087714560}
I20260709 13:10:20.180490 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.174512 27338 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:20.075451 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:20.183665 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:19.921466 27411 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:20.184113 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.191092 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.092025 30885 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.192402 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.185415 31216 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:20.186681 27415 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:20.181891 27413 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:19.951025 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.175781 27337 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:20.192071 30885 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.193513 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:19.919054 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.147841 31116 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.224393 27408 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:20.262804 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:20.249017 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69707.4us
I20260709 13:10:20.175100 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.264914 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:20.040436 31267 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 2.512s	user 0.017s	sys 0.025s
W20260709 13:10:20.284400 27308 connection.cc:256] RPC call timeout handler was delayed by -1.5111768030000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:10:20.140769 31329 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:10:20.267797 27409 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:20.269721 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.270082 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:20.091909 31262 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:20.295876 27415 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:20.191715 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:20.262878 27413 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:20.296972 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.297010 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:20.046809 31291 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.161s	user 0.008s	sys 0.001s
W20260709 13:10:20.290812 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 170677us
I20260709 13:10:20.267148 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.084656 31242 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.017446 31327 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:10:20.293200 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.293005 31346 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:10:20.092306 31172 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:20.084374 31303 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.307848 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.308079 28011 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:10:20.017987 31308 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:10:20.122830 31336 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 13:10:20.162890 31275 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 2.601s	user 0.024s	sys 0.031s
I20260709 13:10:20.316586 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:20.191715 27338 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:20.148280 31088 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.092025 31147 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:20.321326 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.299422 31226 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.298261 27337 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:20.293311 31245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.036s	user 0.033s	sys 0.054s
I20260709 13:10:20.043145 31319 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:20.140269 31338 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.971131 31175 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.301787 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:20.303821 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.047744 31161 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.091572 31118 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.317580 31303 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.348882 31118 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.304705 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.305418 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:20.119144 31141 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:20.194027 31304 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.128226 31179 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:20.265812 31266 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:19.921715 31253 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:19.919153 31268 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.310087 27341 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:20.192148 31286 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:20.092164 31300 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:19.976285 31277 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:19.899322 31194 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.403s
I20260709 13:10:20.351198 31319 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.266611 31097 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.312927 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.284287 31301 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.017740 31337 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.248270 31252 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.055227 31244 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.192416 31130 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:20.187319 31217 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.319720 30885 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.266484 31207 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.900657 31299 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.084889 31129 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:20.328063 31339 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:10:20.328603 31347 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.188540 31331 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.193991 31144 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.397861 31216 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:20.333557 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.298902 31351 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:20.300535 31262 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:20.335450 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.426071 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 567) took 2765 ms. Trace:
I20260709 13:10:20.365208 31268 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.309756 31242 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.310716 31215 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:20.307888 31172 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:20.341887 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.368142 31253 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:20.482369 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.483255 27413 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:20.484434 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.275868 31116 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.342311 27415 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 5.
W20260709 13:10:20.427311 31345 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:10:20.347896 31161 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.351953 27409 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
W20260709 13:10:20.336800 31245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.093s	user 0.033s	sys 0.054s
I20260709 13:10:20.187482 31203 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.352531 31073 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.356854 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.542915 27415 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:20.357338 31307 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:10:20.357404 31141 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:20.358609 27981 connection.cc:256] RPC call timeout handler was delayed by -1.0609820690000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:10:20.315479 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.337790 31293 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.368669 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.550441 27341 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:20.362242 31286 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:20.333781 31147 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.187250 31332 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.303417 31291 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.358260 31304 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.429708 31129 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.300580 27340 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:20.396759 31301 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.573400 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.426637 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.574508 27260 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:20.429986 27416 rpcz_store.cc:276] 0709 13:10:17.661032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.663243 (+  2211us) service_pool.cc:224] Handling call
0709 13:10:17.688583 (+ 25340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.688980 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:17.689010 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:18.908125 (+1219115us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b2c0009df68. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:10:18.908653 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:10:19.709184 (+800531us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:19.709245 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:19.713070 (+  3825us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.366303 (+653233us) raft_consensus.cc:1685] finished
0709 13:10:20.366331 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.425990 (+ 59659us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":15620,"spinlock_wait_cycles":31476608,"thread_start_us":800125,"threads_started":1,"wal-append.queue_time_us":957853}
I20260709 13:10:20.428268 27337 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:20.425793 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 160947us
I20260709 13:10:20.575656 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.397614 31337 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.445032 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:20.446158 31130 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:20.577208 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 132291us
I20260709 13:10:20.577533 27414 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:20.577979 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.353924 31346 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 13:10:20.449766 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.444177 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.367411 31097 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.266208 31218 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.543290 27263 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:20.542905 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 543) took 4240 ms. Trace:
I20260709 13:10:20.429001 31299 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.427899 31144 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.551868 27409 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:20.553078 31246 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.414351 31252 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.566788 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2372) took 4402 ms. Trace:
I20260709 13:10:20.549774 31073 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.419454 31244 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.345845 31174 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.417577 31207 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.426347 31216 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:20.594062 31222 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.444159 31262 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.586249 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.586954 28006 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:20.587802 27336 rpcz_store.cc:276] 0709 13:10:16.302384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.619202 (+1316818us) service_pool.cc:224] Handling call
0709 13:10:17.651462 (+ 32260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.013519 (+362057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.542580 (+2529061us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001fc054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:20.542848 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372847872}
I20260709 13:10:20.592103 31141 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.595258 27266 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:20.587531 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:20.628340 27415 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:20.628917 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.571200 31179 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.596513 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.597582 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.489506 31268 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.598927 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2382) took 3040 ms. Trace:
I20260709 13:10:20.490363 31175 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:20.600085 27339 rpcz_store.cc:276] 0709 13:10:16.164382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.028176 (+863794us) service_pool.cc:224] Handling call
0709 13:10:17.065159 (+ 36983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:17.065731 (+   572us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:17.193838 (+128107us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.341005 (+147167us) log.cc:844] Serialized 14 byte log entry
0709 13:10:17.341193 (+   188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:17.345747 (+  4554us) log.cc:844] Serialized 572 byte log entry
0709 13:10:17.345907 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:17.345942 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:17.346010 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:17.502875 (+156865us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b18003b7be0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:17.504408 (+  1533us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b18003b7be0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1
0709 13:10:17.504955 (+   547us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18003b7be0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:19.883001 (+2378046us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:20.566578 (+683577us) raft_consensus.cc:1685] finished
0709 13:10:20.566603 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.566739 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10640,"prepare.queue_time_us":11917,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":11990,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":5465,"spinlock_wait_cycles":33005952,"thread_start_us":91995,"threads_started":1,"wal-append.queue_time_us":196542}
I20260709 13:10:20.605667 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.610646 31129 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:20.588032 31215 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.585794 31097 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.637154 27259 rpcz_store.cc:276] 0709 13:10:17.553196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.553350 (+   154us) service_pool.cc:224] Handling call
0709 13:10:17.553646 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:18.834158 (+1280512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.593545 (+1759387us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001f81d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:20.593724 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942778112}
I20260709 13:10:20.614430 27341 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:20.594678 31293 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.616585 27416 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:20.579905 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:20.644630 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 158384us
I20260709 13:10:20.644855 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.599826 31253 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:20.647132 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50684.9us
I20260709 13:10:20.597142 31217 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.360285 31338 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.637989 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.631136 31194 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.638345 30885 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:20.636988 27340 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:20.637684 31318 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:20.637722 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:20.643304 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 584) took 1539 ms. Trace:
I20260709 13:10:20.677837 27260 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:20.600723 31144 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:20.648057 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.678453 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2402) took 2672 ms. Trace:
I20260709 13:10:20.652129 27259 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:10:20.678800 27260 rpcz_store.cc:276] 0709 13:10:18.062109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.648523 (+2586414us) service_pool.cc:224] Handling call
0709 13:10:20.675673 (+ 27150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.678206 (+  2533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.678397 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.679322 27259 pending_rounds.cc:85] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:10:20.679607 27259 pending_rounds.cc:107] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:10:20.679834 27259 raft_consensus.cc:2889] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.680441 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2403) took 2618 ms. Trace:
I20260709 13:10:20.658628 31147 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.659603 31242 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:20.640465 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:20.673494 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:20.607097 31286 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.680354 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 568) took 2405 ms. Trace:
I20260709 13:10:20.680876 27259 rpcz_store.cc:276] 0709 13:10:18.062513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.651281 (+2588768us) service_pool.cc:224] Handling call
0709 13:10:20.651668 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.680246 (+ 28578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.680393 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.646157 31175 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.649062 31262 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.682435 27263 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:20.683985 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.636421 31179 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.636138 31348 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:10:20.743301 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.839250 27260 rpcz_store.cc:276] 0709 13:10:18.275037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.679581 (+2404544us) service_pool.cc:224] Handling call
0709 13:10:20.679906 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.680066 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.680089 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.680128 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:20.680157 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.680206 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.680306 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.660884 31141 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:20.734719 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.840621 27341 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:20.840950 27337 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.752872 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:20.853689 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1493) took 1139 ms. Trace:
I20260709 13:10:20.677321 27410 rpcz_store.cc:276] 0709 13:10:19.104018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.104153 (+   135us) service_pool.cc:224] Handling call
0709 13:10:19.104469 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:19.104840 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:19.698049 (+593209us) log.cc:844] Serialized 14 byte log entry
0709 13:10:20.092343 (+394294us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.092875 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:10:20.093024 (+   149us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:20.093058 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.093126 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:20.643082 (+549956us) raft_consensus.cc:1685] finished
0709 13:10:20.643101 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.643249 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32712,"prepare.queue_time_us":935924,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":36777,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":199,"thread_start_us":893217,"threads_started":2,"wal-append.queue_time_us":412495}
W20260709 13:10:20.829981 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 159248us
I20260709 13:10:20.854315 27263 rpcz_store.cc:276] 0709 13:10:19.714532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.637455 (+922923us) service_pool.cc:224] Handling call
0709 13:10:20.853560 (+216105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.843199 27259 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:10:20.855638 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 102884us
I20260709 13:10:20.856411 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:20.673322 31161 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:20.903664 31242 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:20.902614 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.909416 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:20.909565 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:20.885152 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.014s
I20260709 13:10:20.903103 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1486) took 1219 ms. Trace:
I20260709 13:10:20.910220 27341 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:20.910293 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.019s	sys 0.016s
I20260709 13:10:20.910470 27259 rpcz_store.cc:276] 0709 13:10:19.683683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.841160 (+1157477us) service_pool.cc:224] Handling call
0709 13:10:20.841470 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.855206 (+ 13736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.903041 (+ 47835us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:20.911636 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 613387us
I20260709 13:10:20.682566 31331 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.904448 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 580) took 1960 ms. Trace:
I20260709 13:10:20.904974 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:20.916062 31277 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:20.910053 27416 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:20.902510 27260 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:20.909838 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:20.906041 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48668.5us
I20260709 13:10:20.914724 27417 rpcz_store.cc:276] 0709 13:10:18.944050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.945616 (+  1566us) service_pool.cc:224] Handling call
0709 13:10:18.982459 (+ 36843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.030179 (+ 47720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.858680 (+1828501us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b5400317c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:20.904380 (+ 45700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95158016}
I20260709 13:10:20.918627 27263 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:20.919965 27263 pending_rounds.cc:85] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:20.920328 27263 pending_rounds.cc:107] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:20.912894 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1491) took 1199 ms. Trace:
I20260709 13:10:20.844934 31144 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.772488 31174 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.918113 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1485) took 1235 ms. Trace:
I20260709 13:10:20.921793 27259 rpcz_store.cc:276] 0709 13:10:19.713956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.912077 (+1198121us) service_pool.cc:224] Handling call
0709 13:10:20.912383 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.912554 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.912580 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.912627 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:20.912662 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.912719 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.912840 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.931710 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.907998 31286 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.920976 27263 raft_consensus.cc:2889] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.685833 31244 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:20.920240 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:20.919727 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.900859 31147 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:20.928432 27260 rpcz_store.cc:276] 0709 13:10:19.683287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.840801 (+1157514us) service_pool.cc:224] Handling call
0709 13:10:20.886491 (+ 45690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.917885 (+ 31394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.918063 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.933409 27259 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:20.934582 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.938133 27337 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:20.902127 31246 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.759862 31253 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:10:20.756682 31300 consensus_queue.cc:1059] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 13:10:20.911732 31291 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.928411 31072 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.945657 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1494) took 1226 ms. Trace:
I20260709 13:10:20.939221 31130 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.953123 27259 rpcz_store.cc:276] 0709 13:10:19.719339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.929323 (+1209984us) service_pool.cc:224] Handling call
0709 13:10:20.933084 (+  3761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.945443 (+ 12359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.945610 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:20.682085 31216 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.950116 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.762375 31360 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.280s
I20260709 13:10:20.945868 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:20.941134 30885 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.939791 31372 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:20.955372 31301 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.925319 31129 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:20.946411 31277 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:20.954881 27259 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:20.961647 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.950481 31319 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.952975 31072 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.938556 31161 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:10:20.946009 31331 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:20.948608 31207 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.934056 31144 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:20.960162 31372 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:20.958314 27337 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:20.961977 27259 pending_rounds.cc:85] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:20.959018 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:20.958943 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1496) took 1237 ms. Trace:
I20260709 13:10:20.978832 27341 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:20.978766 27260 rpcz_store.cc:276] 0709 13:10:19.721315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.945043 (+1223728us) service_pool.cc:224] Handling call
0709 13:10:20.954738 (+  9695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.954926 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.954953 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:20.954995 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:20.955038 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:20.958750 (+  3712us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:20.958897 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218368}
I20260709 13:10:20.964183 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:20.980008 27259 pending_rounds.cc:107] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:20.980334 27259 raft_consensus.cc:2889] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:20.980993 27380 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:20.940789 31242 consensus_queue.cc:1059] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:10:20.950327 31318 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:10:20.959745 30885 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.975984 31338 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:20.977797 31366 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:10:20.965793 31130 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.951409 31246 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:20.984313 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:20.966627 31072 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.985924 30885 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:20.986145 31367 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.986244 31161 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:20.968700 31331 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:21.015578 31161 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.015704 31331 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.015980 31179 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.998268 31144 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:20.995883 27341 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:20.963238 31277 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:21.003985 27334 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2392) took 3360 ms (client timeout 1889 ms). Trace:
I20260709 13:10:21.020933 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1483) took 3248 ms. Trace:
I20260709 13:10:21.009981 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 558) took 3379 ms. Trace:
W20260709 13:10:21.010066 31347 consensus_meta.cc:287] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
W20260709 13:10:21.010700 30977 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:21.028652 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.029314 27337 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:20.993752 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:21.016047 31161 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.018674 31371 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:21.018816 31360 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:21.020030 31367 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:21.020893 31368 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:21.021260 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.043116 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.043934 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.044363 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:21.044981 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.021929 27261 rpcz_store.cc:276] 0709 13:10:17.630790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.185266 (+554476us) service_pool.cc:224] Handling call
0709 13:10:21.009205 (+2823939us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:21.009430 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.009623 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.009655 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.009702 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:21.009745 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.009806 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.009918 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4046592}
W20260709 13:10:21.021497 27334 rpcz_store.cc:269] 0709 13:10:17.643781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.090256 (+446475us) service_pool.cc:224] Handling call
0709 13:10:21.003750 (+2913494us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b54002896d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.003876 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217749248}
I20260709 13:10:21.021733 27265 rpcz_store.cc:276] 0709 13:10:17.772154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.749365 (+977211us) service_pool.cc:224] Handling call
0709 13:10:18.749760 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.359010 (+609250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.020659 (+1661649us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400313dd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.020868 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822294784}
I20260709 13:10:20.985380 31244 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.006891 31303 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:20.978608 31372 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:21.003438 31130 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:21.018712 31226 consensus_meta.cc:287] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.001s
W20260709 13:10:21.032521 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.032311 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
W20260709 13:10:21.034875 31306 consensus_meta.cc:287] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.154s	user 0.012s	sys 0.000s
I20260709 13:10:21.035447 31144 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:21.040843 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59954.3us
I20260709 13:10:21.040923 31360 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.045011 27341 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:21.029628 31347 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11.
I20260709 13:10:21.049154 27334 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:21.063581 27334 raft_consensus.cc:606] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:21.063992 27334 raft_consensus.cc:614] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:21.050282 31130 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.045957 31367 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.057791 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:21.066282 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:21.068635 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:21.060313 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.060911 27341 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:21.048979 31371 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.071884 31371 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.072548 31118 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.062175 31360 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.070564 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.074759 27341 raft_consensus.cc:2376] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9. Re-sending same reply.
I20260709 13:10:21.058362 31144 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:21.077487 31299 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:21.079970 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.080498 31144 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.082296 27342 raft_consensus.cc:2376] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:21.083714 27334 raft_consensus.cc:2376] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12. Re-sending same reply.
I20260709 13:10:21.059595 31306 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.062302 31179 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:21.077629 31231 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:21.095600 31231 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.096107 31231 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:21.096589 31147 raft_consensus.cc:3055] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:21.096863 31277 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.097108 31147 raft_consensus.cc:740] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:21.097584 31277 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:21.098016 31277 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.098483 31277 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.100947 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:21.101441 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.103622 27978 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:21.059667 31175 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.094620 31246 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.098114 31147 consensus_queue.cc:260] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:21.112421 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43855.4us
I20260709 13:10:21.099458 31358 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:21.116707 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.112078 31091 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.113941 31342 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:21.112030 31179 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:21.111624 31124 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:10:21.078025 31303 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:21.114784 31097 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.112915 31226 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:21.116355 31358 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:21.122071 31147 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.162590 31097 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.172907 30885 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.174261 31179 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.176442 31141 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:21.121966 31299 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:21.121004 31331 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.129778 31342 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:21.249866 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 539) took 5429 ms. Trace:
I20260709 13:10:21.260054 27335 rpcz_store.cc:276] 0709 13:10:15.807036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.016906 (+1209870us) service_pool.cc:224] Handling call
0709 13:10:18.282839 (+1265933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:18.491990 (+209151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.236422 (+2744432us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540032ffd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.236597 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910492544}
I20260709 13:10:21.253165 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:21.262938 28008 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:21.263017 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.267904 27335 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11. Re-sending same reply.
I20260709 13:10:21.275918 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:21.276648 28014 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:21.277040 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.190860 27337 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:21.277350 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:21.258136 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:21.280081 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:21.281098 31097 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:21.281622 31097 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.282063 31097 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.286161 31306 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:21.287225 27412 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1587) took 3760 ms (client timeout 2175 ms). Trace:
W20260709 13:10:21.287639 27412 rpcz_store.cc:269] 0709 13:10:17.526782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.533120 (+  6338us) service_pool.cc:224] Handling call
0709 13:10:21.286944 (+3753824us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003c1254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.287081 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3234556288}
I20260709 13:10:21.289299 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 564) took 3492 ms. Trace:
I20260709 13:10:21.289734 27267 rpcz_store.cc:276] 0709 13:10:17.796632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.939608 (+1142976us) service_pool.cc:224] Handling call
0709 13:10:18.939972 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.877319 (+937347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.289052 (+1411733us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54000b81d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.289237 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856478592}
I20260709 13:10:21.290381 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 621) took 2227 ms. Trace:
I20260709 13:10:21.290030 31333 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:21.291929 31333 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:21.292356 31333 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:21.293295 31333 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.295554 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:21.294898 31333 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.297989 31231 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.230471 31116 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.290890 28013 rpcz_store.cc:276] 0709 13:10:19.062951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.064031 (+  1080us) service_pool.cc:224] Handling call
0709 13:10:19.089319 (+ 25288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.178580 (+1089261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.290073 (+1111493us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.290287 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2005870848}
W20260709 13:10:21.201969 31370 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:10:21.312359 30860 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:21.314045 31372 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.318425 31130 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.222424 31131 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:21.320444 31097 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.195715 30885 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.227056 31144 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.322204 31318 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.322894 31174 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.228415 31202 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:21.290889 31072 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.264302 31210 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:21.327950 31306 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:21.240767 31358 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.323473 31338 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:21.324656 31290 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:21.324503 31124 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:21.274933 31367 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:21.346416 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 83919.9us
I20260709 13:10:21.309469 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.342037 31131 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.327983 31207 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:21.358059 27335 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:21.229666 31299 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.347143 31202 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:21.254722 31371 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.347786 31174 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.360600 31304 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.359980 31290 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:21.373065 31130 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.364948 31372 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.352918 31210 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.376502 31290 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.377476 31210 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.354594 31306 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.367123 31268 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.380277 31231 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.380475 31144 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.388166 31371 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.354511 31342 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.389026 31277 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.390079 31367 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.391595 31277 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.392453 31306 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.392624 31360 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.396311 31331 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.387089 31161 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.398171 31360 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.398409 31161 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:21.405433 31131 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.359220 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.449103 27338 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:21.486848 27335 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:21.488731 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.489866 27335 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:21.490118 31131 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.491199 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.451812 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.461901 31124 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.496219 27339 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:21.496457 31124 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.497777 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:21.407784 31202 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.466203 31348 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.467736 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:21.469924 31332 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.472827 31072 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.505841 31348 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.480283 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:21.464037 31210 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:21.499702 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.509302 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.510938 27339 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:21.510957 31210 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.512310 31124 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.512593 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:21.512739 27268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1487) took 1828 ms (client timeout 2102 ms). Trace:
I20260709 13:10:21.509920 27335 raft_consensus.cc:2376] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
I20260709 13:10:21.511265 31202 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.521482 31348 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:21.515489 27268 rpcz_store.cc:269] 0709 13:10:19.684018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.915388 (+231370us) service_pool.cc:224] Handling call
0709 13:10:21.511145 (+1595757us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b54001b8ad4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.512487 (+  1342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21771648}
I20260709 13:10:21.521633 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.525698 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:21.528329 31210 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.526540 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.530345 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.524399 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:21.531399 27268 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.536711 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2101) took 1108 ms. Trace:
I20260709 13:10:21.537150 27340 rpcz_store.cc:276] 0709 13:10:20.428197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.573102 (+144905us) service_pool.cc:224] Handling call
0709 13:10:21.536254 (+963152us) spinlock_profiling.cc:243] Waited 62.7 ms on lock 0x7b54001fd454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.536539 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144257920}
I20260709 13:10:21.538456 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.538494 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.539880 27339 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:21.540410 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.541648 27341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:21.541337 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:21.542383 27341 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:21.543843 27341 raft_consensus.cc:614] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:21.549968 27341 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:21.550665 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2404) took 1454 ms. Trace:
I20260709 13:10:21.551209 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1602) took 1280 ms. Trace:
I20260709 13:10:21.551051 27341 rpcz_store.cc:276] 0709 13:10:20.095909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.549081 (+1453172us) service_pool.cc:224] Handling call
0709 13:10:21.549672 (+   591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.550366 (+   694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.550557 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.551733 27409 rpcz_store.cc:276] 0709 13:10:20.270937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.499563 (+228626us) service_pool.cc:224] Handling call
0709 13:10:20.499881 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.593950 (+ 94069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.550636 (+956686us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b54000be5d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.550935 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118553472}
I20260709 13:10:21.552924 27341 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:21.553643 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2405) took 1457 ms. Trace:
I20260709 13:10:21.553820 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 583) took 2452 ms. Trace:
I20260709 13:10:21.554009 27341 rpcz_store.cc:276] 0709 13:10:20.096172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.552058 (+1455886us) service_pool.cc:224] Handling call
0709 13:10:21.552418 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.553390 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.553595 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.554212 27411 rpcz_store.cc:276] 0709 13:10:19.101439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:19.101583 (+   144us) service_pool.cc:224] Handling call
0709 13:10:19.101918 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.191240 (+1089322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.553337 (+1362097us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400086e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.553635 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884259072}
I20260709 13:10:21.561057 27339 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:21.561213 27268 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:21.562320 27340 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:21.568431 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2408) took 1464 ms. Trace:
I20260709 13:10:21.568877 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2403) took 1473 ms. Trace:
I20260709 13:10:21.569651 27340 rpcz_store.cc:276] 0709 13:10:20.095637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.555253 (+1459616us) service_pool.cc:224] Handling call
0709 13:10:21.561495 (+  6242us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:21.561768 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.568533 (+  6765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.568740 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7708928}
I20260709 13:10:21.572177 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 2042) took 1493 ms. Trace:
I20260709 13:10:21.572314 27340 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:21.572659 27414 rpcz_store.cc:276] 0709 13:10:20.079070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.180265 (+101195us) service_pool.cc:224] Handling call
0709 13:10:21.571688 (+1391423us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540035be54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.571914 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889749248}
I20260709 13:10:21.564033 27341 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:21.575635 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.568959 27339 rpcz_store.cc:276] 0709 13:10:20.104525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.560255 (+1455730us) service_pool.cc:224] Handling call
0709 13:10:21.560728 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.568091 (+  7363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.568335 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.576122 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2410) took 1468 ms. Trace:
I20260709 13:10:21.577059 27340 rpcz_store.cc:276] 0709 13:10:20.105142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.570995 (+1465853us) service_pool.cc:224] Handling call
0709 13:10:21.571934 (+   939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.572890 (+   956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.573096 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.574321 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2406) took 1477 ms. Trace:
I20260709 13:10:21.577786 27341 rpcz_store.cc:276] 0709 13:10:20.096455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.554906 (+1458451us) service_pool.cc:224] Handling call
0709 13:10:21.563550 (+  8644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.574130 (+ 10580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.574280 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.584157 27339 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:21.584714 27340 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:21.589911 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2098) took 1229 ms. Trace:
I20260709 13:10:21.590817 31203 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.591238 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2416) took 1424 ms. Trace:
I20260709 13:10:21.590442 27340 rpcz_store.cc:276] 0709 13:10:20.359997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.583870 (+1223873us) service_pool.cc:224] Handling call
0709 13:10:21.584370 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.589544 (+  5174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.589812 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.592442 27339 rpcz_store.cc:276] 0709 13:10:20.161547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.583233 (+1421686us) service_pool.cc:224] Handling call
0709 13:10:21.583715 (+   482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.585417 (+  1702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.585587 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.595273 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2102) took 1166 ms. Trace:
I20260709 13:10:21.595777 27341 rpcz_store.cc:276] 0709 13:10:20.428488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.585060 (+1156572us) service_pool.cc:224] Handling call
0709 13:10:21.586868 (+  1808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.594770 (+  7902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.594803 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.594875 (+    72us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:21.594940 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.595028 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.595203 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":257}
I20260709 13:10:21.598336 27341 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:21.599031 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2109) took 1154 ms. Trace:
I20260709 13:10:21.599249 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2108) took 1154 ms. Trace:
I20260709 13:10:21.599514 27341 rpcz_store.cc:276] 0709 13:10:20.444668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.597581 (+1152913us) service_pool.cc:224] Handling call
0709 13:10:21.598014 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.598770 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.598978 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:21.600557 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.601449 27341 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:21.602130 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.596644 31346 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:21.604889 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.606411 27268 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:21.599783 27339 rpcz_store.cc:276] 0709 13:10:20.444377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.595265 (+1150888us) service_pool.cc:224] Handling call
0709 13:10:21.595639 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.598831 (+  3192us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:21.598860 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:21.598948 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:21.598987 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.599048 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:21.599193 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2551,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104}
I20260709 13:10:21.607772 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.609254 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.610011 31216 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.610662 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:21.611073 31300 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:21.612317 31300 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:21.612656 31291 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:21.613106 31291 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:21.603345 31346 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:21.616775 27268 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:21.620208 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.613914 31300 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.628258 31346 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.628445 31300 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:21.614534 31291 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.633759 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:21.634047 31346 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:21.633967 31291 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.636315 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:21.637431 31262 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:21.638341 31262 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:21.653710 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2107) took 1209 ms. Trace:
I20260709 13:10:21.654274 27338 rpcz_store.cc:276] 0709 13:10:20.444055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.597335 (+153280us) service_pool.cc:224] Handling call
0709 13:10:21.653432 (+1056097us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400039dd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.653622 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882052864}
I20260709 13:10:21.660053 27338 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:10:21.670111 27262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 560) took 4034 ms (client timeout 1883 ms). Trace:
W20260709 13:10:21.670647 27262 rpcz_store.cc:269] 0709 13:10:17.635133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.699519 (+ 64386us) service_pool.cc:224] Handling call
0709 13:10:21.669606 (+3970087us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54003089d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.669862 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3895137664}
I20260709 13:10:21.671969 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.672991 27262 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:21.673795 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:21.674880 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.678620 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.681393 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.683467 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:21.682871 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.686228 27264 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:21.687966 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.688992 27259 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:21.690377 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:21.686446 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2405) took 3466 ms (client timeout 1613 ms). Trace:
W20260709 13:10:21.694703 27266 rpcz_store.cc:269] 0709 13:10:18.218143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:18.228446 (+ 10303us) service_pool.cc:224] Handling call
0709 13:10:21.684169 (+3455723us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54001f86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:21.684439 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5196153216}
I20260709 13:10:21.696491 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.699095 27266 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:21.700098 31354 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:21.700736 31354 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:21.701176 31354 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:21.706837 28006 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 496) took 1440 ms. Trace:
I20260709 13:10:21.709767 28006 rpcz_store.cc:276] 0709 13:10:20.266773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.294294 (+ 27521us) service_pool.cc:224] Handling call
0709 13:10:20.294617 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.622373 (+327756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.706277 (+1083904us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54002e45d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:21.706634 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671908224}
I20260709 13:10:21.675058 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.690068 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.713371 27259 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:10:21.720950 27262 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:21.723742 27264 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:21.725647 27259 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:21.736982 27264 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:21.739048 27259 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:21.741348 27268 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:21.744324 27268 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:21.751497 31129 raft_consensus.cc:3055] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:21.752053 31129 raft_consensus.cc:740] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:21.753393 31129 consensus_queue.cc:260] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.753810 31354 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.755774 31129 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.761830 31354 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.767390 27262 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:21.767953 27262 pending_rounds.cc:85] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:21.768288 27262 pending_rounds.cc:107] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:21.768708 27262 raft_consensus.cc:2889] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:21.845290 31291 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:21.845887 31291 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:21.848367 31291 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:21.884687 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 954743us
W20260709 13:10:21.894299 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:21.899760 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.899525 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:21.925308 31194 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:21.895841 31073 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:21.925794 31194 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:21.926237 31073 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:21.909608 31342 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:21.929426 31342 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:21.926990 31194 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.929822 31342 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:21.931020 31194 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.933104 31073 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:21.939666 31073 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:21.934559 31252 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:21.930976 31342 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:21.945199 31342 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:21.943125 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:21.952054 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.952133 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:21.961903 31073 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:21.978324 31372 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:21.980599 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:21.968465 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:21.971083 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:21.988065 27416 raft_consensus.cc:2410] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:21.997983 31161 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:21.998489 31161 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:21.998917 31161 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.012290 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.013423 27411 raft_consensus.cc:2368] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:10:22.014853 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.019212 31300 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.024712 27308 leader_election.cc:400] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:10:22.025139 27308 leader_election.cc:403] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:22.025055 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.025812 27411 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.026422 31194 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.034960 31194 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9.
I20260709 13:10:22.038774 27342 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.040402 27342 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:10:22.042299 27342 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:22.057937 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.058826 27417 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:22.060421 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.062331 27417 raft_consensus.cc:2393] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.063352 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.064204 27417 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.066669 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2419) took 1003 ms. Trace:
I20260709 13:10:22.067129 27337 rpcz_store.cc:276] 0709 13:10:21.063363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.107310 (+ 43947us) service_pool.cc:224] Handling call
0709 13:10:22.066272 (+958962us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54002896d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:22.066509 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168614784}
I20260709 13:10:22.068524 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.071707 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.072821 27264 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:10:22.073436 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1489) took 2386 ms. Trace:
I20260709 13:10:22.073880 27263 rpcz_store.cc:276] 0709 13:10:19.687096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.855138 (+1168042us) service_pool.cc:224] Handling call
0709 13:10:20.855444 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:20.941433 (+ 85989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.072945 (+1131512us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b540024c7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:22.073245 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144510720}
I20260709 13:10:22.075618 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.067503 27341 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.068120 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.076929 30889 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.077384 31073 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.077891 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.066711 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.038383 31161 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.078998 30889 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.080197 31124 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.082935 31124 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.083377 31124 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.087477 30889 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.087994 30889 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.088377 30889 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.080153 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.062677 31342 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.107255 31288 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.108074 31245 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.109918 31245 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:22.111907 31300 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.112545 31161 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.112782 31300 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.113296 31300 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.113715 31300 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.119283 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.120083 27266 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:22.120388 27411 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:22.121600 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.122130 27411 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.121937 31343 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:22.123068 31343 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:22.123466 31343 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:22.123279 31351 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:22.123682 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:22.119452 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 117553us
I20260709 13:10:22.125756 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.110311 31245 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:22.128422 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.130131 27264 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:22.131187 27417 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.124737 31343 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.134363 31245 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.135402 31343 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.135759 31245 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.125255 31372 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:22.140093 31372 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.141417 31372 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:22.142962 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.131515 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.152822 31321 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:22.154214 31321 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:22.154621 31321 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:22.156165 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.157564 27266 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:22.159283 27263 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:22.160710 27411 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:22.161634 27417 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 6.
I20260709 13:10:22.147135 31252 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:22.172848 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.174419 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.175479 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.179747 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:22.181080 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 103333us
I20260709 13:10:22.181509 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.182721 27417 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:22.185918 27268 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:22.186909 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.187834 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.187496 31321 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.188978 31321 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:22.190666 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:22.192859 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:22.193610 31174 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.194510 31174 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.196766 31300 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.197265 31348 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:22.197875 31348 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.198978 31348 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.204824 31351 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:22.205677 27417 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.195065 31174 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.213476 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:22.214679 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.214615 27263 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:22.213428 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.216681 31174 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.217270 31174 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:22.217713 31174 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.217857 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.218986 31286 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.219416 31286 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.219302 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.219946 31286 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.203666 31073 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.223832 31073 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:22.223227 27337 raft_consensus.cc:2955] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:22.224399 31073 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.225667 31073 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.227053 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.227946 27268 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:22.218796 31174 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.230204 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.230432 31354 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.230861 27338 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.171252 31124 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.258047 31124 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.231000 31354 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.258245 31207 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:22.259094 31286 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.260118 27342 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:22.260560 31354 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.261297 31286 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.234107 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.235813 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.237504 27268 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:22.237893 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.238121 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.239856 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.244781 27154 maintenance_manager.cc:643] P 1dbd25262fd84bb38e8451d89b086534: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.488s	user 0.183s	sys 0.049s Metrics: {"bytes_written":30228,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":11416,"dirs.run_cpu_time_us":430,"dirs.run_wall_time_us":9456,"drs_written":1,"lbm_read_time_us":475,"lbm_reads_lt_1ms":4,"lbm_write_time_us":99414,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":64438,"threads_started":2,"update_count":9,"wal-append.queue_time_us":54031}
I20260709 13:10:22.247787 31337 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.250046 31097 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.252184 30885 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:22.254905 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.209493 31351 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.263957 31207 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.289366 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.290248 27417 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.291440 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.292814 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.294000 27155 maintenance_manager.cc:419] P 1dbd25262fd84bb38e8451d89b086534: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8076 bytes on disk
I20260709 13:10:22.295326 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2116) took 1626 ms. Trace:
I20260709 13:10:22.295719 27341 rpcz_store.cc:276] 0709 13:10:20.668854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.608796 (+939942us) service_pool.cc:224] Handling call
0709 13:10:22.067272 (+458476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.076297 (+  9025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.295083 (+218786us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54002896d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:22.295241 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1052483328}
I20260709 13:10:22.296986 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.298226 31351 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.277220 27415 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:22.294021 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.288609 31207 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.280217 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.299790 27417 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.280774 27413 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:22.300483 31207 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.301781 31207 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.281368 27259 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:22.303644 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.303953 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.305251 27259 raft_consensus.cc:1240] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.305678 30885 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:22.305950 27154 maintenance_manager.cc:643] P 1dbd25262fd84bb38e8451d89b086534: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":302,"lbm_reads_lt_1ms":4}
I20260709 13:10:22.281911 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.281769 30889 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.307559 27268 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:22.308593 27268 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.308790 30889 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.211040 31300 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.309273 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.309651 27268 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.309846 27411 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.311372 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.312139 27411 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.312850 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.313510 27411 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.310988 27417 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:22.316068 31300 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.316196 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.316481 31131 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.316936 27417 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:22.317826 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2432) took 1249 ms. Trace:
I20260709 13:10:22.299563 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.275955 27338 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:22.306381 27259 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.298182 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.300071 27263 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.320312 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.320572 27341 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:22.321003 27338 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.321507 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.318233 27339 rpcz_store.cc:276] 0709 13:10:21.068617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.607912 (+539295us) service_pool.cc:224] Handling call
0709 13:10:21.608376 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:21.610058 (+  1682us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:21.610093 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:21.610785 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 13:10:21.624584 (+ 13799us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:21.624643 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:21.624728 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.317607 (+692879us) raft_consensus.cc:1685] finished
0709 13:10:22.317628 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.317758 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1918,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":2169,"thread_start_us":13188,"threads_started":1,"wal-append.queue_time_us":124052}
I20260709 13:10:22.310992 27268 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:22.317822 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.325513 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.326992 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.327531 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.333881 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.328397 30885 raft_consensus.cc:2764] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:10:22.335122 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.337519 27341 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.341430 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:22.343602 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 150811us
I20260709 13:10:22.344537 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1609) took 2053 ms. Trace:
I20260709 13:10:22.345091 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.346127 27415 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.348407 27417 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:22.333223 31202 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:22.350504 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.351213 27339 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.356463 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.357583 27336 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:22.344939 27408 rpcz_store.cc:276] 0709 13:10:20.283713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.547382 (+263669us) service_pool.cc:224] Handling call
0709 13:10:20.547710 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:20.548040 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:20.548067 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:20.550677 (+  2610us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.199026 (+1648349us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b18003c0ee0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:22.316190 (+117164us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:22.316234 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.316325 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:22.323013 (+  6688us) raft_consensus.cc:1685] finished
0709 13:10:22.323031 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.336943 (+ 13912us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23543,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3190,"spinlock_wait_cycles":2560256,"thread_start_us":83515,"threads_started":1,"wal-append.queue_time_us":1749378}
I20260709 13:10:22.357553 27417 raft_consensus.cc:2410] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:22.358929 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.359392 27417 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:22.363768 27408 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
W20260709 13:10:22.384968 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.391569 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.391954 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.400882 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.400873 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:22.402040 27338 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.403513 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:22.380787 31073 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:22.405761 27341 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:22.422430 27411 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.422711 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:22.425696 27413 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:22.411783 31210 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.400709 31202 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.426977 31210 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.410255 31131 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:22.430393 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:22.426379 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46936.8us
I20260709 13:10:22.410686 31207 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:22.438575 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.439080 31210 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.439787 31219 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:22.440261 31219 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.440606 31219 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:22.441083 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.422734 31073 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.442915 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.435387 27413 raft_consensus.cc:2410] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:22.444832 27341 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:22.451116 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.426358 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.446652 27417 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:22.450057 31342 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:22.450803 31400 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:22.459702 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.460336 27408 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.461184 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.451817 31207 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.463567 31207 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.465646 31207 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.458765 31351 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:10:22.451493 31367 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:10:22.415004 30889 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:10:22.473330 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:22.474478 31300 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:22.476037 27339 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:22.477205 31202 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:22.478003 31129 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.006s
I20260709 13:10:22.481863 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.482605 27411 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:22.482864 27415 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.483130 31129 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.483711 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.483675 31129 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.484570 27413 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:22.485208 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.485613 27413 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.486122 31129 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.486068 27411 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.487623 27411 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:22.489122 27411 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.490347 27411 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:22.491537 27411 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.430653 31245 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.495611 31245 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.497074 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.497766 27409 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:22.456045 31073 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.487031 27413 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:22.498637 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.507303 31210 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.508522 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.509011 31210 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:22.509603 31097 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.510018 31097 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.502308 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.510510 31097 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.511459 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.512522 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.513492 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.514081 27413 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.514750 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.530256 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 563) took 1234 ms. Trace:
I20260709 13:10:22.531279 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.530771 27338 rpcz_store.cc:276] 0709 13:10:21.296029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.404582 (+1108553us) service_pool.cc:224] Handling call
0709 13:10:22.427414 (+ 22832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.434274 (+  6860us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:22.474538 (+ 40264us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.529534 (+ 54996us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.529749 (+   215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.529798 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:22.529984 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.530054 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.530193 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34827,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":189,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":370,"thread_start_us":53931,"threads_started":1,"wal-append.queue_time_us":54346}
I20260709 13:10:22.533733 30885 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:22.536382 30885 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.536798 30885 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.537647 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.538911 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.541457 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.542662 27338 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:22.542711 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 565) took 1246 ms. Trace:
I20260709 13:10:22.542941 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.543537 27339 rpcz_store.cc:276] 0709 13:10:21.296671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.476757 (+1180086us) service_pool.cc:224] Handling call
0709 13:10:22.542255 (+ 65498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.542402 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.542423 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:22.542470 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:22.542509 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.542559 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:22.542658 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.545104 27338 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:22.546180 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2379) took 6379 ms. Trace:
I20260709 13:10:22.546402 27338 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:22.546543 27343 rpcz_store.cc:276] 0709 13:10:16.166321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:17.344353 (+1178032us) service_pool.cc:224] Handling call
0709 13:10:17.344584 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:19.124152 (+1779568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.545793 (+3421641us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540025b7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:22.546020 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4059392256}
I20260709 13:10:22.547976 27338 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:22.548511 31097 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.549316 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.550019 27409 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:22.498584 31245 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:22.553916 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80689.4us
I20260709 13:10:22.556309 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.532493 31219 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.557371 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.558095 27409 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.558931 31219 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:22.559041 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:22.559901 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.560225 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:22.557420 27336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2104) took 2128 ms (client timeout 2027 ms). Trace:
W20260709 13:10:22.560814 27336 rpcz_store.cc:269] 0709 13:10:20.429048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:20.622896 (+193848us) service_pool.cc:224] Handling call
0709 13:10:22.550330 (+1927434us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400229f54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:22.557353 (+  7023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3800164736}
I20260709 13:10:22.561336 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.561754 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:22.562397 27336 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:22.560493 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.561862 27409 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.564863 31216 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:22.565251 31216 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.566074 31216 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.567947 31216 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.571732 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.571872 27263 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:22.572511 27259 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:22.572582 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:22.573731 27266 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:22.573822 31404 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:22.574649 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:22.576525 31291 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:22.576916 31291 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:22.577586 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:22.577818 31291 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.578855 31291 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.579851 27339 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:22.580765 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.581532 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1500) took 1257 ms. Trace:
I20260709 13:10:22.581837 27261 rpcz_store.cc:276] 0709 13:10:21.323640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.580398 (+1256758us) service_pool.cc:224] Handling call
0709 13:10:22.581472 (+  1074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.581784 31073 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:22.582293 27409 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:22.583428 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2423) took 1516 ms. Trace:
I20260709 13:10:22.590698 27335 rpcz_store.cc:276] 0709 13:10:21.066868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.490718 (+423850us) service_pool.cc:224] Handling call
0709 13:10:22.583268 (+1092550us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b540025add4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:22.583374 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36474112}
I20260709 13:10:22.584427 31073 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:22.584602 31245 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:22.592051 31245 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:22.592540 31245 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.594314 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.599057 31404 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:22.598847 31172 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.601189 31172 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.601529 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.602314 27266 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:22.603355 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:22.604221 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.604483 27416 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.604701 31300 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:22.605573 31147 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.605995 31147 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:22.585076 31097 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.615942 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.586222 31358 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:22.586311 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.587280 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1515) took 1138 ms. Trace:
I20260709 13:10:22.620571 27262 rpcz_store.cc:276] 0709 13:10:21.448696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.726927 (+278231us) service_pool.cc:224] Handling call
0709 13:10:21.729619 (+  2692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:21.769362 (+ 39743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.587002 (+817640us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b54000b86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:22.587196 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84939520}
I20260709 13:10:22.588797 27414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:10:22.605391 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.621960 27414 raft_consensus.cc:606] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.622514 27415 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.622556 27414 raft_consensus.cc:614] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:22.611578 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.614882 27413 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.624929 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.605472 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.619378 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:22.628007 27261 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:22.627068 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.629522 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.631031 27417 raft_consensus.cc:2376] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9. Re-sending same reply.
I20260709 13:10:22.632424 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:22.634250 31416 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:10:22.636562 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.637233 27408 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 6.
W20260709 13:10:22.639834 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53635.7us
I20260709 13:10:22.641345 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.643031 27417 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:22.643644 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.644189 27409 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:22.644965 27417 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:22.648492 27417 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:10:22.649623 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.652174 27335 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.655072 27417 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 13:10:22.655330 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:22.655988 27416 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.656133 27336 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:22.661303 27413 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.648578 31400 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.649196 31073 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:22.671247 27340 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 11. Ops: []
I20260709 13:10:22.671217 27414 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:22.672318 27408 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:22.673676 27409 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:22.633651 30889 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:10:22.669118 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.553s (SENT) [suppressed 36 similar messages]
I20260709 13:10:22.651576 31342 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:10:22.678193 31219 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:22.673290 31400 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.680013 30889 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:10:22.682943 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.683780 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.701685 27416 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
W20260709 13:10:22.687438 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 68160.4us
I20260709 13:10:22.643281 31147 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.688323 31338 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:22.708657 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:22.709293 31338 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.709380 30977 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:22.709995 30977 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:22.710492 31338 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.711695 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.713465 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:22.709293 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.716704 31147 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:22.717442 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.718307 28012 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:22.689342 27335 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
W20260709 13:10:22.719348 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.719492 27335 raft_consensus.cc:606] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.720065 27335 raft_consensus.cc:614] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:22.716728 28009 raft_consensus.cc:2368] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:22.720518 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.721210 28012 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.722412 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:22.668429 31073 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:22.724128 31073 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.724169 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.691958 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:22.692452 31161 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:22.693617 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:22.699995 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:22.684098 31253 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:22.702620 31406 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.296s	user 0.000s	sys 0.003s
I20260709 13:10:22.701574 30889 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:22.703506 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:22.704728 31400 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:22.706539 31218 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:22.706802 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.707448 31091 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:22.670310 31300 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:22.707577 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.708474 31219 consensus_queue.cc:1243] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:22.709400 27412 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:22.728317 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.734838 28011 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:22.729705 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.794762 28012 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:22.757114 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.776154 28014 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:22.731416 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1498) took 1408 ms. Trace:
W20260709 13:10:22.797257 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 97373.7us
W20260709 13:10:22.816991 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 113563us
I20260709 13:10:22.797026 27267 rpcz_store.cc:276] 0709 13:10:21.322957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.693191 (+1370234us) service_pool.cc:224] Handling call
0709 13:10:22.731352 (+ 38161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:22.728003 31161 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:22.730173 31253 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:22.831060 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.833536 28009 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:22.800757 31194 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.750551 31342 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:22.750996 31291 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:22.840951 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111334us
I20260709 13:10:22.828070 31097 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:22.839181 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800059320 after lost signal to thread 26161
W20260709 13:10:22.848587 27289 debug-util.cc:398] Leaking SignalData structure 0x7b08000ea0c0 after lost signal to thread 27200
I20260709 13:10:22.834762 31253 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.845847 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:22.731767 30885 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.856853 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.825315 31245 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:22.864081 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.931905 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:22.840512 31342 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:22.729182 30977 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.851958 31351 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:22.850873 31300 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:22.979523 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:22.980362 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 134376us
W20260709 13:10:22.979941 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 181796us
I20260709 13:10:23.010927 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:22.855789 31400 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.017558 30977 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:23.020303 27233 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:23.022042 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:23.023515 31161 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.024219 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.024662 31161 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.024933 28012 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:23.025842 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.026681 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.027316 28014 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:22.836359 31091 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:23.036720 27380 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.889s (SENT)
I20260709 13:10:23.036547 28006 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:22.844265 31194 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.866485 31291 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.047365 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.037256 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:22.978609 31097 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:22.986166 31342 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:23.066427 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 220798us
I20260709 13:10:23.175530 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.023552 31230 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.209470 28007 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:23.183737 28014 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 6.
I20260709 13:10:23.212246 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.208570 31219 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.215443 31371 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:23.215839 31219 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:22.843806 30889 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.027935 31400 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:23.233174 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 177294us
I20260709 13:10:23.235072 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.244247 28007 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:23.245790 28009 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:23.276872 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.277958 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.234508 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.281064 28006 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:23.251302 31268 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:23.283587 31268 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:23.284140 31268 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.284366 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:23.285173 31354 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:23.285595 31354 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:23.286016 27309 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:23.251961 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:23.286988 27335 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:23.252521 28015 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:23.288177 31211 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.288549 31358 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.655s	user 0.003s	sys 0.007s
I20260709 13:10:23.288662 31211 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:23.256991 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.289497 31358 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:23.290283 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.256413 30885 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:23.290736 31343 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.291350 30885 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.242033 31400 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.291457 31343 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.292634 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:23.295539 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800106160 after lost signal to thread 27292
W20260709 13:10:23.295892 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800203e60 after lost signal to thread 27293
W20260709 13:10:23.296967 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800320860 after lost signal to thread 27367
I20260709 13:10:23.297420 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.286490 31354 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.267405 31338 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.264575 31245 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.299145 31245 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:23.027204 31300 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.299535 31245 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:23.299746 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 564) took 2003 ms. Trace:
I20260709 13:10:23.300117 27341 rpcz_store.cc:276] 0709 13:10:21.296385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.417908 (+1121523us) service_pool.cc:224] Handling call
0709 13:10:22.433148 (+ 15240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.455647 (+ 22499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.299526 (+843879us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54001fc054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:23.299692 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26386176}
I20260709 13:10:23.267815 31202 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:23.301769 31300 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:23.268389 31091 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.269033 31172 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.269366 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.318661 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 85272.4us
I20260709 13:10:23.320363 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:23.321043 27412 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.221007 31230 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.215466 30882 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:23.325610 31230 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.325889 30882 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.329586 30882 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.271589 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.271932 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:23.330566 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 58715us
I20260709 13:10:23.331074 31216 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:23.272606 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 261653us
I20260709 13:10:23.286288 31268 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.289171 31072 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:23.334327 28011 raft_consensus.cc:2410] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:10:23.266088 31418 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:10:23.334803 27412 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:23.251736 31097 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.336265 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2143) took 1177 ms. Trace:
I20260709 13:10:23.336947 31230 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.336627 27343 rpcz_store.cc:276] 0709 13:10:22.158527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.547378 (+388851us) service_pool.cc:224] Handling call
0709 13:10:22.547653 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.547858 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.547881 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.548335 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.750844 (+202509us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:22.750902 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.751002 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.336065 (+585063us) raft_consensus.cc:1685] finished
0709 13:10:23.336081 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.336209 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":202027,"threads_started":1,"wal-append.queue_time_us":305432}
I20260709 13:10:23.268024 27408 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:23.278959 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.230796 31219 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:23.196260 31404 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.159409 31291 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.298859 31338 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.302078 31202 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.300403 31245 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.358842 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:23.372851 27309 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:23.342594 31172 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.376147 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:23.364012 30977 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:23.390722 27289 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9340 after lost signal to thread 27441
W20260709 13:10:23.391222 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800114720 after lost signal to thread 27442
I20260709 13:10:23.361184 31404 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:23.412521 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 142344us
W20260709 13:10:23.415653 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 145823us
I20260709 13:10:23.388197 31354 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.418356 31230 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:23.440762 28010 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.027s	sys 0.050s
W20260709 13:10:23.441004 31419 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:10:23.441196 28010 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.027s	sys 0.051s
W20260709 13:10:23.442029 31147 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.005s
I20260709 13:10:23.442495 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 567) took 1384 ms. Trace:
I20260709 13:10:23.442641 31147 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:23.379873 31351 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:23.443559 31351 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:23.374672 31300 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:10:23.442938 27342 rpcz_store.cc:276] 0709 13:10:22.058607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.500872 (+442265us) service_pool.cc:224] Handling call
0709 13:10:22.501213 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:22.509482 (+  8269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.509512 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:22.510102 (+   590us) log.cc:844] Serialized 52 byte log entry
0709 13:10:22.740719 (+230617us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.740777 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.740880 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.442227 (+701347us) raft_consensus.cc:1685] finished
0709 13:10:23.442250 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.442431 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7840,"raft.queue_time_us":8293,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":86,"thread_start_us":230150,"threads_started":1,"wal-append.queue_time_us":476485}
I20260709 13:10:23.380872 31371 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:10:23.442674 31422 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:10:23.451429 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 118603us
W20260709 13:10:23.455300 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.457316 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.444936 31351 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:23.438985 31268 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:10:23.404387 31130 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:10:23.437602 30977 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:23.474006 27289 debug-util.cc:398] Leaking SignalData structure 0x7b0800380800 after lost signal to thread 28039
W20260709 13:10:23.474506 27289 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7be0 after lost signal to thread 28040
W20260709 13:10:23.476347 27380 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.098s (SENT)
I20260709 13:10:23.447866 31216 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:23.482059 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:23.466320 31073 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.741s	user 0.013s	sys 0.000s
I20260709 13:10:23.486968 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:23.495973 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.463615 31230 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:23.482004 31300 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:23.482123 31428 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:23.514902 28012 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:23.518697 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.505039 31147 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:23.533046 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 55462.8us
W20260709 13:10:23.532631 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 156569us
I20260709 13:10:23.533990 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:23.537093 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60804.1us
I20260709 13:10:23.511864 31300 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:23.531008 31202 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.538411 31172 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.540599 31147 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.498826 31073 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.548888 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:23.549587 27267 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.550088 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:23.550863 27262 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:23.551980 28010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:23.552645 28010 raft_consensus.cc:606] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:23.549136 31253 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.000s
I20260709 13:10:23.552984 28010 raft_consensus.cc:614] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:23.559545 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:23.560048 31343 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.560297 27266 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.561442 31404 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.521977 31434 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:23.562810 31216 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.522508 31291 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.530649 31097 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:23.568423 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 148505us
I20260709 13:10:23.576126 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2435) took 2300 ms. Trace:
I20260709 13:10:23.576586 27337 rpcz_store.cc:276] 0709 13:10:21.264263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.069375 (+805112us) service_pool.cc:224] Handling call
0709 13:10:22.070078 (+   703us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:22.080363 (+ 10285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:22.082031 (+  1668us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.173276 (+ 91245us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.173860 (+   584us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:22.222937 (+ 49077us) log.cc:844] Serialized 624 byte log entry
0709 13:10:22.223089 (+   152us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:22.250574 (+ 27485us) log.cc:844] Serialized 14 byte log entry
0709 13:10:22.250798 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.250902 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.533186 (+1282284us) spinlock_profiling.cc:243] Waited 3.96 ms on lock 0x7b18003fb980. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:23.563283 (+ 30097us) raft_consensus.cc:1685] finished
0709 13:10:23.563304 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.564672 (+  1368us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":790,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":57193,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":645,"spinlock_wait_cycles":9107712,"thread_start_us":88130,"threads_started":1,"wal-append.queue_time_us":97912}
I20260709 13:10:23.507891 31430 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:10:23.535181 31338 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.587623 27267 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:23.589036 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:23.534824 31351 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.599048 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.599565 31351 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.599874 28006 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:23.602489 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2105) took 3173 ms. Trace:
I20260709 13:10:23.607767 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:23.602883 27340 rpcz_store.cc:276] 0709 13:10:20.429339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:21.593608 (+1164269us) service_pool.cc:224] Handling call
0709 13:10:22.589617 (+996009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:22.675565 (+ 85948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.601631 (+926066us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b540025add4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:23.602284 (+   653us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540025add0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:23.602433 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476810368}
W20260709 13:10:23.611078 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44567.8us
I20260709 13:10:23.653045 27262 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:23.652285 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:23.652457 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 72157.2us
I20260709 13:10:23.655434 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:23.578555 31432 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:23.587994 31291 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:23.659478 27265 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 7: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:23.665632 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.669648 28008 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.671917 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.679272 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:23.662504 31161 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 13:10:23.680152 28014 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:23.687804 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.569881 31253 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.667375 31432 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.697000 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:23.708668 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 174757us
I20260709 13:10:23.712106 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.713333 27336 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:23.718094 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.720528 27261 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:23.729537 27266 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:23.730997 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:23.731353 30977 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.681166 31342 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.678960 31300 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.736115 31300 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:23.736610 31253 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:23.680707 31338 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:23.739470 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.716612 31161 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:23.710033 31432 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:23.741999 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1624) took 1780 ms. Trace:
I20260709 13:10:23.742538 27410 rpcz_store.cc:276] 0709 13:10:21.961407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.278509 (+1317102us) service_pool.cc:224] Handling call
0709 13:10:23.278996 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:23.354960 (+ 75964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:23.355000 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:23.368188 (+ 13188us) log.cc:844] Serialized 26 byte log entry
0709 13:10:23.520872 (+152684us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:23.520927 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:23.521116 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:23.741613 (+220497us) raft_consensus.cc:1685] finished
0709 13:10:23.741639 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:23.741782 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39156,"raft.queue_time_us":65442,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4963,"thread_start_us":102124,"threads_started":1,"wal-append.queue_time_us":266999}
I20260709 13:10:23.745348 31073 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:23.750123 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:23.750871 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.751231 31442 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.751488 30977 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:23.753460 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:23.719601 31441 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:23.754520 31441 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:23.755577 31441 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.756709 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:23.759224 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.766636 28008 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:10:23.767683 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 112359us
I20260709 13:10:23.728534 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:23.779084 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50632.2us
I20260709 13:10:23.734925 31342 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:23.783721 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.788694 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.789919 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.791379 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.792482 28009 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:23.775731 31253 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.781208 31449 raft_consensus.cc:2764] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:23.797022 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.798249 27233 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:23.777743 30885 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:23.783839 31354 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:23.830832 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.741863 31400 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.834609 31354 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.862717 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:23.874979 28006 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:23.828575 31253 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.866371 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:23.835014 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50564.3us
I20260709 13:10:23.876431 27337 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:23.720958 31438 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 13:10:23.834589 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:23.879601 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:23.880745 27342 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:23.871256 31430 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:23.884037 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85873.7us
I20260709 13:10:23.888002 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:23.889721 27411 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:23.890385 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:23.876871 31354 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:23.885761 31430 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:23.907805 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:23.902109 27336 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:23.903252 27267 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:23.917682 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.918136 27260 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:10:23.912415 31430 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:23.928977 31447 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:23.932644 27337 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
W20260709 13:10:23.921268 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 351650us
I20260709 13:10:23.920194 31453 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.937357 27341 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:10:23.940395 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:23.941201 27335 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:23.942243 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:23.937992 31443 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:23.943446 31443 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.943944 31443 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:23.952087 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:23.953873 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:23.954668 31447 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:23.955292 31447 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:23.956369 31447 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:23.957662 31253 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:23.959118 31400 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:23.960115 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:23.959290 31453 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:23.961114 27265 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:23.942277 27341 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:23.959964 31253 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:23.959797 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:23.962983 31453 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:23.985647 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:23.968840 31253 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:23.990394 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:23.992600 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:23.983906 31444 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:24.003505 31444 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:24.004001 31444 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.004858 31131 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:24.007459 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.008695 27337 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:24.005465 31131 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.016784 31253 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.016949 31291 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:24.019395 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 77244.9us
I20260709 13:10:24.020128 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.020715 27340 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:24.020836 27266 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:24.018802 31131 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:23.984364 31400 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.025717 31432 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.026883 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.027305 31354 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.031793 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 499) took 1311 ms. Trace:
I20260709 13:10:24.032135 28013 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.031814 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.043998 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:24.033051 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:24.042619 28007 rpcz_store.cc:276] 0709 13:10:22.720080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.722022 (+  1942us) service_pool.cc:224] Handling call
0709 13:10:24.031567 (+1309545us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54004d3d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:24.031699 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118659840}
I20260709 13:10:24.033792 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.064158 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.065160 27264 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.068125 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.069269 27267 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:24.078905 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.080307 27266 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:10:24.089056 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 68426us
I20260709 13:10:24.098567 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.086876 31358 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.088749 31400 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.110494 27264 raft_consensus.cc:2410] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:10:24.111753 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.114136 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 92260.2us
I20260709 13:10:24.091276 31444 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.117935 31444 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.118572 31444 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:24.110971 31147 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.121230 31147 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:24.121670 31147 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.114212 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:24.122723 31453 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.124956 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:24.126166 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.127341 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:24.126166 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:24.132310 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.136433 27417 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:24.136998 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36154 (request call id 590) took 1453 ms. Trace:
I20260709 13:10:24.136216 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.138105 27266 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.148047 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.137353 27417 rpcz_store.cc:276] 0709 13:10:22.683430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.100358 (+1416928us) service_pool.cc:224] Handling call
0709 13:10:24.136929 (+ 36571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:24.149546 27413 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:24.151945 27336 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:10:24.155299 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.155807 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.155978 27336 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:24.154994 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.160658 27343 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.161262 27268 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.161695 27268 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:24.164016 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:24.165186 28014 raft_consensus.cc:2410] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:24.165910 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.175979 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.102005 31131 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:24.179641 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.184219 27412 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:24.142480 31439 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.180750 27264 raft_consensus.cc:2410] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:24.182958 27336 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:24.181360 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.203678 27410 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.176255 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.186862 27408 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:24.187137 31131 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:24.187469 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.205276 27413 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:24.189623 31211 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.190268 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.185722 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.206625 27409 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:24.196208 27412 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:10:24.208115 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:24.182678 31218 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.011s	sys 0.017s
I20260709 13:10:24.217281 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:24.224400 31218 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.011s	sys 0.018s
I20260709 13:10:24.227240 31358 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.227487 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.227849 31358 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.228821 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.229421 27264 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.197808 27268 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.234433 27417 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:24.236413 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.237449 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:24.239487 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.241926 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.242905 31404 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.243588 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.245631 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.248062 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.249459 27260 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:24.211302 31131 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:24.212298 31447 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:24.256459 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:24.268289 27266 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:24.257854 27343 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:24.238608 31430 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.237679 31442 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.277856 31447 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:24.224795 31300 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:10:24.258375 31404 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.293959 27264 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:24.295048 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.257180 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 126617us
I20260709 13:10:24.276691 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.278184 31432 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.281148 31354 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.309758 27264 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.315536 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.316253 27266 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.320142 27260 raft_consensus.cc:2410] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:24.297853 31358 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.298115 31427 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.232975 31439 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.270857 31443 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.323448 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.308403 31194 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.332512 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.333981 31443 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.343513 31430 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:24.337153 31468 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:10:24.347735 31447 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.339237 31354 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.307912 31442 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.355893 31354 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.358455 31442 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.361359 31439 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.364835 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:24.368062 31469 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:10:24.369060 31245 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.360291 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.376353 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 627) took 1351 ms. Trace:
I20260709 13:10:24.366766 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.377049 28012 rpcz_store.cc:276] 0709 13:10:23.025116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.025628 (+   512us) service_pool.cc:224] Handling call
0709 13:10:24.376077 (+1350449us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540043bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:24.376259 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734313216}
I20260709 13:10:24.391669 27264 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:24.392275 27264 pending_rounds.cc:85] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:24.392602 27264 pending_rounds.cc:107] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:24.392956 27264 raft_consensus.cc:2889] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.358982 31354 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.406780 27410 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:24.410563 27266 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:24.413769 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.414631 27262 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:24.419806 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:24.421623 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.421862 27410 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:24.397743 31351 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.362967 31253 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.430262 27262 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:24.428228 31351 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.432704 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.433408 27409 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.438476 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.439695 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.440923 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.439003 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.445160 27266 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:24.446004 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.446345 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.444060 27262 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:24.447523 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 630) took 1421 ms. Trace:
I20260709 13:10:24.442162 31253 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.442008 31147 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.444350 27264 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:24.446939 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.456070 27343 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:24.448678 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.455516 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.451468 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.447995 28011 rpcz_store.cc:276] 0709 13:10:23.025959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.232362 (+206403us) service_pool.cc:224] Handling call
0709 13:10:24.447313 (+1214951us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b54000307d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:24.447462 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224163456}
W20260709 13:10:24.455188 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.013s	sys 0.015s
I20260709 13:10:24.453328 31354 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:10:24.471288 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.472080 27339 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:24.473201 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:24.474577 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.476591 27414 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:24.477496 31147 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.433429 31351 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.479580 27337 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:24.479737 27410 raft_consensus.cc:2368] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
W20260709 13:10:24.480562 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:24.480806 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.016s	sys 0.018s
W20260709 13:10:24.481196 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.457882 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:24.481354 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.14944e+06us
I20260709 13:10:24.455024 31484 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.489751 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.490079 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.492087 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.493244 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.495653 27409 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
W20260709 13:10:24.496732 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 363487us
I20260709 13:10:24.497745 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.506119 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.483678 31354 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.508941 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.515805 27409 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:10:24.497332 31421 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.232s	user 0.005s	sys 0.003s
I20260709 13:10:24.497010 31097 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:24.533641 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.505918 31484 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:24.537381 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.538036 27409 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
W20260709 13:10:24.538631 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 80882.4us
I20260709 13:10:24.535732 27410 raft_consensus.cc:2393] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:24.536113 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:24.540542 27416 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:10:24.541424 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.541947 27416 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:24.543107 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.544368 31354 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:24.539821 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2599099059999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:10:24.552332 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2365099059999238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:10:24.552785 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2239099059999035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260709 13:10:24.534562 31219 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:24.553126 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2239099059999035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
I20260709 13:10:24.566908 31131 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.569839 27414 pending_rounds.cc:85] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 7
I20260709 13:10:24.570173 27414 pending_rounds.cc:107] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:10:24.570398 27414 raft_consensus.cc:2889] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.576397 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:24.577291 27231 connection.cc:256] RPC call timeout handler was delayed by -1.156409905999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:10:24.577484 31428 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:24.578926 27265 raft_consensus.cc:2410] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:24.581044 31428 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:24.575609 31354 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.581852 31354 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.582149 31428 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.584391 31354 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.560745 31218 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.576726 31253 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.586402 31218 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.586858 31253 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.587285 31484 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.589393 31253 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.589824 31218 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:24.590553 27231 connection.cc:256] RPC call timeout handler was delayed by -1.156409905999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:10:24.578756 27409 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:24.584422 31485 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:10:24.568845 31131 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:24.591176 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0826099059999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 13:10:24.595569 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0826099059999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:10:24.596045 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2144) took 2437 ms. Trace:
W20260709 13:10:24.596024 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0577401079999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3018s for a response
W20260709 13:10:24.609759 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.596459 27338 rpcz_store.cc:276] 0709 13:10:22.158786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:22.548627 (+389841us) service_pool.cc:224] Handling call
0709 13:10:22.548921 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:22.549544 (+   623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:22.549577 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:22.550011 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:10:22.729956 (+179945us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:22.731113 (+  1157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:22.732497 (+  1384us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:24.474808 (+1742311us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:24.591421 (+116613us) raft_consensus.cc:1685] finished
0709 13:10:24.591443 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:24.595977 (+  4534us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":97,"spinlock_wait_cycles":116501760,"thread_start_us":179575,"threads_started":1,"wal-append.queue_time_us":499798}
I20260709 13:10:24.612048 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.593091 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.561949 31494 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:10:24.603808 31428 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.661075 31371 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.664975 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:24.667224 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49372.6us
I20260709 13:10:24.669740 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:24.604075 31218 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:24.662317 31490 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:24.672835 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:24.668165 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.675645 27409 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:24.679900 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:24.678196 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:24.684902 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.686579 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:24.681430 31342 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:24.695786 31500 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:24.699294 31443 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.708942 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 578) took 1162 ms. Trace:
I20260709 13:10:24.709547 27261 rpcz_store.cc:276] 0709 13:10:23.546705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.546854 (+   149us) service_pool.cc:224] Handling call
0709 13:10:23.547207 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.726454 (+179247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.708596 (+982142us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54003151d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:24.708854 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398072064}
I20260709 13:10:24.713112 31338 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.713966 31338 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.725569 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.670881 31496 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:24.681815 31453 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:24.677071 31129 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.676625 31442 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.662436 31354 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:10:24.755656 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 77538.9us
I20260709 13:10:24.764277 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.714475 31338 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.755052 27259 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:10:24.754230 31400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.008s
I20260709 13:10:24.760190 31497 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:24.771019 27409 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:24.771945 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 83617.3us
I20260709 13:10:24.772491 27409 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:10:24.749249 31496 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:24.792968 27336 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:24.776051 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:24.684912 31351 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:10:24.755064 31147 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.787858 27409 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:24.767571 31400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.002s	sys 0.008s
I20260709 13:10:24.682552 31218 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.806900 28012 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:24.681003 31097 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:24.760743 31342 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:24.799817 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:24.820827 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 241554us
I20260709 13:10:24.682720 31371 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.851750 27268 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.853085 31453 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.855254 31338 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:24.856801 31492 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:24.857292 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.810402 31451 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:24.861212 31451 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:24.862232 31451 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:24.867425 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91548us
I20260709 13:10:24.868566 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:24.804201 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:24.869494 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69763.1us
I20260709 13:10:24.869693 28011 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:24.805183 28010 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:24.806205 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:24.870266 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.870740 28009 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.798380 31428 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:24.819482 27409 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:24.761193 31439 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:24.822017 31429 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:24.822419 31431 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.826979 31475 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:24.828732 31218 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:24.797839 31496 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.871428 31500 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.878446 31484 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:24.840399 27414 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:24.882510 31500 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.849273 31202 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.883430 31202 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.875136 31358 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:24.885048 31358 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:24.885214 30882 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:24.885500 31358 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:24.885581 31202 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.850479 27412 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:24.873721 27413 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:24.887259 31428 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:24.887482 31130 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:24.887867 31130 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:24.888271 31428 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.888690 31130 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.890007 31130 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:24.879460 31439 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.891155 30882 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:24.892041 30882 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.893028 31431 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.894059 30889 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:24.895098 31431 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.895397 31371 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.896282 31342 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.823026 31505 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.897466 31505 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:24.875144 31429 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.899537 31429 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.899678 31505 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.900707 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1651) took 1581 ms. Trace:
I20260709 13:10:24.901067 27411 rpcz_store.cc:276] 0709 13:10:23.318962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.324886 (+  5924us) service_pool.cc:224] Handling call
0709 13:10:23.325153 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:23.892753 (+567600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.900478 (+1007725us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54000be5d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:24.900652 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287751040}
I20260709 13:10:24.903074 31091 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:24.903597 31091 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.875478 31131 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:10:24.906232 31091 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:24.880087 31453 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:24.876471 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.909546 28009 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:24.872654 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.918143 31202 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:24.918540 31202 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.918887 31202 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:24.919457 31451 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:24.892969 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.878708 27268 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:24.881115 31475 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:24.893420 30882 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:24.921998 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49420.4us
I20260709 13:10:24.935434 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.940280 27414 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:24.936316 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:24.943904 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:24.945619 31432 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:24.946070 31432 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:24.946429 31432 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:24.892973 31439 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:24.951601 31097 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.953226 31300 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:24.953881 31439 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:24.955178 31505 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:24.955587 31505 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:24.956321 27265 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:10:24.956734 27265 pending_rounds.cc:85] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:24.956995 27265 pending_rounds.cc:107] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:24.957414 27265 raft_consensus.cc:2889] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.959721 27414 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:24.960588 27410 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:10:24.944825 27259 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:24.959770 27415 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:24.877790 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.924115 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:24.927340 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:24.928658 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:24.923086 27268 pending_rounds.cc:85] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:24.953835 31300 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:24.930490 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:24.956900 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 637) took 1687 ms. Trace:
I20260709 13:10:24.963275 27409 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:24.964361 27268 pending_rounds.cc:107] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:10:24.963140 28013 rpcz_store.cc:276] 0709 13:10:23.269157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:23.293585 (+ 24428us) service_pool.cc:224] Handling call
0709 13:10:24.031908 (+738323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:24.043533 (+ 11625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:24.956643 (+913110us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54004d3d50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:24.956824 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697249152}
I20260709 13:10:24.964808 27268 raft_consensus.cc:2889] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:24.963056 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:24.869084 31211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.024s	sys 0.040s
W20260709 13:10:24.987788 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63740.9us
I20260709 13:10:24.973168 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:24.976699 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 98961.4us
W20260709 13:10:24.979650 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44196.8us
I20260709 13:10:24.995952 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.997227 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:24.998211 27341 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.006487 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.007745 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.008796 27268 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:24.929149 31475 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:24.938959 31147 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.030088 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.993481 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:24.938922 31443 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.016446 27233 leader_election.cc:400] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:25.003907 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:24.975226 31219 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:24.941300 31500 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.032315 27233 leader_election.cc:403] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:10:25.033424 27416 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:24.996860 31211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.025s	sys 0.040s
W20260709 13:10:24.997152 31343 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:10:25.066625 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.058028 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:25.040961 27338 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:25.042824 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51075.6us
I20260709 13:10:25.045842 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:25.069993 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.043556 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.043449 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:25.044427 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.053524 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:24.996788 31091 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:25.075347 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:25.071359 27262 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:25.010653 31499 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:10:25.034017 31291 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.035255 31431 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.074910 27260 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.089082 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:25.029476 31497 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:25.083952 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:25.084694 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.097435 27342 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:25.049544 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:25.045053 31400 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.072286 31430 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.071962 31447 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:25.102047 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 172455us
I20260709 13:10:25.016881 31354 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:25.036938 31131 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.098855 28010 raft_consensus.cc:2376] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13. Re-sending same reply.
I20260709 13:10:25.065722 30977 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:25.029402 31194 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:25.152515 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.072082 31253 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.032790 31338 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:25.106048 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.153162 27338 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:25.097630 31091 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:25.034878 31427 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:10:25.016482 31477 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:10:25.151834 27342 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:25.140172 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:25.076061 31072 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:25.124778 31430 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:25.107254 31400 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.095911 31291 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.156474 31131 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.095420 31463 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:25.039794 31147 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:25.139150 31481 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:25.170271 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.121749 31172 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:10:25.077145 31505 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.157474 31218 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:10:25.104709 31497 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:25.237004 31497 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.160516 30977 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.240564 28008 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:25.240801 31432 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.243345 31503 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:10:25.243944 31358 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.246086 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.246945 27262 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:25.249432 30977 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.177281 31430 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.163194 31501 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:10:25.235390 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 186616us
W20260709 13:10:25.171185 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 129431us
I20260709 13:10:25.246258 31358 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.166356 31354 raft_consensus.cc:2764] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:25.160971 31253 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.252111 27260 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:25.251111 31429 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.166759 31194 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.266713 31194 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.267243 31432 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.181802 31500 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.205169 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:25.269613 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 276197us
I20260709 13:10:25.269878 27338 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:25.157656 31129 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.270834 31129 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.252156 31097 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:25.271723 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 195333us
I20260709 13:10:25.271533 31202 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.273054 31441 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:25.273435 31441 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:25.273566 31400 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.274000 31202 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.255815 27265 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:25.162734 31338 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.275302 31091 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.257112 31427 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:25.277058 31427 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:25.277189 31338 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.277781 31338 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.277901 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.274276 31441 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.213165 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.157855 31404 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:25.279515 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.266933 28006 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:25.261216 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.269186 31194 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:25.281742 27262 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
W20260709 13:10:25.285529 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 81182.8us
I20260709 13:10:25.286351 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:25.286748 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 233346us
I20260709 13:10:25.253908 27341 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:25.287737 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.169030 31245 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:10:25.288393 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.271303 31129 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:25.283813 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.308627 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.310631 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.311980 27408 raft_consensus.cc:2410] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:10:25.291682 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.313484 27262 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:25.314721 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.271303 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:25.304035 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.263592 31300 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:25.315493 27265 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:25.320847 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:25.329607 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:25.169421 31510 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:25.318753 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:25.285854 31432 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.340027 27417 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:25.255800 31463 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:25.215842 31477 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:10:25.258116 31358 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:25.333878 27408 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:25.259985 31505 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.357973 30889 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:25.358085 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:25.358501 30889 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.261374 31451 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:10:25.358887 30889 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.359341 31351 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.335696 27413 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:25.359884 31351 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.261940 31253 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.340919 31441 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:25.362370 31351 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:25.167305 31475 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.367928 31475 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.368945 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.369556 27408 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.367002 30889 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.371541 31358 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:25.371874 27408 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:25.372233 31291 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.373486 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.337179 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:25.259153 31147 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:25.340121 27409 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:25.285643 31211 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:25.386288 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:25.339864 31501 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.347220 31434 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.391369 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:25.391893 27267 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:25.391721 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.359972 31451 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.392910 27338 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:25.347579 27416 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:25.345183 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.347903 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:25.348208 31499 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:25.343269 31503 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:10:25.348955 31522 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:25.278033 31427 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.346618 31172 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:25.352367 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 81236.8us
I20260709 13:10:25.427600 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:25.353929 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.429216 27414 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:25.331048 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:25.356689 30977 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.367811 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.431428 27413 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.271737 31097 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:25.434630 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:25.374266 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 205847us
I20260709 13:10:25.324776 31202 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.255614 31131 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:25.325198 31245 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:25.379452 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.380241 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:25.471328 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 140377us
I20260709 13:10:25.380367 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:25.381022 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:25.381745 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:25.382598 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.300201 31429 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:25.387485 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:25.324467 31443 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:25.389484 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.257962 31496 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.336079 31494 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.396124 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:25.373060 31358 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.413015 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.416131 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:25.481884 27337 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:25.603574 27266 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.601154 27410 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:25.600410 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 252562us
I20260709 13:10:25.397989 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:25.356750 31521 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:25.609393 27343 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:25.610553 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 138496us
I20260709 13:10:25.437107 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.618374 27416 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:25.386463 31505 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:25.397328 31434 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.440840 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:25.669165 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 232890us
W20260709 13:10:25.459919 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:25.481734 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.586500 27267 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:25.587296 27264 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:25.606669 27268 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.424192 31501 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.626928 31172 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.627275 31505 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.660140 31524 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.624321 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 518320us
I20260709 13:10:25.626024 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:25.626579 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.629240 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:25.689425 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.601162 27334 raft_consensus.cc:2376] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9. Re-sending same reply.
I20260709 13:10:25.690619 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.691495 27412 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:25.557061 31517 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:25.692466 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 224260us
I20260709 13:10:25.476823 31510 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.660912 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.696074 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.660981 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:25.696889 27414 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:25.472934 31447 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:25.472535 30977 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.476927 31147 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:25.664819 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:25.722880 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:25.723549 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 84646.3us
I20260709 13:10:25.675808 27413 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:10:25.677646 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 243084us
I20260709 13:10:25.664089 31427 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.686347 31501 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.638247 31518 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.668083 31434 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.426350 31477 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.701892 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:25.749836 27412 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:25.686990 31131 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:25.702935 27980 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:25.753775 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50969.2us
I20260709 13:10:25.707216 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:25.755335 27414 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:10:25.708138 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 82492.3us
I20260709 13:10:25.710773 27342 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:25.715744 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.414346 31451 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.730453 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:25.686141 31505 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.720077 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.741205 27410 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:25.673532 31291 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:10:25.769990 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.765738 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:25.771289 28008 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:25.767516 27342 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:25.772557 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.775662 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:25.740031 31500 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:25.783825 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:25.787138 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64325.4us
I20260709 13:10:25.745983 31518 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:25.706305 31499 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:10:25.740510 31351 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:25.632834 31463 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.790596 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.789714 28013 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:25.712715 31503 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:10:25.715070 31494 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:10:25.780515 31447 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:25.756523 31526 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:25.780187 31130 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.761044 31451 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.784597 31211 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:25.829576 31428 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:25.761454 31520 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.430s
I20260709 13:10:25.706868 31524 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.752225 31245 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.715229 31517 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.792340 31518 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.733505 31097 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.769028 31131 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.817168 31172 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.805701 31351 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.826135 31130 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:25.950846 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91811.8us
W20260709 13:10:25.953264 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 159334us
I20260709 13:10:25.746315 31443 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.768565 31477 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:25.851073 31404 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:25.831027 31447 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:25.975421 31484 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.976224 31518 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.976420 31447 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.974822 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.977875 31529 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:25.978699 31518 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:25.897590 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:25.980422 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.850431 31543 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.168s
I20260709 13:10:25.872653 31530 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.851033 31534 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:25.972740 31428 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:10:25.972908 31522 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:25.973738 31291 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:25.903891 31550 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:10:25.981899 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.806138 31500 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:26.005519 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 289836us
I20260709 13:10:25.853958 31547 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:25.961433 31130 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:25.998838 31097 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.021297 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:25.830621 31526 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:25.854094 31338 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
W20260709 13:10:26.015997 31430 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.002s
I20260709 13:10:26.056239 28011 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:26.080562 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59351.3us
I20260709 13:10:26.081868 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.048087 28010 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:26.084471 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.073855 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:26.085170 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.036367 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:26.086648 28013 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:26.080229 31091 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.002s	sys 0.016s
I20260709 13:10:26.024828 31530 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:26.040238 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:26.032577 31444 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:26.098095 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 73950.4us
W20260709 13:10:26.096841 31091 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.002s	sys 0.016s
I20260709 13:10:26.121572 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:26.109022 28011 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:26.103127 27412 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:26.178369 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 219477us
I20260709 13:10:26.082058 30977 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.137712 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:26.032385 31549 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:26.106273 31504 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.132s	user 0.001s	sys 0.002s
W20260709 13:10:26.122033 31536 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.280s	user 0.000s	sys 0.004s
I20260709 13:10:26.033730 31547 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:26.090355 31428 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.127153 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:26.187194 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:26.247822 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60781.8us
W20260709 13:10:26.198910 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 158823us
I20260709 13:10:26.118471 31494 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.121819 31525 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.322s	user 0.002s	sys 0.002s
I20260709 13:10:26.202637 31300 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.204569 31522 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.202906 31510 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.116422 31129 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.786s	user 0.011s	sys 0.000s
W20260709 13:10:26.118325 31497 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.881s	user 0.007s	sys 0.006s
I20260709 13:10:26.225131 31131 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.122162 31548 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:26.098683 31484 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.207442 31549 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:26.108628 31400 consensus_meta.cc:287] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.834s	user 0.009s	sys 0.002s
I20260709 13:10:26.335705 31400 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.337183 27408 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:26.236652 31444 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.176136 27342 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:26.229275 31130 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.238112 31351 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.345996 31524 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.240399 31477 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.079947 31430 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.096419 31501 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.216128 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:26.099344 31530 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:26.121625 31500 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:26.089447 31253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.084s	sys 0.166s
I20260709 13:10:26.251955 27412 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:26.423997 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:26.255846 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:26.426182 27414 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:10:26.257332 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 168787us
I20260709 13:10:26.427556 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.101655 31211 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:26.227859 31475 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.003s
I20260709 13:10:26.260397 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:26.262095 31544 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.262024 31354 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:26.262492 31555 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.262712 31439 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.247677 31543 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:26.263839 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:26.263003 31556 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.450275 31543 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:26.450030 31439 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.247850 31428 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:26.451084 31428 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.248354 31547 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.257483 31499 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:26.293300 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.453537 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 193211us
I20260709 13:10:26.121421 31541 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.431s
W20260709 13:10:26.319185 31537 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:10:26.323437 31540 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:10:26.435914 31500 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:26.201341 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 63801.5us
W20260709 13:10:26.348202 31504 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:26.264358 31534 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
W20260709 13:10:26.415364 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:26.453745 31451 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.004s
W20260709 13:10:26.396745 31505 consensus_meta.cc:287] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.003s
W20260709 13:10:26.423069 31253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.084s	sys 0.177s
I20260709 13:10:26.429591 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:26.365123 31549 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.288715 31129 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.451215 31543 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.529987 31129 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.454375 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:26.456971 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 193360us
I20260709 13:10:26.265561 31494 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:26.531211 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76898.2us
I20260709 13:10:26.531658 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:26.457096 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:26.395475 31525 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:10:26.106056 31434 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.532965 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:26.533571 31565 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:26.533964 31554 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:26.534505 27341 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:26.463135 31560 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:26.511044 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 81529us
I20260709 13:10:26.294201 31497 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.535398 31554 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:26.536772 31497 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.514067 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:26.537731 27409 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:26.539467 31431 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:26.540536 31431 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:26.540961 31431 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:26.462392 31530 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.542127 31530 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.281229 31510 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.545900 31549 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.532146 31351 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:26.546682 31548 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:26.463804 31354 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.444347 31544 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.547106 31548 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.547430 31354 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.547595 31548 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:26.547895 31354 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.546983 31351 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:26.546227 31510 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.549628 31351 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:26.462147 31552 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:10:26.456090 31439 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.552464 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1682) took 1121 ms. Trace:
I20260709 13:10:26.557937 31253 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:26.558112 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 101105us
I20260709 13:10:26.575317 27417 rpcz_store.cc:276] 0709 13:10:25.431673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.432278 (+   605us) service_pool.cc:224] Handling call
0709 13:10:25.608946 (+176668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.609401 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.609445 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.610067 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.769365 (+159298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:25.769406 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.769471 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.552235 (+782764us) raft_consensus.cc:1685] finished
0709 13:10:26.552272 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.552408 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14840,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":33629,"thread_start_us":75328,"threads_started":1,"wal-append.queue_time_us":540582}
I20260709 13:10:26.558769 31554 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:26.532976 31494 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:26.559350 31129 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.559881 31510 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.561262 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:26.514680 31505 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.563485 31501 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:26.564239 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:26.564843 31475 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:26.565282 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:26.477677 31453 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.568352 31556 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:26.555285 31534 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:26.552346 31430 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:26.571655 31130 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:26.579279 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:26.460084 31526 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.594275 28008 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:26.565522 31300 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.596304 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:26.542755 31428 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.613257 28010 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.603080 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:26.604768 27334 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:26.607791 27417 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:26.614022 27342 raft_consensus.cc:2376] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13. Re-sending same reply.
I20260709 13:10:26.599272 31475 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:26.584486 31432 consensus_meta.cc:287] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.233s	user 0.011s	sys 0.002s
I20260709 13:10:26.610841 31530 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.612536 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:26.583596 31554 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.450057 31555 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.617851 31300 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.625350 31549 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:26.617895 31530 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.626325 31354 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.627012 31072 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:26.627332 31477 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:26.628355 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:26.633762 28010 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:26.639655 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 60495.3us
I20260709 13:10:26.668900 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.669946 31340 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:26.670156 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.621407 31432 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:26.646744 31553 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.470s	user 0.004s	sys 0.012s
I20260709 13:10:26.650033 31505 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.599998 31129 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.604112 31443 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.653537 31428 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.595945 31510 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.616189 31211 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.656106 31554 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.616458 31475 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:26.511528 31451 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.459494 31499 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.608987 31534 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:26.670439 31340 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:26.676419 31300 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.678821 31547 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.680399 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:26.681469 28008 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:26.664132 31530 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.676219 31343 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.661010 31130 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.692169 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:26.697535 27408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1678) took 1324 ms (client timeout 1711 ms). Trace:
W20260709 13:10:26.712121 27408 rpcz_store.cc:269] 0709 13:10:25.373168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.373263 (+    95us) service_pool.cc:224] Handling call
0709 13:10:26.697270 (+1324007us) spinlock_profiling.cc:243] Waited 963 ms on lock 0x7b5400377154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:26.697459 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2214446336}
I20260709 13:10:26.712688 27411 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:26.666813 31072 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:26.704995 27337 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:26.678994 31354 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.700122 31554 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.724076 31072 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.737358 27336 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:26.714118 31131 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:26.690867 31443 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:26.727875 31529 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.746s	user 0.013s	sys 0.000s
I20260709 13:10:26.708244 31343 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:26.731490 31428 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:26.742725 31499 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.723727 30889 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:26.755815 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 68408.9us
W20260709 13:10:26.764891 31097 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 13:10:26.743389 31340 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.766889 31340 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:26.751642 31343 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:26.777654 31538 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.703s	user 0.003s	sys 0.009s
I20260709 13:10:26.719909 31130 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.779378 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1669) took 1445 ms. Trace:
I20260709 13:10:26.779824 27415 rpcz_store.cc:276] 0709 13:10:25.333867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.333984 (+   117us) service_pool.cc:224] Handling call
0709 13:10:25.346648 (+ 12664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.363006 (+ 16358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.363037 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.363580 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.676804 (+313224us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:25.676914 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.677073 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.776792 (+1099719us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:26.778987 (+  2195us) raft_consensus.cc:1685] finished
0709 13:10:26.779017 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:26.779306 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15953,"raft.queue_time_us":16344,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":78,"spinlock_wait_cycles":251200256,"thread_start_us":312815,"threads_started":1,"wal-append.queue_time_us":600838}
W20260709 13:10:26.781283 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.782409 31354 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:26.782974 31354 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.785810 31354 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.794070 31400 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.795727 31531 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.796371 31531 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:26.797642 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.798619 31531 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.799889 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:26.800419 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:26.800871 27415 raft_consensus.cc:2410] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:26.801980 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:26.802146 31531 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.802570 27415 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:26.800043 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2457) took 1857 ms. Trace:
W20260709 13:10:26.805244 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 47481.5us
I20260709 13:10:26.804459 27264 rpcz_store.cc:276] 0709 13:10:24.942333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.942492 (+   159us) service_pool.cc:224] Handling call
0709 13:10:24.977468 (+ 34976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.671490 (+694022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.799805 (+1128315us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000b0754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:26.799986 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401837824}
I20260709 13:10:26.815554 28008 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:26.751863 31529 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:26.736002 31554 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.823885 31194 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:26.781181 31130 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.759145 31129 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:26.821197 31566 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:26.868202 31561 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:26.868872 31561 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.847121 31428 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:26.836308 31484 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.802685 31531 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.876391 27233 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:26.816349 31430 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:26.840698 31547 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.871142 31561 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.882082 27267 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:26.894503 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 190896us
I20260709 13:10:26.887435 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:26.888707 27261 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:26.877925 27415 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:26.893736 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:26.898406 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:26.898144 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:26.899487 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:26.899672 27266 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.887806 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:26.901343 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:26.901952 27268 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.903522 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:26.913183 27260 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:26.914004 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:26.914846 27416 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 9: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:26.759093 31534 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.918514 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:26.930852 27261 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:26.845607 31500 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:10:26.928808 27268 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:26.934479 27266 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:26.938989 27266 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:26.895984 31428 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:26.941370 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:26.942499 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 54807.8us
I20260709 13:10:26.944010 27415 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:26.901019 31499 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:26.952744 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:26.953624 28013 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:26.912343 31561 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:26.948508 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:26.961233 27415 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:26.948586 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:26.950753 31567 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:26.956296 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:26.948442 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:26.962461 27268 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:26.937000 31444 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:26.951282 31547 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:26.875630 31484 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.959259 31451 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:26.963397 31531 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:26.951349 31556 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:26.969121 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:26.970002 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:26.970515 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:26.973266 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96944.3us
I20260709 13:10:26.983846 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.005930 27340 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:26.960911 31561 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:26.976220 31463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.010s	sys 0.033s
I20260709 13:10:27.013795 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.021381 27268 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:27.014695 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:26.957270 31555 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:27.023914 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 67727.6us
I20260709 13:10:26.976572 31354 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.982529 31497 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:26.998930 31432 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:26.957643 31428 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.999043 31518 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.036643 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.003382 31522 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.011123 31444 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:27.038699 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:26.964862 31499 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:26.997601 31547 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:27.038333 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 512) took 1975 ms (client timeout 1698 ms). Trace:
I20260709 13:10:27.068948 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:27.019901 31561 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:27.013274 31549 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:27.078372 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:27.027520 31554 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.080972 27268 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:27.092599 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.093881 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.095044 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.095701 27268 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:27.097785 31484 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.079921 31072 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.099997 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:27.100807 31072 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.105057 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1558) took 1720 ms. Trace:
I20260709 13:10:27.087594 31510 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.106468 31434 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.107355 31451 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.108059 31510 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.107924 31451 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.108683 31510 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.110294 31451 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.100827 27408 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:27.112324 31512 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.080s	user 0.005s	sys 0.005s
I20260709 13:10:27.112355 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.112869 31499 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.040915 31497 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.114079 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.114886 27408 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:27.115038 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2459) took 1736 ms. Trace:
I20260709 13:10:27.115783 31497 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.115985 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1542) took 2975 ms. Trace:
I20260709 13:10:27.117514 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1679) took 1730 ms. Trace:
I20260709 13:10:27.116428 27263 rpcz_store.cc:276] 0709 13:10:24.140808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:24.327668 (+186860us) service_pool.cc:224] Handling call
0709 13:10:24.406339 (+ 78671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:24.413903 (+  7564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:24.413960 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:24.920110 (+506150us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b2c00000f48. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:10:24.920526 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:10:25.074886 (+154360us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:25.121264 (+ 46378us) log.cc:844] Serialized 14 byte log entry
0709 13:10:25.338385 (+217121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:25.338459 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:26.014754 (+676295us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b1800286420. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:27.111751 (+1096997us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:27.115745 (+  3994us) raft_consensus.cc:1685] finished
0709 13:10:27.115768 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.115899 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17362,"prepare.queue_time_us":44947,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5473,"raft.queue_time_us":139677,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":9695,"spinlock_wait_cycles":302863232,"thread_start_us":346066,"threads_started":2,"wal-append.queue_time_us":259203}
I20260709 13:10:27.117893 27409 rpcz_store.cc:276] 0709 13:10:25.387017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.387157 (+   140us) service_pool.cc:224] Handling call
0709 13:10:27.117316 (+1730159us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b540010e354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:27.117458 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188515712}
I20260709 13:10:27.116884 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:27.118805 31548 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.001s
W20260709 13:10:27.023649 31463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.010s	sys 0.034s
I20260709 13:10:27.023885 31556 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:27.038780 31354 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.085136 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.151084 31556 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.152206 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.152520 31354 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.105487 27259 rpcz_store.cc:276] 0709 13:10:25.384921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.391479 (+  6558us) service_pool.cc:224] Handling call
0709 13:10:25.391784 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:25.394079 (+  2295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.394123 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:25.394693 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.680671 (+1285978us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b1800046de0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:26.996674 (+316003us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:26.996724 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.996828 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.104746 (+107918us) raft_consensus.cc:1685] finished
0709 13:10:27.104766 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.104993 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1875,"raft.queue_time_us":5124,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":21595,"spinlock_wait_cycles":13396224,"thread_start_us":315726,"threads_started":1,"wal-append.queue_time_us":1618165}
I20260709 13:10:27.153712 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.031286 31501 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.089291 27412 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:27.075385 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:27.088774 31549 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.119004 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.119935 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.120621 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:27.157549 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.157735 27408 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.157879 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.124048 27980 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.115453 27341 rpcz_store.cc:276] 0709 13:10:25.379106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.379230 (+   124us) service_pool.cc:224] Handling call
0709 13:10:27.114840 (+1735610us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002da854. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:27.114978 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443816704}
I20260709 13:10:27.013406 31534 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.025964 31430 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:10:27.138059 31561 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.136960 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:27.082563 27231 connection.cc:256] RPC call timeout handler was delayed by -1.069379247000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260709 13:10:27.038379 31432 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.143939 27261 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:27.144912 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2462) took 1858 ms. Trace:
I20260709 13:10:27.167214 27262 rpcz_store.cc:276] 0709 13:10:25.286442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.286600 (+   158us) service_pool.cc:224] Handling call
0709 13:10:25.286913 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.314059 (+ 27146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.144647 (+1830588us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b54001b85d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:27.144846 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60092800}
I20260709 13:10:27.149428 28013 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:27.153661 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:27.085832 28006 rpcz_store.cc:269] 0709 13:10:25.062842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.075078 (+ 12236us) service_pool.cc:224] Handling call
0709 13:10:27.038152 (+1963074us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54005e38d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:27.038269 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411792768}
I20260709 13:10:27.154902 27259 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:10:27.105413 31547 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.159992 27412 raft_consensus.cc:2410] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:27.161331 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.170833 27263 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:27.159915 31549 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.140266 31499 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:27.111089 31510 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.160157 31354 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:27.180441 28008 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 7.
I20260709 13:10:27.188238 31428 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.194490 31496 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.195529 31531 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.160522 31501 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.168231 31432 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.148741 31548 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.205464 27415 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:10:27.210031 27409 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:10:27.306339 31548 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.308847 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.285766 31501 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:27.239909 27336 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2458) took 1861 ms (client timeout 1669 ms). Trace:
W20260709 13:10:27.273154 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 109454us
I20260709 13:10:27.295918 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2124) took 1667 ms. Trace:
I20260709 13:10:27.237399 27408 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
W20260709 13:10:27.310480 27336 rpcz_store.cc:269] 0709 13:10:25.378722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.381400 (+  2678us) service_pool.cc:224] Handling call
0709 13:10:27.239458 (+1858058us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002891d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:27.239807 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513570176}
I20260709 13:10:27.234787 31428 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.311309 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:27.312698 27408 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:27.311453 27410 rpcz_store.cc:276] 0709 13:10:25.628724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.764939 (+136215us) service_pool.cc:224] Handling call
0709 13:10:25.765204 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:25.993616 (+228412us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:26.014757 (+ 21141us) log.cc:844] Serialized 14 byte log entry
0709 13:10:26.198138 (+183381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:26.198194 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:26.198243 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.295528 (+1097285us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540013c4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:27.295606 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.295821 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18638,"prepare.queue_time_us":21486,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3601,"raft.queue_time_us":20627,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":10303,"spinlock_wait_cycles":524531584,"thread_start_us":164312,"threads_started":1,"wal-append.queue_time_us":263314}
I20260709 13:10:27.316028 27410 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:27.316525 27410 pending_rounds.cc:85] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 6
I20260709 13:10:27.316854 27410 pending_rounds.cc:107] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:27.317206 27410 raft_consensus.cc:2889] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:27.322574 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.324656 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.327199 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.282356 31496 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:27.186261 31444 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.318749 31161 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:27.338218 31343 consensus_meta.cc:287] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.001s
I20260709 13:10:27.300220 31431 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:27.339954 31585 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:27.198676 31499 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:27.341167 31569 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.433s	user 0.004s	sys 0.000s
I20260709 13:10:27.343760 31443 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.347092 31561 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.346743 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:27.348675 31475 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.004s
I20260709 13:10:27.349004 31554 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:27.352370 31340 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.003s
I20260709 13:10:27.320779 31428 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.208892 31211 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:27.392601 28010 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
W20260709 13:10:27.239289 31530 consensus_meta.cc:287] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:10:27.382412 31510 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:27.382819 31147 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.393714 31524 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.414179 31534 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:27.393266 31496 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.417550 28009 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:27.275206 31531 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.404022 31431 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.405716 31517 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.396632 31161 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.396377 31343 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:27.448984 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.450385 28006 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:27.418987 31554 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:27.425079 31534 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:27.411827 31475 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:26.941988 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.466989 27260 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.456885 31561 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.420491 31524 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.421729 31147 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.427037 31510 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.479712 31603 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.489408 31603 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.420338 31530 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.482672 31554 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.492626 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1687) took 1242 ms. Trace:
I20260709 13:10:27.493391 31530 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.494288 27266 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:27.490806 31510 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.486795 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.488377 28012 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:27.478157 27160 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.509792 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.480882 27408 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:27.484951 28014 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:27.496582 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.517835 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.493098 27414 rpcz_store.cc:276] 0709 13:10:26.250472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.426940 (+176468us) service_pool.cc:224] Handling call
0709 13:10:26.435034 (+  8094us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.459988 (+ 24954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:26.460031 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:26.460677 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:10:26.710975 (+250298us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:26.711017 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:26.711100 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.286298 (+575198us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:27.471510 (+185212us) raft_consensus.cc:1685] finished
0709 13:10:27.471540 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.492558 (+ 21018us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38888,"raft.queue_time_us":18386,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":23003,"spinlock_wait_cycles":2874752,"thread_start_us":145612,"threads_started":1,"wal-append.queue_time_us":331746}
I20260709 13:10:27.511843 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.498939 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.510736 27267 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.514289 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.513090 27268 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:27.509917 28013 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:27.483187 31161 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.523590 27262 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:27.482929 31531 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.497449 31253 raft_consensus.cc:2764] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:10:27.484661 31475 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.526618 31517 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.532199 31430 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:27.533304 31519 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:27.564152 31519 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.564831 31549 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.566380 31519 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:27.535841 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 224603us
I20260709 13:10:27.526672 31522 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:27.526983 31510 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:27.567224 31549 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.529572 31584 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:10:27.567643 31522 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:27.568109 31549 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.533337 31499 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.568580 31522 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.569619 31517 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.570197 31343 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.520427 31529 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:27.568640 31549 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.571484 31529 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:27.571754 31517 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.571877 31529 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:27.559063 31451 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:10:27.572578 31544 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.572805 31549 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.567302 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.574620 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.533531 31147 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:27.576025 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.560935 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.497895 31561 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.580577 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:27.484699 31432 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.597137 28012 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:27.599210 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.599896 27415 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:27.600868 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.608137 28011 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:27.602214 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:27.608882 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.482295 31534 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:27.611407 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:27.613605 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.535704 31524 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.615450 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.619053 27414 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:27.597442 31589 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:27.600150 31517 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:27.616225 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:27.616643 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.621047 27410 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:27.593477 31601 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:27.628389 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.624751 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.629923 31219 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:27.630420 31219 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.630970 31496 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.631907 31340 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:27.637462 31131 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:27.638139 31131 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.630874 31219 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.612368 31428 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.650143 31432 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.607648 31602 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:27.602207 31147 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:27.614600 31549 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.572769 31529 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.614593 31603 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.564190 31161 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:10:27.628368 31517 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.712342 31561 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.670320 31549 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:27.715196 31549 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:27.715627 31529 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.719306 31517 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:27.725508 31131 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.726186 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2468) took 2342 ms. Trace:
I20260709 13:10:27.726766 27338 rpcz_store.cc:276] 0709 13:10:25.383865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:25.393698 (+  9833us) service_pool.cc:224] Handling call
0709 13:10:25.423407 (+ 29709us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:25.431102 (+  7695us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:25.431135 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:27.460520 (+2029385us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b2c0000e678. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:10:27.465853 (+  5333us) log.cc:844] Serialized 52 byte log entry
0709 13:10:27.616431 (+150578us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:27.616475 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.616719 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:27.725781 (+109062us) raft_consensus.cc:1685] finished
0709 13:10:27.725810 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:27.726105 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":974,"raft.queue_time_us":247905,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":16769,"spinlock_wait_cycles":7057792,"thread_start_us":143514,"threads_started":1,"wal-append.queue_time_us":200798}
I20260709 13:10:27.668176 31147 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:27.782214 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 244078us
I20260709 13:10:27.783833 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:27.851508 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 226843us
W20260709 13:10:27.851281 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 225804us
I20260709 13:10:27.778622 31219 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.852517 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:27.852895 27980 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.855007 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.857188 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.858024 27264 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:27.858845 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.861811 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.863078 27262 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:27.868347 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.871073 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.873740 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.874567 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.874991 27264 raft_consensus.cc:2410] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:27.877504 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.878422 27259 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:27.864370 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:27.884039 31603 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:27.888028 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.890112 27267 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:27.896775 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.902932 27267 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:27.904287 31527 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 2.232s	user 0.012s	sys 0.002s
I20260709 13:10:27.904467 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1684) took 1654 ms. Trace:
I20260709 13:10:27.915575 31091 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:27.884696 31607 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:10:27.917522 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.919512 27411 rpcz_store.cc:276] 0709 13:10:26.249597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.252460 (+  2863us) service_pool.cc:224] Handling call
0709 13:10:26.270929 (+ 18469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:26.719605 (+448676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.904169 (+1184564us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400087354. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:27.904396 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015348480}
I20260709 13:10:27.887392 31603 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.916334 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2473) took 1019 ms. Trace:
I20260709 13:10:27.893514 31475 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.924978 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.929392 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.866428 31131 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:27.930208 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.952521 27261 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.952878 27267 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:27.932083 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.954064 27263 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.932821 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.955778 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.933961 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.957074 27264 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:27.934190 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.957666 27259 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:27.958778 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.936370 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.927883 27260 rpcz_store.cc:276] 0709 13:10:26.896582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.939464 (+ 42882us) service_pool.cc:224] Handling call
0709 13:10:26.939764 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.467909 (+528145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.916043 (+448134us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540031f6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:27.916264 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212031872}
I20260709 13:10:27.928607 31603 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:27.960199 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:27.938845 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.941665 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.943564 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:27.923632 31091 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.951560 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:27.965194 27336 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:27.967268 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:27.967506 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:27.965255 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:27.966936 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:27.968398 27341 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.968160 27339 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:27.967568 28010 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:27.969722 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:27.970372 27342 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:27.971715 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.972986 27260 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:27.973397 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:27.973008 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.976619 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:27.977309 27265 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:27.968146 27343 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:27.981096 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:27.946537 31607 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:27.987506 27340 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:27.994863 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:27.995783 27337 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:27.996062 28010 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:27.972829 31432 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:27.997356 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:27.973755 31543 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:28.008112 27263 raft_consensus.cc:2410] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:10:27.943966 31475 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:27.985800 27261 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:27.973696 31439 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:27.987988 31404 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.016036 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:27.976029 31091 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.021179 27341 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:28.025521 27265 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:28.026769 27268 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:28.027730 31499 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:28.009131 31529 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.008872 31432 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:28.031970 31596 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.508s	user 0.003s	sys 0.000s
I20260709 13:10:28.046118 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2127) took 1218 ms. Trace:
I20260709 13:10:28.107219 27409 rpcz_store.cc:276] 0709 13:10:26.827597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.307151 (+479554us) service_pool.cc:224] Handling call
0709 13:10:27.307912 (+   761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:27.308190 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:27.462651 (+154461us) log.cc:844] Serialized 14 byte log entry
0709 13:10:27.623406 (+160755us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.045390 (+421984us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800255460. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:10:28.045611 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.045684 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.045757 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.045855 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.046037 (+   182us) inbound_call.cc:177] Queueing success response
0709 13:10:28.055568 (+  9531us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b480012c258. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd87b5aaa1 00007fbd87b51b37 00007fbd87b519ca 00007fbd87c4926f 00007fbd87c48f37 00007fbd87c5d55c 00007fbd87c5d508 00007fbd87c5d488 00007fbd87c5d443 00007fbd87c5c6ec 00007fbd86b86a96
Metrics: {"mutex_wait_us":1392,"prepare.queue_time_us":161619,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":24983,"raft.queue_time_us":424279,"raft.run_cpu_time_us":3185,"raft.run_wall_time_us":428235,"spinlock_wait_cycles":25933056,"thread_start_us":307507,"threads_started":2,"wal-append.queue_time_us":253220}
I20260709 13:10:28.049235 31161 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:28.051865 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.966s (SENT) [suppressed 21 similar messages]
I20260709 13:10:28.053400 31523 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.054025 31609 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.054807 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:28.055753 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.059269 31518 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.060671 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.062496 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.123515 27408 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
W20260709 13:10:28.063222 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 279472us
I20260709 13:10:28.063843 31131 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:28.065061 27416 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:10:28.065294 31219 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.014850 31556 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:28.067152 27412 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:28.067026 31524 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.068724 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.069581 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.070380 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2477) took 1112 ms. Trace:
I20260709 13:10:28.134614 27266 rpcz_store.cc:276] 0709 13:10:26.958288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:26.958440 (+   152us) service_pool.cc:224] Handling call
0709 13:10:28.070120 (+1111680us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400319cd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:28.070300 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137279232}
I20260709 13:10:27.993721 31477 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:28.081972 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 499789us
I20260709 13:10:28.083550 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.138671 27341 raft_consensus.cc:2368] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10.
I20260709 13:10:28.109886 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:28.012527 31147 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.112638 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.116295 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.128300 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.141160 27409 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:28.016876 31543 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.131011 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.015827 31517 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.125026 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.119295 31431 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:28.122814 31523 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.151322 31431 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:28.112953 31161 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:28.151834 31522 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.152251 31561 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.152420 31522 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.152863 31561 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.153554 31523 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:28.153834 31147 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:28.154332 31147 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.154721 31147 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.143982 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.157994 31561 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.081130 31439 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.082748 31404 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.150681 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.106371 31529 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.146927 27338 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:28.129585 31131 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.164990 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.174306 31131 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:28.174803 31554 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:28.175318 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.169464 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.175978 31451 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:28.176903 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:28.177628 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.177574 27408 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:28.179354 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.171759 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.173545 31543 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.175402 31554 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:28.152755 31161 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.184535 31161 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.184792 31554 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.180442 27341 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:28.187250 31443 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.171177 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.187723 31443 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.188055 27338 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:28.143102 31477 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:28.188985 31477 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.183598 27339 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.188125 31443 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.162994 31549 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.198491 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.129797 31518 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.207847 31549 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.208359 31549 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.208673 31404 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.194792 31594 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.209692 31518 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.209642 31594 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.211769 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:28.211704 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.212535 27261 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:28.212980 27338 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.213987 27409 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
I20260709 13:10:28.181974 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:28.214460 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:28.215412 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:28.216810 31602 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:28.180418 31523 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:28.143898 31524 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.126782 31609 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.205731 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.334141 27334 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.206045 27341 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:28.206259 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:28.205735 27336 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:10:28.206910 31475 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:28.217365 31602 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:28.220930 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:28.221580 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:28.342612 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 136435us
W20260709 13:10:28.343457 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 122632us
I20260709 13:10:28.343600 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:28.202503 27339 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:28.217787 31523 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.206467 31439 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.212208 31594 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.352797 27342 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:28.348009 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.352682 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.358609 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.360136 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.361445 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.222560 31614 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:28.334599 31451 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:28.367748 27338 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:28.334959 31510 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.347913 31428 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.351154 31129 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:28.352967 31523 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.351707 31522 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.351992 31556 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:28.334157 31519 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:28.364305 31543 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:28.392714 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.392795 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:28.414393 27411 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:28.159754 31607 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.374770 31614 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.380769 31439 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:28.422968 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.435122 27411 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.429309 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.441603 27409 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:28.422717 31404 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.417191 31556 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:28.426971 31614 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:28.351290 31431 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:28.472114 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 420246us
I20260709 13:10:28.420342 31451 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:10:28.388607 31510 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.391579 31428 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.521975 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:28.484786 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.476445 27411 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:28.535557 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:28.578737 27411 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:28.435427 31129 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:28.583945 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 62037.7us
I20260709 13:10:28.595116 27334 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:28.598879 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 63742.9us
I20260709 13:10:28.468451 31522 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.468502 31556 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.468147 31432 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.552148 31518 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:28.480235 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:28.592514 31129 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:28.612054 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:28.540956 31519 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:28.638389 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.445012 31439 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.473876 31404 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.612790 31529 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.617388 31619 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.596973 31253 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:10:28.553084 31091 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.467573 31602 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:28.658411 31616 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.310s	user 0.001s	sys 0.001s
W20260709 13:10:28.688232 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 259394us
I20260709 13:10:28.657737 31524 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.614711 31561 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:10:28.696909 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:28.688824 31554 raft_consensus.cc:2764] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:28.624820 31522 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.679123 31529 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:28.649849 31519 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.728747 27342 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:28.713884 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:28.689066 31543 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:28.708325 31147 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
W20260709 13:10:28.713672 31595 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.189s	user 0.008s	sys 0.006s
W20260709 13:10:28.756084 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 411654us
I20260709 13:10:28.678728 31619 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.631958 27160 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.702596 31444 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:28.765089 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.759892 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.741315 31529 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:28.772711 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:28.787923 27412 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:28.790958 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.793285 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:28.794910 27412 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:28.796038 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:28.799878 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:28.800601 27261 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:28.702430 31129 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:28.807260 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 171979us
I20260709 13:10:28.753907 31147 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.789446 31428 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.812618 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.813773 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.816619 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:28.817399 28013 raft_consensus.cc:2368] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13.
I20260709 13:10:28.816751 27412 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
W20260709 13:10:28.802618 31477 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.004s
I20260709 13:10:28.826323 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:28.825870 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 433125us
I20260709 13:10:28.814570 28014 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:28.826437 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:28.806046 31617 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:10:28.884606 31496 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:28.884840 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:28.885298 31496 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:28.886291 31496 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.834208 27268 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:28.810966 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 210170us
W20260709 13:10:28.821825 31621 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:10:28.846319 27408 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:28.847761 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:28.845232 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:28.892977 27263 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:28.892776 31529 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.893219 27265 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:28.805573 31510 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.854135 28012 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:28.860095 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.895357 31556 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.895829 31510 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:28.896122 31519 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.896550 27342 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:28.897183 31404 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:28.899518 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:28.900774 31519 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:28.901186 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.901297 31519 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.901949 31519 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:28.904649 31556 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.906702 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.907406 28012 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:28.907712 31439 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.910141 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:28.911288 27265 raft_consensus.cc:2393] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:28.911504 31517 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.911114 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.912079 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:28.912842 27263 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:28.864075 31091 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:28.864950 31161 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.001s
I20260709 13:10:28.864967 31645 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:28.922343 31645 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:28.922892 31645 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:28.924034 31645 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.925786 31645 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:28.867583 31561 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:28.927529 31561 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.930475 31561 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:28.938395 31523 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:10:28.938901 31523 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.868865 27231 leader_election.cc:400] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13.
I20260709 13:10:28.940881 27231 leader_election.cc:403] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:10:28.918715 31613 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.755s	user 0.000s	sys 0.006s
I20260709 13:10:28.948338 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:28.870057 31549 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.002s
I20260709 13:10:28.871423 31619 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:28.872212 31630 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:10:28.872985 31627 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:10:28.873617 31623 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:28.875878 31620 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:28.836882 31477 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:28.826759 31543 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:28.883566 31631 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.888162 31641 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:28.889226 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:28.875815 31147 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:28.891570 31603 consensus_meta.cc:287] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.000s
W20260709 13:10:28.827371 31618 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:10:29.011523 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:28.811060 31609 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.896422 31510 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:28.863466 31629 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:10:28.918007 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:28.918427 31443 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.712s	user 0.011s	sys 0.000s
W20260709 13:10:28.919232 31131 consensus_meta.cc:287] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.000s
I20260709 13:10:28.873029 31522 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:28.867053 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:29.029368 27412 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:28.941735 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 73086.9us
I20260709 13:10:29.030611 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:28.942754 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:28.950727 27263 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:10:28.992372 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:28.986179 31161 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:29.009238 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:29.015208 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:28.979002 31614 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:29.020617 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 131512us
I20260709 13:10:29.042018 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:29.021190 28012 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:28.988010 31549 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.025681 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:29.026808 28010 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:29.027809 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:29.054316 27259 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.036620 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 657) took 1437 ms. Trace:
I20260709 13:10:29.055486 28011 rpcz_store.cc:276] 0709 13:10:27.598700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.626879 (+ 28179us) service_pool.cc:224] Handling call
0709 13:10:27.636108 (+  9229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.636535 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.636569 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.637131 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:10:27.926391 (+289260us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:27.926451 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:27.926548 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:28.917961 (+991413us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:29.028534 (+110573us) raft_consensus.cc:1685] finished
0709 13:10:29.028556 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.036549 (+  7993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25159,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1370,"spinlock_wait_cycles":63804800,"thread_start_us":288802,"threads_started":1,"wal-append.queue_time_us":483860}
W20260709 13:10:29.062155 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.669s (SENT)
I20260709 13:10:29.062861 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:29.039283 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:29.020450 31510 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:29.086133 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:29.086823 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44908.3us
I20260709 13:10:29.091490 31477 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:29.094199 31524 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.086755 31641 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:29.089083 28015 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:29.090049 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:29.094898 31641 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.030428 31639 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:29.035313 31520 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.035190 31161 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.045529 31522 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.105836 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1585) took 1168 ms. Trace:
I20260709 13:10:29.006759 31631 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.016750 31603 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:29.112413 31643 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:10:29.114225 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1712) took 1057 ms. Trace:
I20260709 13:10:29.031752 31131 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.108593 27412 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:29.028633 31443 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.101995 31641 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.126468 27409 rpcz_store.cc:276] 0709 13:10:28.056356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.466458 (+410102us) service_pool.cc:224] Handling call
0709 13:10:28.520711 (+ 54253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.556210 (+ 35499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.556259 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.556318 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:28.556365 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.113887 (+557522us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54000e9a54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:29.113961 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.114142 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80946560}
I20260709 13:10:29.036881 31561 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13.
I20260709 13:10:29.101392 31451 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:29.095861 31648 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:29.135771 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 103257us
W20260709 13:10:29.136034 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.118916 27262 rpcz_store.cc:276] 0709 13:10:27.937428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.982897 (+ 45469us) service_pool.cc:224] Handling call
0709 13:10:27.983243 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.983573 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.983599 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.996479 (+ 12880us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.218975 (+222496us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.219018 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.219091 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.105539 (+886448us) raft_consensus.cc:1685] finished
0709 13:10:29.105567 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.105762 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":429,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10476,"thread_start_us":192458,"threads_started":1,"wal-append.queue_time_us":491607}
W20260709 13:10:29.144946 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54976.7us
I20260709 13:10:29.200328 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:29.146396 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.117831 31161 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.131855 28011 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:29.118656 31522 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.156095 28013 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:10:29.117990 31520 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:29.165756 27417 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:29.173836 31641 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:29.118273 31523 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:29.176112 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.177251 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:29.232756 27268 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.188822 27410 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:29.201473 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.234805 27409 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:29.239568 27262 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:29.201072 31218 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.257696 31549 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:29.264513 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64272.2us
I20260709 13:10:29.265002 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.210860 27412 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:29.152931 31439 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.232080 31522 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.201758 31451 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:29.267933 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.186995 31519 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.266841 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:29.282505 31549 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:29.283185 31131 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:29.283347 31650 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:10:29.284049 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:29.285336 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2165) took 1293 ms. Trace:
I20260709 13:10:29.285703 27343 rpcz_store.cc:276] 0709 13:10:27.991985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.992565 (+   580us) service_pool.cc:224] Handling call
0709 13:10:27.992911 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.333741 (+340830us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:28.673701 (+339960us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.980266 (+306565us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.983899 (+  3633us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.984084 (+   185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:28.984372 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.987459 (+  3087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.987540 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.285147 (+297607us) raft_consensus.cc:1685] finished
0709 13:10:29.285165 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.285281 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34601,"prepare.queue_time_us":449635,"prepare.run_cpu_time_us":147,"prepare.run_wall_time_us":4937,"raft.queue_time_us":111992,"raft.run_cpu_time_us":483,"raft.run_wall_time_us":12617,"thread_start_us":866679,"threads_started":3,"wal-append.queue_time_us":325070}
W20260709 13:10:29.270790 31657 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:29.272761 31439 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.289563 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:29.263489 31603 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:29.299521 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:29.274096 31543 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:29.306201 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:29.285863 31549 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:29.309477 27268 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:29.310263 27412 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.318264 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:29.320322 31161 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:29.321545 28011 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:29.327143 31161 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:29.328495 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:29.299795 31439 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.335930 28011 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:29.309361 31543 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:29.350389 31660 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:29.352336 31614 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:29.305145 31651 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.271798 31218 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:29.353878 27412 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:29.296729 31131 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 13:10:29.368232 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 104285us
I20260709 13:10:29.380307 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.311851 31652 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:29.399709 27412 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:29.404192 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:29.404572 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:29.375288 31543 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:29.406934 28011 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:29.406404 27412 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:10:29.383538 31631 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:29.385567 31651 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:29.411248 27412 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:29.404301 31652 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:29.412667 31648 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:29.420921 31670 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:29.383256 31451 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:29.490761 31641 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:29.493518 31664 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:10:29.422927 31520 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:29.440342 31218 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:29.494762 31648 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:29.497673 31519 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:29.591382 31652 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.595429 31651 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:29.569540 31131 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:29.638196 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:29.644770 31131 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:29.655791 31676 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:10:29.683051 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.634117 31670 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:29.754472 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1725) took 1537 ms. Trace:
I20260709 13:10:29.755113 27411 rpcz_store.cc:276] 0709 13:10:28.216800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.581067 (+364267us) service_pool.cc:224] Handling call
0709 13:10:28.581435 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.581846 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.581882 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.602508 (+ 20626us) log.cc:844] Serialized 26 byte log entry
0709 13:10:29.088346 (+485838us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b1800427360. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:29.291278 (+202932us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:29.291325 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:29.291396 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:29.670169 (+378773us) raft_consensus.cc:1685] finished
0709 13:10:29.670200 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:29.754359 (+ 84159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33672,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":3357,"spinlock_wait_cycles":6216576,"thread_start_us":202735,"threads_started":1,"wal-append.queue_time_us":690851}
W20260709 13:10:30.058229 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:29.749925 31510 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:10:29.747406 31131 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:29.797564 31674 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.236007 31147 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:30.268075 31644 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:30.120649 31549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.021s
I20260709 13:10:30.170110 31510 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:30.463845 31147 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:30.293308 31674 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:30.256500 31648 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:30.721866 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.558s (SENT)
I20260709 13:10:30.728585 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:30.730042 27380 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.648s (SENT)
I20260709 13:10:30.730530 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:30.731848 27409 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:30.478713 31644 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:30.906781 27412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.415s	user 0.046s	sys 0.076s
W20260709 13:10:30.907266 27383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.030s	sys 0.061s
W20260709 13:10:30.907495 27412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.046s	sys 0.076s
W20260709 13:10:30.907804 27383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.031s	sys 0.061s
W20260709 13:10:30.909597 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.859190 31651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.081s	sys 0.153s
I20260709 13:10:30.758518 31519 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.038403 31651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.082s	sys 0.153s
W20260709 13:10:31.135391 31652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.008s	sys 0.015s
I20260709 13:10:31.124076 31682 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:31.168494 31678 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.416s	user 0.000s	sys 0.000s
W20260709 13:10:31.147701 31652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.008s	sys 0.016s
I20260709 13:10:31.123473 31519 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.170511 31682 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.169762 31681 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.173553 31147 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.193883 31147 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.180819 31682 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.202435 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2149) took 2409 ms. Trace:
W20260709 13:10:31.202986 27411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.009s	sys 0.016s
W20260709 13:10:31.203445 27411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.009s	sys 0.016s
I20260709 13:10:31.195274 31510 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.202916 27416 rpcz_store.cc:276] 0709 13:10:28.793135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.201495 (+2408360us) service_pool.cc:224] Handling call
0709 13:10:31.201866 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.202047 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.202088 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.202140 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:31.202194 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.202257 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.202379 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:31.215354 27382 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.036s	sys 0.086s
I20260709 13:10:31.199935 31644 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.191247 31681 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.229307 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2150) took 2435 ms. Trace:
I20260709 13:10:31.203341 31147 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.230160 27416 rpcz_store.cc:276] 0709 13:10:28.793399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.213925 (+2420526us) service_pool.cc:224] Handling call
0709 13:10:31.228756 (+ 14831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.228956 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.228981 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.229019 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:31.229050 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.229099 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.229229 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:31.232599 27416 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:10:31.233167 27416 pending_rounds.cc:85] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 4
I20260709 13:10:31.233558 27416 pending_rounds.cc:107] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:10:31.233868 27416 raft_consensus.cc:2889] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:31.216321 27382 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.036s	sys 0.086s
I20260709 13:10:31.212577 31674 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.241727 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2151) took 2448 ms. Trace:
I20260709 13:10:31.243747 27416 rpcz_store.cc:276] 0709 13:10:28.793639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.231315 (+2437676us) service_pool.cc:224] Handling call
0709 13:10:31.231648 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.241457 (+  9809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.241659 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:31.244910 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.246366 31554 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.246950 31554 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:31.248672 31679 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:10:31.252904 31439 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.883s	user 0.014s	sys 0.000s
I20260709 13:10:31.250469 31682 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.259974 31439 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:31.251600 31549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.003s	sys 0.012s
W20260709 13:10:31.257499 31680 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:10:31.267805 31549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.003s	sys 0.012s
W20260709 13:10:31.272425 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.036s	sys 0.036s
W20260709 13:10:31.272917 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.036s	sys 0.036s
I20260709 13:10:31.272488 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2143) took 2488 ms. Trace:
W20260709 13:10:31.274263 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 544235us
W20260709 13:10:31.270321 31683 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:10:31.277089 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.680s (SENT)
I20260709 13:10:31.278256 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.275411 27412 rpcz_store.cc:276] 0709 13:10:28.784176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.421084 (+636908us) service_pool.cc:224] Handling call
0709 13:10:29.421355 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.421535 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:29.491343 (+ 69808us) log.cc:844] Serialized 14 byte log entry
0709 13:10:31.271732 (+1780389us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.271815 (+    83us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:31.271877 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.271971 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.272411 (+   440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":69153,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":306612,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":24916,"thread_start_us":1778239,"threads_started":2,"wal-append.queue_time_us":1632852}
I20260709 13:10:31.267494 31682 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:31.280998 27380 leader_election.cc:336] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.557s (SENT)
I20260709 13:10:31.282423 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.282238 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:31.281844 31684 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:31.285259 31554 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.288491 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:31.289412 27380 leader_election.cc:336] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.575s (SENT)
I20260709 13:10:31.289940 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.290524 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:31.291752 27380 leader_election.cc:336] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.636s (SENT)
I20260709 13:10:31.291941 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:31.292181 31687 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.293166 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.293848 27412 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:31.295984 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1730) took 2437 ms. Trace:
I20260709 13:10:31.297660 27412 rpcz_store.cc:276] 0709 13:10:28.858990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.294991 (+2436001us) service_pool.cc:224] Handling call
0709 13:10:31.295367 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.295586 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.295624 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:31.295679 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:31.295731 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.295798 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.295918 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:31.300776 27412 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:31.302472 31543 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.889s	user 0.011s	sys 0.000s
I20260709 13:10:31.289484 31684 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.302934 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1731) took 2440 ms. Trace:
I20260709 13:10:31.303949 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2144) took 2515 ms. Trace:
I20260709 13:10:31.304502 31594 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:31.305223 31522 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 2.018s	user 0.012s	sys 0.004s
I20260709 13:10:31.305313 27412 rpcz_store.cc:276] 0709 13:10:28.862524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.300077 (+2437553us) service_pool.cc:224] Handling call
0709 13:10:31.300364 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.302652 (+  2288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.302885 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:31.305747 31522 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.304556 27411 rpcz_store.cc:276] 0709 13:10:28.788662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.839942 (+1051280us) service_pool.cc:224] Handling call
0709 13:10:29.840459 (+   517us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:30.068307 (+227848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.068353 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:30.402543 (+334190us) log.cc:844] Serialized 52 byte log entry
0709 13:10:31.204044 (+801501us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:31.204083 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.204156 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.303761 (+ 99605us) raft_consensus.cc:1685] finished
0709 13:10:31.303780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.303898 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":227421,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":25107,"thread_start_us":544743,"threads_started":1,"wal-append.queue_time_us":764169}
W20260709 13:10:31.312567 27380 leader_election.cc:336] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.644s (SENT)
I20260709 13:10:31.313187 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:31.314497 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.705s (SENT)
I20260709 13:10:31.316987 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 524) took 2499 ms. Trace:
I20260709 13:10:31.317559 31681 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.314976 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.318225 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2499) took 2473 ms. Trace:
I20260709 13:10:31.316561 31682 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.319535 31522 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.318624 27260 rpcz_store.cc:276] 0709 13:10:28.845434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.845622 (+   188us) service_pool.cc:224] Handling call
0709 13:10:28.846048 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:28.850134 (+  4086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.850175 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:28.863102 (+ 12927us) log.cc:844] Serialized 26 byte log entry
0709 13:10:31.300227 (+2437125us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18003cd180. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:31.317854 (+ 17627us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:31.317892 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.317955 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.317994 (+    39us) raft_consensus.cc:1685] finished
0709 13:10:31.318005 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.318175 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3583,"raft.queue_time_us":6366,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":6234880,"thread_start_us":17462,"threads_started":1,"wal-append.queue_time_us":2452847}
W20260709 13:10:31.320616 27380 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.707s (SENT)
I20260709 13:10:31.320936 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.322162 31684 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:31.322585 31439 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.317543 28010 rpcz_store.cc:276] 0709 13:10:28.813419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.813584 (+   165us) service_pool.cc:224] Handling call
0709 13:10:28.813887 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:29.054286 (+240399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.312463 (+2258177us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54004d3d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:31.312699 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489129728}
I20260709 13:10:31.333985 31554 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:31.333824 31543 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.335446 31691 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:31.335995 31691 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.336994 31543 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.311004 27411 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:31.338049 31691 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.322858 31594 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:31.322857 31684 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:31.339543 31594 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:31.342809 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52479.2us
I20260709 13:10:31.345335 31594 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.345829 31594 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.345871 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.346410 31594 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.360538 31594 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.366712 31594 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.367265 31594 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.369455 31594 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.348304 31691 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.374142 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.375324 28010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:31.375512 27412 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 6.
I20260709 13:10:31.375968 28010 raft_consensus.cc:606] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:31.376529 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.373850 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.377182 27412 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:31.377383 27411 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:31.379403 31692 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:31.374657 31691 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.382254 31691 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.372243 31594 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.384826 31594 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.386899 31253 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:31.387351 31253 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:31.388275 31253 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.389348 31253 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.398778 31594 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.400215 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:31.402465 27411 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:31.403600 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:31.404340 27417 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1713) took 3347 ms (client timeout 2619 ms). Trace:
W20260709 13:10:31.404805 27417 rpcz_store.cc:269] 0709 13:10:28.056615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.373837 (+317222us) service_pool.cc:224] Handling call
0709 13:10:31.404082 (+3030245us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54003c2b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:31.404225 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707940736}
I20260709 13:10:31.405665 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:31.406916 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:31.408047 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:31.410168 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:31.409315 31091 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:10:31.411641 27978 connection.cc:256] RPC call timeout handler was delayed by -2.168446882000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 13:10:31.411839 31091 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:31.412256 27978 connection.cc:256] RPC call timeout handler was delayed by -1.4441667660000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:10:31.412473 31091 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.414075 31695 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:31.416741 31692 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:31.417186 31692 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.417585 31692 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:31.423301 31691 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:31.423810 31691 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:31.424193 31691 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:31.425997 31091 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.426541 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.427475 27260 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:31.431699 31561 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:31.432304 31561 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:31.433399 27231 connection.cc:256] RPC call timeout handler was delayed by -2.0693879440000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2445s for a response
W20260709 13:10:31.433981 27231 connection.cc:256] RPC call timeout handler was delayed by -1.9432639709999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:10:31.434026 31522 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.434432 27231 connection.cc:256] RPC call timeout handler was delayed by -1.92796397099994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:10:31.434600 31444 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:31.434638 31522 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.435272 31444 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.436534 31691 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.438581 31691 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.440092 27260 raft_consensus.cc:2410] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:31.442526 31444 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.443264 31444 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.443457 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.443614 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.445489 27266 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.446638 31692 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.434453 31561 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.450963 31692 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.443929 31444 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.441903 31091 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.458165 27266 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:31.545502 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.546644 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.547354 27266 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:31.548082 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.548620 27266 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:31.549377 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.550462 27266 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:31.458622 27260 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:31.459657 27231 connection.cc:256] RPC call timeout handler was delayed by -1.8577639709999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
I20260709 13:10:31.551411 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:31.552294 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.552493 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:31.553056 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2579775279999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:10:31.553433 27231 connection.cc:256] RPC call timeout handler was delayed by -1.2412639709999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2909s for a response
W20260709 13:10:31.553887 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1148775279999654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:10:31.484282 27409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 2137) took 2717 ms (client timeout 2344 ms). Trace:
W20260709 13:10:31.554466 27409 rpcz_store.cc:269] 0709 13:10:28.767108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.235771 (+468663us) service_pool.cc:224] Handling call
0709 13:10:31.484048 (+2248277us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000ad054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:31.484196 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371442048}
W20260709 13:10:31.476595 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2475) took 2139 ms (client timeout 1558 ms). Trace:
I20260709 13:10:31.484506 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:31.555389 27343 rpcz_store.cc:269] 0709 13:10:29.338810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.476346 (+2137536us) service_pool.cc:211] Skipping call since client already timed out
0709 13:10:31.476518 (+   172us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:10:31.556475 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.556571 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.557096 27338 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:31.557246 27343 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.557529 31443 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:31.558100 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.486498 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2166) took 3486 ms. Trace:
I20260709 13:10:31.485379 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.488858 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.560843 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.561774 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.562001 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.562445 27264 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.527712 31690 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.563735 31690 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:31.529858 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.565632 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.566047 31690 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.529755 31700 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:31.567282 31700 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.569836 31700 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.562647 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:31.559975 27340 rpcz_store.cc:276] 0709 13:10:28.000400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.003442 (+  3042us) service_pool.cc:224] Handling call
0709 13:10:28.018078 (+ 14636us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:28.073962 (+ 55884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.073997 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:28.074620 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 13:10:28.426615 (+351995us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:28.426659 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.426784 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.378911 (+2952127us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b24002aa3e8. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7f9ca9c4 00007fbd7f9c8acb 00007fbd7fb83dc9 00007fbd7fb83a55 00007fbd7fb82fb0 00007fbd827f9488 00007fbd827f9be8 00007fbd827d1398 00007fbd827cc76a 00007fbd827cbbb6
0709 13:10:31.486164 (+107253us) raft_consensus.cc:1685] finished
0709 13:10:31.486190 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.486437 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55419,"raft.queue_time_us":55577,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":7217536,"thread_start_us":346565,"threads_started":1,"wal-append.queue_time_us":553175}
I20260709 13:10:31.571357 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:31.571633 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.560624 28012 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:31.572171 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.574695 31690 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.577863 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1721) took 3519 ms. Trace:
I20260709 13:10:31.579504 31626 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.580106 31626 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.578399 27410 rpcz_store.cc:276] 0709 13:10:28.058899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.599653 (+540754us) service_pool.cc:224] Handling call
0709 13:10:28.600090 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.233823 (+633733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:31.577554 (+2343731us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54000adf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:31.577793 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353228032}
I20260709 13:10:31.572223 27336 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:31.572047 28010 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:31.582271 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.582717 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.559460 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.583593 27338 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:31.543720 31444 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.585187 31444 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.585723 31444 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.578162 31690 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.589959 31690 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.590497 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.592236 31129 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:31.589987 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.597154 31626 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.583627 27336 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:31.597455 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.598634 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.599622 27340 raft_consensus.cc:2393] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:31.599784 27260 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:31.600973 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.601258 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2162) took 3635 ms. Trace:
I20260709 13:10:31.601502 31444 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.601637 27336 raft_consensus.cc:2376] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10. Re-sending same reply.
W20260709 13:10:31.538336 27259 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 2.483s	user 0.019s	sys 0.020s
I20260709 13:10:31.602710 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.603637 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.607451 27338 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:31.607671 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.608531 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.610145 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:31.604678 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.603996 27265 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:31.413826 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.605474 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:31.532773 27309 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52486 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 13:10:31.590590 31690 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:31.602824 27259 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:31.609938 27336 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:31.614105 27233 connection.cc:256] RPC call timeout handler was delayed by -2.4855074199998626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 13:10:31.636384 27233 connection.cc:256] RPC call timeout handler was delayed by -2.379273798999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2344s for a response
I20260709 13:10:31.636452 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:31.636736 27233 connection.cc:256] RPC call timeout handler was delayed by -2.375773231999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:10:31.637177 27233 connection.cc:256] RPC call timeout handler was delayed by -2.2572267249998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
I20260709 13:10:31.637307 27336 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:31.637542 27233 connection.cc:256] RPC call timeout handler was delayed by -2.2489262959999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:10:31.637914 27233 connection.cc:256] RPC call timeout handler was delayed by -2.1916912409999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:10:31.638242 27233 connection.cc:256] RPC call timeout handler was delayed by -1.3761199729999589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2909s for a response
W20260709 13:10:31.638554 27233 connection.cc:256] RPC call timeout handler was delayed by -1.182981396999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2457s for a response
I20260709 13:10:31.639046 31647 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.639631 31647 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.615362 28010 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:31.622727 31690 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.622460 27309 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:52486 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2504)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2484)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2183)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2186)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2482)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2497)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2524)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2523)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2181)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2182)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2185)
I20260709 13:10:31.612112 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.645071 31690 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:31.645578 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.645725 31690 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.646387 27340 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:31.646317 31690 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.553597 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:31.892652 27266 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:31.610968 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.622727 27260 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:31.664076 27380 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.204s (SENT)
I20260709 13:10:31.896137 27338 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:31.896332 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:31.612900 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.899843 27265 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:10:31.900938 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.902089 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.623836 27343 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:31.904537 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.906180 27343 raft_consensus.cc:2368] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11.
W20260709 13:10:31.614660 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 200919us
I20260709 13:10:31.913902 27978 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:31.601689 27335 rpcz_store.cc:276] 0709 13:10:27.965814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.965947 (+   133us) service_pool.cc:224] Handling call
0709 13:10:27.966330 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:27.966773 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:27.966812 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:27.981414 (+ 14602us) log.cc:844] Serialized 26 byte log entry
0709 13:10:28.356717 (+375303us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b18003f4d20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:28.665004 (+308287us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:28.837971 (+172967us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.853676 (+ 15705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.853804 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.392470 (+2538666us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b18003f4d20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:31.601034 (+208564us) raft_consensus.cc:1685] finished
0709 13:10:31.601056 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.601199 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21498,"prepare.queue_time_us":133662,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":64940,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":9347,"spinlock_wait_cycles":115106304,"thread_start_us":458059,"threads_started":2,"wal-append.queue_time_us":824890}
I20260709 13:10:31.617470 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:31.657580 27264 raft_consensus.cc:2410] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:31.640442 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:31.658788 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.622155 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:31.638425 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.932729 27336 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:31.957608 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:31.959936 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:31.888882 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 249418us
I20260709 13:10:31.967444 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:31.635802 27259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2505) took 2610 ms (client timeout 1534 ms). Trace:
W20260709 13:10:31.975152 27259 rpcz_store.cc:269] 0709 13:10:29.025089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.025305 (+   216us) service_pool.cc:224] Handling call
0709 13:10:31.635712 (+2610407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:31.917730 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.030388 27335 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.031888 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.046892 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:31.901998 27265 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:31.629212 31091 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:31.615584 31444 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:31.657137 31443 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:32.325642 31444 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.326092 31443 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:31.690219 31451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.005s	sys 0.002s
W20260709 13:10:32.331722 31451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.006s	sys 0.002s
I20260709 13:10:31.674897 31549 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.688575 31620 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:32.372648 31620 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:31.614270 31626 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.375952 31626 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.377707 27260 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:10:32.378050 27260 pending_rounds.cc:85] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 4
I20260709 13:10:32.378348 27260 pending_rounds.cc:107] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:10:32.378618 27260 raft_consensus.cc:2889] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:31.689401 31636 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:31.671633 31672 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 2.253s	user 0.006s	sys 0.004s
I20260709 13:10:31.658258 31690 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.380013 31636 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.381004 31690 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:31.658028 31706 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:31.660358 31705 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.395046 31636 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:31.934881 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.187868 31700 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.396400 31700 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.397966 31620 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.398617 27336 raft_consensus.cc:2376] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12. Re-sending same reply.
I20260709 13:10:31.898590 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.330833 31443 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:32.351999 31645 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:32.354153 31219 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:32.355217 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 441809us
W20260709 13:10:32.352295 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 688172us
I20260709 13:10:32.334446 31451 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.382875 27343 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.382135 31690 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.378880 31626 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.394176 31706 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:32.408416 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 441335us
I20260709 13:10:32.413512 27338 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:32.414295 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.413880 31645 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.414997 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.416328 27338 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.418136 31645 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:32.414103 27263 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:32.419826 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:32.420579 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 798294us
I20260709 13:10:32.422103 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:32.423882 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.464s (SENT)
I20260709 13:10:32.431978 31444 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.432374 31706 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:32.409150 31443 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.433212 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:32.433712 31443 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.436349 31443 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:32.436929 31626 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.437252 31091 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.437711 31626 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:32.451023 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.456488 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.456836 27306 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.006s
W20260709 13:10:32.457334 27306 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.002s	sys 0.006s
W20260709 13:10:32.457679 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 566292us
I20260709 13:10:32.457844 31710 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:32.458673 31710 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:32.459300 31711 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.464203 31451 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.467447 31549 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.471398 27335 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:10:32.477157 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54573.9us
W20260709 13:10:32.467459 27364 debug-util.cc:398] Leaking SignalData structure 0x7b080008d5c0 after lost signal to thread 26161
I20260709 13:10:32.471021 31549 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:32.483258 27380 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.966s (SENT)
I20260709 13:10:32.483634 31713 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:32.459312 31710 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:32.483151 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50111.3us
I20260709 13:10:32.486263 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.495544 31717 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:32.462013 31444 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.460331 31711 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.509179 31690 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:32.511674 27233 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:32.513226 31626 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.518168 27343 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:32.523437 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:32.524407 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.534658 31431 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.535750 31451 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:32.541116 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:32.545790 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 55456.9us
I20260709 13:10:32.545027 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:32.562631 27417 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.563222 31724 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:32.564739 31444 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.566045 27410 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:32.566754 27336 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.567148 31451 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.568003 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.566790 31711 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:32.555085 27266 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.007s
I20260709 13:10:32.570818 31626 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:32.571460 27409 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:32.579118 27266 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:32.581231 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1601) took 1072 ms. Trace:
I20260709 13:10:32.581571 31444 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.581661 27266 rpcz_store.cc:276] 0709 13:10:31.509014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.553386 (+ 44372us) service_pool.cc:224] Handling call
0709 13:10:32.581136 (+1027750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.582429 27341 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:32.583076 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2480) took 1099 ms. Trace:
I20260709 13:10:32.579032 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2485) took 1092 ms. Trace:
W20260709 13:10:32.583410 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71940.5us
I20260709 13:10:32.583482 27341 rpcz_store.cc:276] 0709 13:10:31.483766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.567547 (+1083781us) service_pool.cc:224] Handling call
0709 13:10:32.583012 (+ 15465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.584605 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:32.585227 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.583730 27336 rpcz_store.cc:276] 0709 13:10:31.486937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.524035 (+1037098us) service_pool.cc:224] Handling call
0709 13:10:32.578968 (+ 54933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.589032 31711 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:32.579589 31626 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:32.595542 31626 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:32.595579 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2518) took 1098 ms. Trace:
I20260709 13:10:32.601441 27341 rpcz_store.cc:276] 0709 13:10:31.496854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.584628 (+1087774us) service_pool.cc:224] Handling call
0709 13:10:32.595488 (+ 10860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.604383 27410 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:10:32.609256 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:32.609452 27231 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:32.610443 31091 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:32.611286 31711 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:32.611756 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.612514 31711 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:32.612718 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2186) took 1080 ms. Trace:
I20260709 13:10:32.613189 31711 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:32.613253 27336 rpcz_store.cc:276] 0709 13:10:31.531899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.603127 (+1071228us) service_pool.cc:224] Handling call
0709 13:10:32.612653 (+  9526us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.610438 31444 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:32.619829 31444 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:32.620299 31444 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.614689 31711 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.623744 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.614544 31091 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:32.625537 31091 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.628952 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.625420 31700 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.631632 27336 raft_consensus.cc:2376] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:32.631865 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.632185 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2482) took 1146 ms. Trace:
I20260709 13:10:32.632777 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2477) took 1155 ms. Trace:
I20260709 13:10:32.633256 27334 rpcz_store.cc:276] 0709 13:10:31.476891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.631401 (+1154510us) service_pool.cc:224] Handling call
0709 13:10:32.632687 (+  1286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.634347 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.637678 27409 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:32.639201 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:32.640120 31710 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.628095 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1705) took 4573 ms. Trace:
I20260709 13:10:32.641791 31721 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:32.642609 31721 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:32.634388 31718 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.644305 31721 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.645004 31718 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.641960 27413 rpcz_store.cc:276] 0709 13:10:28.054183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.065450 (+ 11267us) service_pool.cc:224] Handling call
0709 13:10:28.065777 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.066019 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:28.379701 (+313682us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.585697 (+4205996us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b18003c0e20. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287
0709 13:10:32.627292 (+ 41595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.627420 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:32.627508 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.627634 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.627854 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5104,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":189028,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"spinlock_wait_cycles":46500224,"thread_start_us":796153,"threads_started":3,"wal-append.queue_time_us":416096,"wal-append.run_cpu_time_us":1424,"wal-append.run_wall_time_us":1062212}
W20260709 13:10:32.647396 27408 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1719) took 4588 ms (client timeout 2159 ms). Trace:
W20260709 13:10:32.647900 27408 rpcz_store.cc:269] 0709 13:10:28.058304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.178953 (+120649us) service_pool.cc:224] Handling call
0709 13:10:32.646898 (+4467945us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54000ada54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:32.647137 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531649920}
I20260709 13:10:32.650404 31718 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.626801 31443 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.651515 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.652513 27334 raft_consensus.cc:2410] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:32.652976 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2506) took 1159 ms. Trace:
I20260709 13:10:32.653384 27417 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:32.654057 27412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.252s	user 0.009s	sys 0.029s
W20260709 13:10:32.654563 27412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.009s	sys 0.029s
I20260709 13:10:32.655465 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 641) took 1255 ms. Trace:
I20260709 13:10:32.655835 27412 rpcz_store.cc:276] 0709 13:10:31.400127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.400268 (+   141us) service_pool.cc:224] Handling call
0709 13:10:31.400566 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:31.400952 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:31.400980 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:31.401455 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.654974 (+1253519us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:32.655028 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.655110 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.655150 (+    40us) raft_consensus.cc:1685] finished
0709 13:10:32.655182 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.655399 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1102,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1253116,"threads_started":1,"wal-append.queue_time_us":70748,"wal-append.run_cpu_time_us":2044,"wal-append.run_wall_time_us":1002159}
I20260709 13:10:32.659451 31710 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:32.655412 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:32.660895 27338 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:32.648258 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63790.5us
I20260709 13:10:32.661717 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:32.632583 27336 rpcz_store.cc:276] 0709 13:10:31.486113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.623269 (+1137156us) service_pool.cc:224] Handling call
0709 13:10:32.632127 (+  8858us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.630811 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.653275 27334 rpcz_store.cc:276] 0709 13:10:31.493103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.651156 (+1158053us) service_pool.cc:224] Handling call
0709 13:10:32.652924 (+  1768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.651597 31443 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:32.666405 27413 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:32.646869 31626 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.669001 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 605) took 1004 ms. Trace:
I20260709 13:10:32.671427 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.669462 27341 raft_consensus.cc:2376] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:32.675565 27340 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:32.684592 31718 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:32.685518 31718 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:32.679380 27338 rpcz_store.cc:276] 0709 13:10:31.660832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.414547 (+753715us) service_pool.cc:224] Handling call
0709 13:10:32.664915 (+250368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.680680 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2521) took 1183 ms. Trace:
I20260709 13:10:32.690327 27341 rpcz_store.cc:276] 0709 13:10:31.497697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.630457 (+1132760us) service_pool.cc:224] Handling call
0709 13:10:32.680607 (+ 50150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.679919 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2505) took 1187 ms. Trace:
I20260709 13:10:32.691568 27336 rpcz_store.cc:276] 0709 13:10:31.492815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.669822 (+1177007us) service_pool.cc:224] Handling call
0709 13:10:32.679835 (+ 10013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.694566 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.697587 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1598) took 1099 ms. Trace:
I20260709 13:10:32.698221 27264 rpcz_store.cc:276] 0709 13:10:31.506773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.923799 (+417026us) service_pool.cc:224] Handling call
0709 13:10:32.004781 (+ 80982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.005436 (+   655us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:32.425514 (+420078us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.557871 (+132357us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.603680 (+ 45809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.603726 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:32.606344 (+  2618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.606418 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.606567 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11505,"prepare.queue_time_us":426750,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":4449,"raft.queue_time_us":159289,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":25805,"thread_start_us":554084,"threads_started":4,"wal-append.queue_time_us":53101}
I20260709 13:10:32.707712 27978 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:32.716516 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.721333 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2513) took 1267 ms. Trace:
I20260709 13:10:32.710103 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:32.727156 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.728336 27336 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:32.728601 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 58701.2us
I20260709 13:10:32.730419 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2503) took 1238 ms. Trace:
I20260709 13:10:32.730743 27336 rpcz_store.cc:276] 0709 13:10:31.492098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.694109 (+1202011us) service_pool.cc:224] Handling call
0709 13:10:32.730366 (+ 36257us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:32.728323 27380 leader_election.cc:336] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.603s (SENT)
I20260709 13:10:32.731825 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.733421 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.729668 31091 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:32.738565 28006 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:32.721943 27262 rpcz_store.cc:276] 0709 13:10:31.426941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.530753 (+1103812us) service_pool.cc:224] Handling call
0709 13:10:32.531503 (+   750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.532109 (+   606us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:32.532714 (+   605us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.687378 (+154664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.687448 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:32.693398 (+  5950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.693498 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.694238 (+   740us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7987,"prepare.queue_time_us":1929,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":29389,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":144638,"threads_started":2,"wal-append.queue_time_us":156347}
I20260709 13:10:32.740692 31161 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:32.741474 31161 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.742915 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:32.744319 28010 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:32.745760 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:32.747404 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.748459 27341 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.749883 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2490) took 1261 ms. Trace:
I20260709 13:10:32.750121 27341 rpcz_store.cc:276] 0709 13:10:31.488384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.720565 (+1232181us) service_pool.cc:224] Handling call
0709 13:10:32.749837 (+ 29272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.750773 31091 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:32.752398 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:32.753397 27264 raft_consensus.cc:2410] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:32.752528 31091 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:31.409793 31594 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:32.754118 31594 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:32.754549 31594 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:32.758744 31519 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:32.759374 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:32.725499 31444 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.760426 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.765224 31444 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.766093 27341 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:32.766686 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48434.8us
I20260709 13:10:32.767249 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.767992 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2487) took 1280 ms. Trace:
I20260709 13:10:32.768287 27341 rpcz_store.cc:276] 0709 13:10:31.487539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.766928 (+1279389us) service_pool.cc:224] Handling call
0709 13:10:32.767941 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.769217 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.769455 27338 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:32.770144 28013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 527) took 3936 ms. Trace:
I20260709 13:10:32.770421 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.770561 28013 rpcz_store.cc:276] 0709 13:10:28.833501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.833672 (+   171us) service_pool.cc:224] Handling call
0709 13:10:28.833999 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:29.219599 (+385600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.769646 (+3550047us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54004d30d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:32.769941 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740191488}
I20260709 13:10:32.748610 31718 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.778213 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.779218 27342 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.779954 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:32.779743 27342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2476) took 1303 ms (client timeout 1705 ms). Trace:
W20260709 13:10:32.784126 27342 rpcz_store.cc:269] 0709 13:10:31.476586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.777760 (+1301174us) service_pool.cc:224] Handling call
0709 13:10:32.779677 (+  1917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.786175 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:32.787550 27262 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:32.786870 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.788549 31131 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:32.788686 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.789749 27342 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.790838 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.791814 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.792605 27342 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:32.793557 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.797282 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.798137 31716 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:32.798534 31716 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:32.798650 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2497) took 1308 ms. Trace:
I20260709 13:10:32.799299 27336 rpcz_store.cc:276] 0709 13:10:31.490300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.792294 (+1301994us) service_pool.cc:224] Handling call
0709 13:10:32.798580 (+  6286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.800624 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.798053 31626 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.801493 27336 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:32.805027 31716 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.806622 31716 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:32.809062 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:32.811409 31626 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:32.812052 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.812204 31626 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:32.812979 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2520) took 1315 ms. Trace:
I20260709 13:10:32.813145 31626 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:32.813591 31626 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:32.814747 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1602) took 1305 ms. Trace:
I20260709 13:10:32.813397 27342 rpcz_store.cc:276] 0709 13:10:31.497387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.793397 (+1296010us) service_pool.cc:224] Handling call
0709 13:10:32.812919 (+ 19522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.815807 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.815143 27259 rpcz_store.cc:276] 0709 13:10:31.509670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.977026 (+467356us) service_pool.cc:224] Handling call
0709 13:10:31.977697 (+   671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.350848 (+373151us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:32.429260 (+ 78412us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.579667 (+150407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.579715 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:32.579768 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.814504 (+234736us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54003d0254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:32.814567 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.814695 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81299,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":114,"raft.queue_time_us":32963,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":209,"spinlock_wait_cycles":856741760,"thread_start_us":192905,"threads_started":3,"wal-append.queue_time_us":167900}
I20260709 13:10:32.816535 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2524) took 1318 ms. Trace:
I20260709 13:10:32.817381 27342 rpcz_store.cc:276] 0709 13:10:31.498562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.815530 (+1316968us) service_pool.cc:224] Handling call
0709 13:10:32.816489 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.788497 27338 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:32.807746 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1707) took 4752 ms. Trace:
I20260709 13:10:32.821485 27414 rpcz_store.cc:276] 0709 13:10:28.054811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.067865 (+ 13054us) service_pool.cc:224] Handling call
0709 13:10:28.068216 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.159640 (+ 91424us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:28.194456 (+ 34816us) log.cc:844] Serialized 14 byte log entry
0709 13:10:28.800469 (+606013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.800513 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:28.800556 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.807080 (+4006524us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b540027d154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:32.807179 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.807468 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30203,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":836,"raft.queue_time_us":148519,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":2993,"spinlock_wait_cycles":209702656,"thread_start_us":605581,"threads_started":2,"wal-append.queue_time_us":544547,"wal-append.run_cpu_time_us":1983,"wal-append.run_wall_time_us":1295416}
W20260709 13:10:32.827464 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 131770us
I20260709 13:10:32.828377 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.829636 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2145) took 4037 ms. Trace:
I20260709 13:10:32.829946 27338 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:32.831023 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.831367 31647 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:32.832152 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.832756 27338 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:32.832926 27264 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:32.833205 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2188) took 1188 ms. Trace:
I20260709 13:10:32.833508 27338 rpcz_store.cc:276] 0709 13:10:31.644990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.831886 (+1186896us) service_pool.cc:224] Handling call
0709 13:10:32.833158 (+  1272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.834367 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.834535 27266 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:32.834877 27338 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:32.828559 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:32.835623 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:32.845414 27342 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11. Re-sending same reply.
I20260709 13:10:32.846380 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.846391 27265 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:32.802802 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.847124 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 607) took 1185 ms. Trace:
I20260709 13:10:32.828552 27341 raft_consensus.cc:2376] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10. Re-sending same reply.
I20260709 13:10:32.847510 27338 rpcz_store.cc:276] 0709 13:10:31.661372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.834077 (+1172705us) service_pool.cc:224] Handling call
0709 13:10:32.847073 (+ 12996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.853191 27342 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:32.853801 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.854272 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.853215 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:32.855517 27266 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:32.858965 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:32.830073 27415 rpcz_store.cc:276] 0709 13:10:28.792011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.432612 (+1640601us) service_pool.cc:224] Handling call
0709 13:10:30.433139 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.443588 (+ 10449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.443637 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.444276 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:10:32.652430 (+2208154us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b180048b2c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:32.784493 (+132063us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:32.784565 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.785724 (+  1159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:32.785793 (+    69us) raft_consensus.cc:1685] finished
0709 13:10:32.785810 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.829390 (+ 43580us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9882,"raft.queue_time_us":40481,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":7405,"spinlock_wait_cycles":2478848,"thread_start_us":68257,"threads_started":1,"wal-append.queue_time_us":2246533}
I20260709 13:10:32.860355 31648 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.860724 27264 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:32.861035 31648 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.863413 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2189) took 1218 ms. Trace:
I20260709 13:10:32.863691 27336 rpcz_store.cc:276] 0709 13:10:31.645312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.802412 (+1157100us) service_pool.cc:224] Handling call
0709 13:10:32.863365 (+ 60953us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.866817 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:32.866762 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.869556 27265 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:32.870559 27266 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:32.864542 31647 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:10:32.842986 31443 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.875756 31726 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:32.876168 31726 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:32.877235 31726 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.879403 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:32.881114 31710 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:32.881731 31710 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:32.883077 31710 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.881698 31711 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:32.890918 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:32.891863 27341 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:32.814733 31626 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:32.899417 31626 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:32.902336 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.906078 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2484) took 1419 ms. Trace:
W20260709 13:10:32.908057 31731 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:10:32.846431 31594 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.028565 27266 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:33.023391 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.022716 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.032742 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:32.957932 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.033553 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 156478us
W20260709 13:10:32.989642 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.035044 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.022930 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.032785 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.044260 27341 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:33.024971 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1600) took 1345 ms. Trace:
I20260709 13:10:33.000475 27411 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:32.906634 27335 rpcz_store.cc:276] 0709 13:10:31.486678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.046385 (+559707us) service_pool.cc:224] Handling call
0709 13:10:32.905828 (+859443us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001fcf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:32.905967 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585366272}
I20260709 13:10:33.022054 31444 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.050174 27412 raft_consensus.cc:2410] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:10:33.049788 31444 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:32.910241 31648 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:33.051851 31727 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.057411 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.057626 31727 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.058336 27412 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:33.060186 31727 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.061023 27264 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.043654 31443 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:32.995739 31519 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.053925 27978 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:33.067889 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.055914 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.045953 31726 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.044812 27267 rpcz_store.cc:276] 0709 13:10:31.508358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.925826 (+417468us) service_pool.cc:224] Handling call
0709 13:10:31.926415 (+   589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.927006 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:32.550873 (+623867us) log.cc:844] Serialized 14 byte log entry
0709 13:10:32.849069 (+298196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.849143 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:32.853670 (+  4527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.853745 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.853888 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18784,"prepare.queue_time_us":357353,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":31141,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5487,"thread_start_us":668617,"threads_started":2,"wal-append.queue_time_us":327262}
I20260709 13:10:33.076308 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.077989 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.080768 27336 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.069330 31444 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.084337 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.084761 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:33.085834 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.085942 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:33.086522 27308 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.580s (SENT) [suppressed 55 similar messages]
I20260709 13:10:33.087050 27335 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:33.092202 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.092558 28013 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.087450 27341 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.091012 31594 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:33.096079 27408 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.095929 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:33.091496 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 127121us
I20260709 13:10:33.091866 27415 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:33.099799 28014 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.100283 28010 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.101020 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.101804 28006 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.103523 27417 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:33.105057 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.105316 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.106536 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.107374 31732 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.107836 31732 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.108171 31732 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.109953 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2489) took 1605 ms. Trace:
I20260709 13:10:33.110334 27335 rpcz_store.cc:276] 0709 13:10:31.488096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.055707 (+1567611us) service_pool.cc:224] Handling call
0709 13:10:33.086872 (+ 31165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.093464 (+  6592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.093640 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:33.111678 27308 connection.cc:256] RPC call timeout handler was delayed by -3.2755486160000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:10:33.112237 27263 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:33.112385 27308 connection.cc:256] RPC call timeout handler was delayed by -3.2034703110000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:10:33.112776 27308 connection.cc:256] RPC call timeout handler was delayed by -3.19454861600002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:10:33.113055 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1607) took 1586 ms. Trace:
I20260709 13:10:33.111642 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.113498 27263 rpcz_store.cc:276] 0709 13:10:31.526779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.419527 (+892748us) service_pool.cc:224] Handling call
0709 13:10:33.111765 (+692238us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b5800000c98. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:33.111991 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.112785 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.112996 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17614720}
I20260709 13:10:33.115172 27408 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:33.114758 27335 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:33.115898 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2498) took 1625 ms. Trace:
I20260709 13:10:33.116212 27335 rpcz_store.cc:276] 0709 13:10:31.490618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.114098 (+1623480us) service_pool.cc:224] Handling call
0709 13:10:33.114412 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.115636 (+  1224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.115826 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.117578 27335 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:33.118079 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2523) took 1619 ms. Trace:
I20260709 13:10:33.118371 27335 rpcz_store.cc:276] 0709 13:10:31.498292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.116954 (+1618662us) service_pool.cc:224] Handling call
0709 13:10:33.117282 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.117871 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.118028 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.119680 27335 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.120222 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2181) took 1589 ms. Trace:
I20260709 13:10:33.120530 27335 rpcz_store.cc:276] 0709 13:10:31.530526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.119084 (+1588558us) service_pool.cc:224] Handling call
0709 13:10:33.119430 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.120014 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.120174 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.121765 27335 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:33.123592 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.124521 27410 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:33.125603 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.125856 31710 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:33.126482 31710 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.123633 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.130875 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2486) took 1616 ms. Trace:
I20260709 13:10:33.131373 27341 rpcz_store.cc:276] 0709 13:10:31.487259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.055746 (+1568487us) service_pool.cc:224] Handling call
0709 13:10:33.083745 (+ 27999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.103579 (+ 19834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.103753 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:33.113040 27308 connection.cc:256] RPC call timeout handler was delayed by -3.0550486160000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 13:10:33.122289 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2182) took 1591 ms. Trace:
I20260709 13:10:33.140069 27335 rpcz_store.cc:276] 0709 13:10:31.530788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.121262 (+1590474us) service_pool.cc:224] Handling call
0709 13:10:33.121578 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.122081 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.122244 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.126362 27411 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
W20260709 13:10:33.132767 27308 connection.cc:256] RPC call timeout handler was delayed by -3.0406486160001123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 13:10:33.142681 27308 connection.cc:256] RPC call timeout handler was delayed by -3.0181486160000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:10:33.133682 27264 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
W20260709 13:10:33.142972 27308 connection.cc:256] RPC call timeout handler was delayed by -2.9994194450000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 13:10:33.143487 27308 connection.cc:256] RPC call timeout handler was delayed by -2.96915109400004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:10:33.143929 27308 connection.cc:256] RPC call timeout handler was delayed by -2.626648616000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2619s for a response
W20260709 13:10:33.145637 27308 connection.cc:256] RPC call timeout handler was delayed by -2.422348616000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2846s for a response
W20260709 13:10:33.146136 27308 connection.cc:256] RPC call timeout handler was delayed by -2.3935486160000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2878s for a response
W20260709 13:10:33.146525 27308 connection.cc:256] RPC call timeout handler was delayed by -2.2417287480001278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 13:10:33.147336 27308 connection.cc:256] RPC call timeout handler was delayed by -2.2257217750001246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 13:10:33.147847 27308 connection.cc:256] RPC call timeout handler was delayed by -2.1396468340000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
W20260709 13:10:33.148293 27308 connection.cc:256] RPC call timeout handler was delayed by -1.9633357579999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24580000000000002s for a response
I20260709 13:10:33.147457 27336 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:33.148672 27308 connection.cc:256] RPC call timeout handler was delayed by -1.1237725490001367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32530000000000003s for a response
I20260709 13:10:33.149178 28013 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:33.152580 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.157194 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2492) took 1662 ms. Trace:
I20260709 13:10:33.157589 27336 rpcz_store.cc:276] 0709 13:10:31.488912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.092770 (+1603858us) service_pool.cc:224] Handling call
0709 13:10:33.144258 (+ 51488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.151412 (+  7154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.151661 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.155707 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.159055 27415 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:33.155068 28008 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:33.160742 27409 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:33.154971 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.164688 28012 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:33.173738 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 604) took 1513 ms. Trace:
I20260709 13:10:33.098095 31727 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:33.174117 27336 rpcz_store.cc:276] 0709 13:10:31.660511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.161215 (+1500704us) service_pool.cc:224] Handling call
0709 13:10:33.173206 (+ 11991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.173386 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.173409 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:33.173462 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:33.173515 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.173567 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.173655 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.174671 27341 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:33.174974 31727 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:33.175740 31727 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:33.177021 31727 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.142258 31519 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.182111 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.182624 31727 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.183719 31519 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:33.175926 27336 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:10:33.186671 27336 pending_rounds.cc:85] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:10:33.186923 27336 pending_rounds.cc:107] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 12.9
W20260709 13:10:33.187389 27340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2190) took 1541 ms (client timeout 1577 ms). Trace:
W20260709 13:10:33.187911 27340 rpcz_store.cc:269] 0709 13:10:31.645602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.658508 (+ 12906us) service_pool.cc:224] Handling call
0709 13:10:33.187210 (+1528702us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54002896d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:33.187330 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719440256}
I20260709 13:10:33.189116 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:33.190039 27340 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:33.187197 27336 raft_consensus.cc:2889] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.191041 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 608) took 1529 ms. Trace:
I20260709 13:10:33.192315 31732 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.193158 27231 leader_election.cc:400] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11.
I20260709 13:10:33.193682 28011 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:33.193997 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.194855 27338 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:33.191362 27336 rpcz_store.cc:276] 0709 13:10:31.661729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.175205 (+1513476us) service_pool.cc:224] Handling call
0709 13:10:33.175539 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.190812 (+ 15273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.190992 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.195550 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.196245 27978 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.196861 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.196964 31444 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:33.197419 27338 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.198014 31739 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.198159 31718 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.200105 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:33.169544 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2522) took 1671 ms (client timeout 2150 ms). Trace:
I20260709 13:10:33.166532 31522 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.201843 31432 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:33.180917 31543 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:33.201560 27343 rpcz_store.cc:269] 0709 13:10:31.497999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.959464 (+461465us) service_pool.cc:224] Handling call
0709 13:10:33.169360 (+1209896us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540024fed4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:33.169463 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970975488}
I20260709 13:10:33.204282 31732 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:33.205149 27340 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:10:33.202793 31432 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:10:33.165544 31736 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:33.168911 31710 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.175308 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2185) took 1643 ms. Trace:
I20260709 13:10:33.186126 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.208966 27341 rpcz_store.cc:276] 0709 13:10:31.531626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.132307 (+1600681us) service_pool.cc:224] Handling call
0709 13:10:33.161736 (+ 29429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.175025 (+ 13289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.175256 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.210116 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:33.210354 27341 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:33.210693 27341 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.212018 27308 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.097970 31091 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:10:33.213301 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.180449 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:33.172850 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2167) took 5156 ms. Trace:
W20260709 13:10:33.214900 27261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2514) took 1787 ms (client timeout 2071 ms). Trace:
W20260709 13:10:33.215613 27261 rpcz_store.cc:269] 0709 13:10:31.431490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.180030 (+1748540us) service_pool.cc:224] Handling call
0709 13:10:33.214828 (+ 34798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.184533 27160 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 11, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.214576 27337 rpcz_store.cc:276] 0709 13:10:28.016527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.017581 (+  1054us) service_pool.cc:224] Handling call
0709 13:10:28.083674 (+ 66093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.127278 (+ 43604us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:28.597541 (+470263us) log.cc:844] Serialized 14 byte log entry
0709 13:10:29.016599 (+419058us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:29.016660 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:29.016715 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.172370 (+4155655us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b540021dc54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:33.172440 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:33.172643 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":610853,"prepare.run_cpu_time_us":3876,"prepare.run_wall_time_us":4740,"raft.queue_time_us":83301,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":99590912,"thread_start_us":869486,"threads_started":3,"wal-append.queue_time_us":388101,"wal-append.run_cpu_time_us":2163,"wal-append.run_wall_time_us":1164196}
I20260709 13:10:33.211720 27341 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.223589 27335 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:33.224615 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2193) took 1578 ms. Trace:
I20260709 13:10:33.225209 27338 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:33.232570 27415 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:33.225183 31432 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.234864 27409 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:33.225495 27335 rpcz_store.cc:276] 0709 13:10:31.646510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.146483 (+1499973us) service_pool.cc:224] Handling call
0709 13:10:33.223366 (+ 76883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.224309 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.224542 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.229674 31716 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:10:33.247553 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:33.250754 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.252365 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.262199 31739 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:33.263442 31626 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:33.267056 27416 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.266238 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:33.270838 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:33.272238 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.256446 31432 raft_consensus.cc:2764] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:33.273674 28011 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:33.263881 31594 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:33.264955 31626 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:33.276055 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 62906.6us
I20260709 13:10:33.275079 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.251117 31718 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:10:33.281067 31705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.009s	sys 0.008s
I20260709 13:10:33.273887 31727 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:33.273527 31707 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:33.297580 28012 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:33.294421 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 96592.8us
I20260709 13:10:33.278792 31626 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:33.293540 31705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.009s	sys 0.008s
I20260709 13:10:33.286080 31594 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:33.297304 31432 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.311333 31748 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.311748 31519 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.312424 31517 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:33.300441 31707 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.307574 31705 consensus_queue.cc:1243] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:33.299360 31727 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.306207 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:33.325500 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:33.326248 31705 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.325973 31517 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.327325 31707 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.328078 27334 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:33.320053 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.328473 27334 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.325729 31727 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:33.330143 31499 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.325687 31519 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.331907 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:33.332644 31499 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:33.333341 31519 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:33.326650 31705 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:33.334563 31594 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.335570 31705 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.337872 31432 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:33.338670 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.344076 27416 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
W20260709 13:10:33.385365 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.422909 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.345438 27980 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:33.436389 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 90939.9us
W20260709 13:10:33.452596 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 112492us
W20260709 13:10:33.456032 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.457950 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.457607 27334 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:33.458367 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.457788 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 119278us
I20260709 13:10:33.460328 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:33.458305 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.445072 31091 raft_consensus.cc:2804] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:33.458251 31746 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 13:10:33.454902 31748 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.474123 31517 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:33.479549 27266 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:33.480020 27266 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:33.482721 27266 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.483695 27340 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:33.484651 27266 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:33.489403 28015 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:33.492992 31744 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:33.493978 31744 consensus_queue.cc:1243] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:33.494454 31744 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:33.494789 31744 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:33.499990 31626 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.502579 31626 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:33.504349 27266 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:10:33.504920 27266 pending_rounds.cc:85] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 8
I20260709 13:10:33.505425 27266 pending_rounds.cc:107] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:10:33.505615 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:33.505785 27266 raft_consensus.cc:2889] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:33.505120 31744 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.508708 31744 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.500093 27342 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.509836 31652 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.510473 31652 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.512015 27336 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:10:33.514730 27383 connection.cc:256] RPC call timeout handler was delayed by -2.2422994180001297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:10:33.518581 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1592) took 2017 ms. Trace:
I20260709 13:10:33.519145 27260 rpcz_store.cc:276] 0709 13:10:31.500671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.896935 (+396264us) service_pool.cc:224] Handling call
0709 13:10:31.897959 (+  1024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.379661 (+481702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.518234 (+1138573us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b540031e7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:33.518470 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101877120}
I20260709 13:10:33.520859 31707 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.523118 31707 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:33.515236 27383 connection.cc:256] RPC call timeout handler was delayed by -2.2002298440000914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 13:10:33.524537 27383 connection.cc:256] RPC call timeout handler was delayed by -1.2003298440000663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32610000000000006s for a response
I20260709 13:10:33.527112 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.527504 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.527669 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.528153 27263 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
W20260709 13:10:33.524861 27383 connection.cc:256] RPC call timeout handler was delayed by -1.1643298440000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33010000000000006s for a response
I20260709 13:10:33.529727 31517 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.530215 31517 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.532361 31517 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:33.534734 31161 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:33.535728 31713 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:10:33.537274 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.537930 27415 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:33.505231 27334 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.539088 31739 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:33.539323 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.539232 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:33.543087 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54772.1us
I20260709 13:10:33.565836 27415 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.569301 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.475936 31091 raft_consensus.cc:697] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:33.570780 28015 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:33.504958 31749 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:33.575239 27413 raft_consensus.cc:2410] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:33.572999 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.577082 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:33.577245 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.577504 27266 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:33.577746 28012 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:33.539755 31499 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.560760 31739 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:33.582675 28011 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:10:33.578791 27260 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:33.588032 27263 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:33.584491 31091 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.563237 31716 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:33.586036 31499 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.586812 31749 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:33.588955 27231 leader_election.cc:336] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.010s (SENT)
W20260709 13:10:33.593760 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 138936us
I20260709 13:10:33.594945 27411 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:33.595300 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.596252 27416 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.598312 31749 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.599761 27339 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:10:33.601265 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.602241 27417 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.593487 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.600858 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.603422 27260 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:33.604084 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.604704 27268 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:33.605180 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2511) took 2178 ms. Trace:
I20260709 13:10:33.605496 27268 rpcz_store.cc:276] 0709 13:10:31.426456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.603705 (+2177249us) service_pool.cc:224] Handling call
0709 13:10:33.605131 (+  1426us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:33.605943 31744 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:33.606317 31710 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.607443 31753 raft_consensus.cc:993] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:10:33.608129 31753 raft_consensus.cc:1081] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:10:33.598508 31739 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.612167 31652 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.624421 31727 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.625969 27264 raft_consensus.cc:1240] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:33.636991 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 616) took 1040 ms. Trace:
I20260709 13:10:33.637585 27336 rpcz_store.cc:276] 0709 13:10:32.597353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.198019 (+600666us) service_pool.cc:224] Handling call
0709 13:10:33.510943 (+312924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:33.512436 (+  1493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.636715 (+124279us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540025c6d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:33.636897 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":720472192}
W20260709 13:10:33.642030 27364 debug-util.cc:398] Leaking SignalData structure 0x7b0800099d80 after lost signal to thread 27200
I20260709 13:10:33.642970 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.643388 31732 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:33.643702 27260 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:33.644524 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.646464 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:33.650228 27334 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:33.651753 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.654932 28012 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
W20260709 13:10:33.672485 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78062.6us
I20260709 13:10:33.673852 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.674793 27266 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:33.675514 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.678130 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.679749 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:33.680543 27364 debug-util.cc:398] Leaking SignalData structure 0x7b08001e8f00 after lost signal to thread 27292
I20260709 13:10:33.680704 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.678735 27262 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:33.684089 27265 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:33.679657 31652 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:33.685253 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.686154 27260 raft_consensus.cc:2368] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:10:33.685344 31652 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.687662 31652 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.689286 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.690326 27261 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
W20260709 13:10:33.685428 27231 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.111s (SENT)
I20260709 13:10:33.691828 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.692690 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.693048 31711 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.694171 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.673903 31705 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.694963 27417 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.695938 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.697132 31705 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.697885 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.698786 27267 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 13: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:33.698472 31652 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:33.694257 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.700567 31652 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:33.700727 27412 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.701829 27268 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:33.697038 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.702837 27411 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:33.703707 27364 debug-util.cc:398] Leaking SignalData structure 0x7b080031c2c0 after lost signal to thread 27367
W20260709 13:10:33.704022 27364 debug-util.cc:398] Leaking SignalData structure 0x7b080037b800 after lost signal to thread 27368
I20260709 13:10:33.698644 27408 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:33.704344 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:33.705081 27364 debug-util.cc:398] Leaking SignalData structure 0x7b080014dc20 after lost signal to thread 27441
W20260709 13:10:33.706322 27364 debug-util.cc:398] Leaking SignalData structure 0x7b08003e38a0 after lost signal to thread 28039
W20260709 13:10:33.710953 27231 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.150s (SENT)
I20260709 13:10:33.711149 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.711504 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:33.713102 27231 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.152s (SENT)
I20260709 13:10:33.713829 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.715018 27415 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:10:33.715528 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.715075 27411 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:33.711884 27408 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:33.721122 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:33.737851 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:33.739675 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.739598 31432 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.742990 31432 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.723381 31705 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.748466 27412 raft_consensus.cc:2410] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:33.735838 31711 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:33.760924 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.761946 27412 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.768018 27265 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:33.750042 31744 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:33.774117 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 313906us
I20260709 13:10:33.775697 31759 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.776050 27268 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:33.776520 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.777889 31754 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:33.778090 31759 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.778355 31754 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.779342 31754 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.780670 31754 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.752257 31711 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.783979 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.787514 31727 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:33.790494 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:33.791786 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54031.6us
I20260709 13:10:33.791400 31721 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:33.797585 31732 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.812923 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.813412 27341 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:33.796288 31711 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:33.817123 31739 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:33.828620 27231 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.183s (SENT)
I20260709 13:10:33.831614 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:33.838191 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 61754.6us
I20260709 13:10:33.836107 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.840297 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.840524 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:33.841070 27413 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:33.841872 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.843494 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.843385 31763 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:33.843904 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:33.844602 27267 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:33.844846 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.844988 31763 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:33.845643 27417 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.842867 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.851897 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:33.826014 27408 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:33.862025 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.864099 27342 raft_consensus.cc:2410] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:33.863991 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.861549 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:33.865993 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.864703 27340 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.875082 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.878439 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.881912 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.887504 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:33.887714 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.890285 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.877667 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.843327 27263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59118
I20260709 13:10:33.892110 27263 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.858981 31705 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:33.892470 27263 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:33.888257 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:33.896221 27417 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.893827 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.894397 31626 raft_consensus.cc:2764] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:33.886945 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.898448 27411 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:33.860560 31744 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:33.901103 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:33.901269 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111021us
I20260709 13:10:33.902889 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.903965 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.904567 27343 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:33.909618 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.910357 27343 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:33.912735 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:33.914654 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.915534 27335 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:33.919128 28006 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:33.919399 27981 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:33.924511 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:33.929422 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.932626 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:33.935462 27342 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:33.933938 28010 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:33.937052 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:33.912930 31744 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:33.942399 27335 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:33.943229 27416 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:33.938989 28006 raft_consensus.cc:2376] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:33.920581 31647 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:33.960654 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.947418 27308 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:33.951207 31752 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 13:10:33.955606 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.964098 31744 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.940735 31721 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:33.966894 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:33.969785 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76098.3us
I20260709 13:10:33.971942 27342 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:33.974851 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:33.975732 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:33.970781 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:33.973205 27342 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:33.984973 31748 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.985175 31716 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.988742 31651 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:33.989204 31651 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:33.989588 31651 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:33.990110 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46232.5us
W20260709 13:10:33.990433 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44662.8us
W20260709 13:10:33.991485 31751 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.414s	user 0.003s	sys 0.001s
I20260709 13:10:33.994180 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.995184 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.969035 31161 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:33.999748 27334 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.000727 31161 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.001288 31161 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.995936 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:33.969193 31443 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:34.003521 27339 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:34.003872 31524 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:33.996640 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.007725 27340 raft_consensus.cc:2393] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:33.997283 31718 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:33.998303 31763 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:33.998972 31721 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:34.010737 31721 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:33.990993 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:34.011310 31710 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:34.014421 27341 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:10:34.015208 31710 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:34.029667 31710 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.029524 31432 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:34.017853 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52500.6us
I20260709 13:10:34.031769 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.032788 31432 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:34.033586 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.033789 31652 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:34.034235 31652 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.034693 31131 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.035097 31652 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.036553 31652 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.018566 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.021581 27334 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:34.037739 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:33.968704 31517 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:10:34.041617 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.044119 31131 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:34.044703 31131 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:34.045750 31131 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.046401 27339 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:34.016484 31748 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:34.047472 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53406.5us
I20260709 13:10:34.027149 27342 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.051998 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:34.052663 27261 raft_consensus.cc:3060] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.049789 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:34.054400 27342 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:34.028537 31443 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:34.059294 27268 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:34.058640 31749 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:34.071583 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.071738 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:34.061750 27263 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.078349 28010 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:34.082561 27263 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:34.087107 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49481.5us
W20260709 13:10:34.085884 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52422.6us
I20260709 13:10:34.088359 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:34.081364 31517 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.091534 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:34.086688 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:34.053789 31748 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.096046 27261 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:34.060644 31647 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.040565 31543 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:10:34.092432 28011 raft_consensus.cc:2376] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11. Re-sending same reply.
I20260709 13:10:34.063797 31443 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:34.101992 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 83502.2us
I20260709 13:10:34.072314 31161 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:34.107255 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:34.109745 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.111943 28006 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:10:34.108881 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:34.116029 31769 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:34.115662 31748 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.119268 31759 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.119531 31543 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:34.120064 31543 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.121047 31543 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.122509 31543 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.079206 31499 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:34.124075 27309 leader_election.cc:400] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:10:34.124663 31753 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.125087 31753 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.126080 31753 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.124455 27309 leader_election.cc:403] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.126451 31763 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:34.124411 31754 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:34.100564 31647 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:34.093493 31517 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:34.162608 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:34.163273 27342 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:10:34.106040 31443 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:34.183831 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 59911.8us
W20260709 13:10:34.181234 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 87785.3us
W20260709 13:10:34.186259 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 95210.5us
I20260709 13:10:34.187067 27380 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.192236 31782 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:34.192836 31782 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:34.193250 31782 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.193789 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.194183 31713 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:34.195369 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 86556.9us
I20260709 13:10:34.195879 31517 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.196949 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:34.197269 31517 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.193081 31705 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:10:34.199352 31759 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:10:34.199649 31705 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:34.200143 31705 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:34.200220 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:34.202279 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:34.203290 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.203972 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.207367 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.207561 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:34.227247 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 114765us
I20260709 13:10:34.104929 31711 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:34.230316 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125384us
I20260709 13:10:34.234880 31745 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.235126 31749 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.178139 31647 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.200081 31759 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:34.238169 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53012.8us
I20260709 13:10:34.247684 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:34.241281 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.241839 27414 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:10:34.252624 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 50421.7us
I20260709 13:10:34.230398 31716 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.254726 31759 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:34.255033 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:34.266530 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 59348.6us
I20260709 13:10:34.233292 31432 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:34.240593 31713 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.234948 31524 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:34.270814 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:34.273303 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:34.279342 27263 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.241257 31744 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:34.275883 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.283401 31131 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.298159 27264 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:34.236878 31499 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:10:34.309388 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 57567.4us
I20260709 13:10:34.277997 31745 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:34.301210 31753 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.284993 31524 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:34.299067 31131 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:34.342352 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.315434 31754 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.347446 27261 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:10:34.311475 31785 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:34.362105 31789 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.362828 31789 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.365295 31789 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:34.345638 31131 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.368185 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:34.253665 31705 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.376829 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.379979 27342 raft_consensus.cc:2368] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11.
I20260709 13:10:34.377646 27339 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:34.377769 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.341804 31524 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.378535 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.381299 27337 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 7.
I20260709 13:10:34.407467 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.407966 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.412973 27263 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:34.415388 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.416105 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.417389 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.417811 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.418448 27338 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:34.418296 31443 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.421607 31131 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.423451 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.321126 31749 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:10:34.353528 31754 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:34.424281 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.418460 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.416237 27342 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:34.430307 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.432204 27414 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:34.435716 27340 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:34.437417 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.443835 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.444589 27343 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:34.444952 31798 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.445369 31798 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.445477 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.433243 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.433818 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.452580 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.454442 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.460664 28015 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:34.441658 31727 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.464120 31727 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:34.465301 31788 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:10:34.466265 31727 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:34.467092 31775 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:10:34.375761 31785 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:34.469040 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.464367 31800 raft_consensus.cc:2764] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:34.356115 31744 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:10:34.492291 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.440845 31754 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.496695 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.498641 28012 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.431948 31091 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.499981 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 250737us
I20260709 13:10:34.431305 31745 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:34.560330 27337 raft_consensus.cc:2410] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:34.515045 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:34.565488 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 50552.7us
I20260709 13:10:34.430603 31797 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:34.568888 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:34.577730 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.579115 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.579766 27341 raft_consensus.cc:2376] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:34.580086 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.578382 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:34.581127 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.581749 27336 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:34.588284 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.589465 27340 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:10:34.435514 31773 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.133s
I20260709 13:10:34.592474 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.601423 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.607360 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.608551 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.610355 27335 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:34.604744 27337 raft_consensus.cc:2376] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
W20260709 13:10:34.611761 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 336540us
I20260709 13:10:34.611513 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.617919 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.617978 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.618523 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:34.619625 27343 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:34.619099 27336 raft_consensus.cc:2410] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:34.625240 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:34.626878 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59066.8us
I20260709 13:10:34.588925 31626 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:34.590704 31711 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:34.660301 27336 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:10:34.613034 31131 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:34.672183 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.615295 31732 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:34.675407 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.569240 31091 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:34.680626 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.624233 31718 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:10:34.683693 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.682555 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.689953 31443 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:34.674606 31626 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:34.691382 31781 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:10:34.691715 31626 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.704526 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.705299 27334 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:34.705660 27334 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:34.716455 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61066us
I20260709 13:10:34.717207 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:34.727118 27334 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.713155 31749 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:34.715876 31778 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:34.753901 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:34.756946 27411 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:34.696786 31732 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.755524 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:34.740957 31443 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:34.766000 27338 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.770264 28012 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:34.772579 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:34.773509 27417 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.780032 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:34.781337 27412 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:34.783231 27416 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:34.746104 31517 consensus_queue.cc:1059] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:10:34.756698 31778 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:34.683845 31798 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.773470 31443 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:34.802537 31710 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.001s
I20260709 13:10:34.802390 31784 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:34.803934 31806 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:10:34.804293 31815 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:34.805945 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.005s
I20260709 13:10:34.784296 31811 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.756206 31647 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.768318 31779 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:34.794937 31812 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:34.819766 27338 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:34.798522 31778 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:34.821019 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.005s
W20260709 13:10:34.829417 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 574433us
I20260709 13:10:34.736480 31745 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.768129 31749 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:34.823361 31791 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:10:34.787678 31801 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 13:10:34.809636 31443 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:34.827266 31779 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:34.741758 31785 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.876991 31779 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:34.883240 31651 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.893s	user 0.012s	sys 0.000s
I20260709 13:10:34.883883 31651 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.885437 31161 raft_consensus.cc:3055] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:34.885931 31161 raft_consensus.cc:740] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:34.886581 31754 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.887631 27340 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:34.888613 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:34.825012 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:34.831336 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:34.787634 31432 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:34.812785 31784 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.832326 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:34.787569 31774 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 13:10:34.899456 31784 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:34.822779 31808 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:10:34.901885 27334 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:34.902194 31499 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:34.902834 31499 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:34.903209 31499 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.904287 31749 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:34.886912 31161 consensus_queue.cc:260] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.906337 31161 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:34.908121 27337 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:34.820808 31815 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.911604 31815 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:34.901928 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 70679.9us
W20260709 13:10:34.915540 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 90577.2us
I20260709 13:10:34.807683 27417 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:34.836028 31807 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:10:34.840523 31793 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:10:34.842063 31732 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:34.846323 31543 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.000s
I20260709 13:10:34.847208 31091 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:34.794937 31524 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.829154 31652 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:34.815903 31710 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:34.827939 31812 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:34.851922 31647 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:34.828176 31811 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.891762 31779 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:34.940393 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:34.890645 31651 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:34.948611 27342 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:10:34.938973 31782 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.005s
I20260709 13:10:34.925458 31749 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:34.958112 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 460537us
I20260709 13:10:34.963549 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:34.953474 31716 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 13:10:34.970242 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:34.970820 27417 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:34.974709 27334 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:34.981432 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:34.983868 27411 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:34.987568 27408 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:34.954614 31812 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:34.968019 31543 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:34.994493 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:34.995563 27410 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:34.956764 31754 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:34.992441 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 340239us
I20260709 13:10:34.979504 31716 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.005407 27413 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:34.990553 31749 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.012074 27417 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:35.013115 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.013906 31647 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:35.014045 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.014328 31647 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.014704 31647 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.015188 31707 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:35.015626 31707 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:34.992386 27160 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.015992 31707 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.017310 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.018813 31727 raft_consensus.cc:2764] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:35.020576 27413 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.023638 31754 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:35.023556 31652 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:35.024549 31807 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:35.025385 31652 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:35.025785 31652 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.025978 31707 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.026652 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:35.027439 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.026783 31652 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.024600 31754 consensus_queue.cc:1243] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:35.028228 31727 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.028471 31652 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.030004 31727 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:35.031759 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:35.032480 31727 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.034329 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.035054 31727 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:35.035427 31091 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.035745 31727 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.036170 31091 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.036819 31727 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.037845 31647 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.039139 31779 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:35.039523 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:35.041141 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.042124 31707 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.043243 31647 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.043606 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.044013 31652 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.044719 31647 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:35.045573 31647 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.045390 31815 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.039156 31091 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.046717 31647 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:35.054312 31753 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 13:10:34.978543 31782 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.055301 27336 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:35.018770 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.045403 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.067703 27233 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.074918 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:35.025835 31807 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:10:35.082472 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.090574 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.091907 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.098975 27334 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:35.063516 31707 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.046876 31784 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.062680 31815 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:35.171758 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.079701 31626 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:35.189620 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:35.193141 28011 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.190528 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.194669 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.088117 31807 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.218509 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:35.219759 27415 raft_consensus.cc:2368] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:35.095947 31782 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:35.218801 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:35.224294 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 156661us
I20260709 13:10:35.225601 27380 leader_election.cc:400] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11.
I20260709 13:10:35.096187 31499 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.234540 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:35.235702 31443 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.255400 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:35.236382 31707 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.253407 31524 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.206888 31799 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:35.233654 31823 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.226303 31131 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.219087 31778 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:35.291471 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 87884.8us
I20260709 13:10:35.293042 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:35.296403 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:35.235006 27334 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:35.308868 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.309573 27334 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.311594 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:35.273896 31710 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.318086 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.291303 31707 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.313191 31825 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:10:35.312449 31499 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.308573 31713 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:35.315487 31801 raft_consensus.cc:2764] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:10:35.247915 31749 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.274653 31823 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.286841 31131 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.321681 31826 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:10:35.351087 31443 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:35.351573 31830 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:35.352900 31826 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:35.353188 31829 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:35.360457 27334 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:35.332728 31713 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.376806 31823 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.378760 31131 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.328768 31707 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.334501 31782 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:35.285563 31799 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.286351 31807 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.385401 27341 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:35.385767 31784 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.387444 31705 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.387528 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.392493 28011 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:35.397778 31837 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.398705 31826 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:35.393378 31801 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:35.404520 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 86463.9us
I20260709 13:10:35.411123 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.411903 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.413288 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.411948 27262 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:10:35.411968 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.414889 27414 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:10:35.419643 31778 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:35.422636 31748 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:35.422650 31798 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.430425 31517 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:35.431680 27408 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:35.433064 27416 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:35.434806 27410 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:35.437839 27413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:10:35.443214 27412 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:35.447677 27160 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 15, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 15 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:35.574393 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.574819 31707 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:35.510342 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 122898us
I20260709 13:10:35.581655 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.582541 31499 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.583341 31718 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:35.584734 31718 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.585186 31718 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.503762 27340 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:35.542326 31647 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:35.587198 27341 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:35.587306 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:35.513301 31823 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.535873 27262 pending_rounds.cc:85] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:10:35.588397 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:35.588387 27262 pending_rounds.cc:107] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:10:35.588639 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:35.589078 27262 raft_consensus.cc:2889] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.589236 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:35.590175 27335 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:35.590343 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.538282 27411 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:35.582979 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.575078 27261 raft_consensus.cc:2376] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:35.577112 31517 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.598544 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:35.568246 31804 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.547871 31748 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.579725 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.580389 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.613138 27260 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.581050 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.614192 27265 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.460330 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:35.590989 27262 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:35.589354 27340 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:35.615069 27334 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:35.594911 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 323586us
W20260709 13:10:35.610287 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 75246.5us
I20260709 13:10:35.494791 31626 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.626356 31517 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.627329 31796 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.643090 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.648526 31796 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.651357 31784 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:35.626879 31626 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.627450 31811 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:35.660142 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:35.504617 31782 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.534374 31837 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.549182 31826 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.680884 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.608130 31499 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:35.638875 31812 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.005s
I20260709 13:10:35.694491 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2548) took 1264 ms. Trace:
I20260709 13:10:35.695523 27342 rpcz_store.cc:276] 0709 13:10:34.429970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.454110 (+ 24140us) service_pool.cc:224] Handling call
0709 13:10:35.691088 (+1236978us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400229a54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:35.694411 (+  3323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133305728}
I20260709 13:10:35.643911 28006 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:35.638024 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:35.636368 27160 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 8, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:35.643882 31836 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:10:35.647492 31718 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.651265 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:35.642970 27165 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 211) took 44964 ms (client timeout 15000 ms). Trace:
I20260709 13:10:35.709842 27334 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:35.655838 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:35.658098 31748 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.621510 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.669100 27411 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:35.713665 27413 raft_consensus.cc:606] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.714056 27413 raft_consensus.cc:614] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:35.623975 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:35.681636 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:35.716365 27340 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:10:35.650940 31796 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.719794 27268 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:35.720213 27268 pending_rounds.cc:85] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
I20260709 13:10:35.720463 27268 pending_rounds.cc:107] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:35.720700 27268 raft_consensus.cc:2889] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.637652 31799 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.693814 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2239) took 1016 ms. Trace:
I20260709 13:10:35.731547 27336 rpcz_store.cc:276] 0709 13:10:34.677239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.677386 (+   147us) service_pool.cc:224] Handling call
0709 13:10:34.683584 (+  6198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.055664 (+372080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.693549 (+637885us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540020ab54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:35.693743 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853887232}
I20260709 13:10:35.621513 31804 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.627059 31517 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:35.652172 31651 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:10:35.710520 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 50469.3us
I20260709 13:10:35.683969 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:35.746245 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 62349.5us
W20260709 13:10:35.724526 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 263678us
I20260709 13:10:35.750593 27231 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.687708 31821 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:35.730463 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106578us
I20260709 13:10:35.621766 31753 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:10:35.756951 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.757731 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:35.635947 31832 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:10:35.756032 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104884us
I20260709 13:10:35.762657 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:35.701279 31789 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:10:35.735285 31091 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:35.771694 31091 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:35.772126 31091 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:35.773322 31848 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:10:35.775460 31789 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:35.742359 31710 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.710340 31812 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.751977 31821 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.701421 31794 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:10:35.768025 31854 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:35.768869 31799 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:35.769265 31517 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:35.820277 31517 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.822484 31499 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:35.822940 31499 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:35.775871 31789 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:35.823874 31499 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.824195 31789 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.825176 31499 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.825860 31789 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.763851 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:35.829275 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65498.9us
I20260709 13:10:35.829645 31846 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:35.764460 31838 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:35.830367 27233 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.831067 31838 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.832337 31838 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.788560 31841 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.836150 31854 consensus_queue.cc:1243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:10:35.838600 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76027.8us
I20260709 13:10:35.730041 31800 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.841506 31800 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.843784 31800 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:35.843779 31821 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.846498 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.846772 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.778355 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:35.779240 27265 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:35.737993 31784 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.786964 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.761829 31748 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:35.759951 31594 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:35.756968 31744 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:35.797564 27260 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:35.798878 27160 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 2 to 7, term changed from 6 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to <none>, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 8 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:35.802635 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.804723 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:35.712431 27165 rpcz_store.cc:269] 0709 13:09:50.678541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:50.679404 (+   863us) service_pool.cc:224] Handling call
0709 13:10:35.642664 (+44963260us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:16.768838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:16.875821 (+106983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:16.875869 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:16.875886 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:16.924078 (+ 48192us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:16.938591 (+ 14513us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:16.946232 (+  7641us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:10:17.258652 (+312420us) tablet.cc:701] Row locks acquired
0709 13:10:17.258710 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:10:17.258888 (+   178us) write_op.cc:270] Start()
0709 13:10:17.259079 (+   191us) write_op.cc:276] Timestamp: P: 1783602617258818 usec, L: 0
0709 13:10:17.259106 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:10:17.259813 (+   707us) log.cc:844] Serialized 3649 byte log entry
0709 13:10:17.741798 (+481985us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:18.499125 (+757327us) op_driver.cc:464] REPLICATION: finished
0709 13:10:20.092673 (+1593548us) write_op.cc:301] APPLY: starting
0709 13:10:20.092763 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:20.185707 (+ 92944us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:20.185732 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:20.192429 (+  6697us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:20.192667 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:10:20.192715 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:20.192999 (+   284us) log.cc:844] Serialized 71 byte log entry
0709 13:10:20.276179 (+ 83180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.276318 (+   139us) write_op.cc:454] Released schema lock
0709 13:10:20.276370 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:20.276889 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:20.276918 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1475677,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":1547872,"apply.run_cpu_time_us":12615,"apply.run_wall_time_us":184163,"num_ops":9,"prepare.queue_time_us":181060,"prepare.run_cpu_time_us":39838,"prepare.run_wall_time_us":591933,"raft.queue_time_us":530381,"raft.run_cpu_time_us":31495,"raft.run_wall_time_us":1482143,"replication_time_us":1154992,"spinlock_wait_cycles":13000960,"thread_start_us":1858436,"threads_started":5,"wal-append.queue_time_us":248826,"wal-append.run_cpu_time_us":69419,"wal-append.run_wall_time_us":2861431}]]}
I20260709 13:10:35.847102 27268 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:35.849936 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71662.9us
I20260709 13:10:35.850449 27383 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:35.852253 28012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:35.852429 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.862397 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:35.855608 27233 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.764200 31707 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:10:35.864694 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.865643 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:35.847523 31853 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:35.875473 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.876286 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.877087 27260 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:35.873723 31823 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:35.853264 31854 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:35.884861 27233 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:35.885421 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:35.855129 31594 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.858500 31841 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:35.868791 31794 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.870775 31710 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.898909 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.888054 31853 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.870666 31799 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:35.883908 31823 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:35.879576 31778 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:35.906304 27261 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 8.
I20260709 13:10:35.896070 31594 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:35.920375 27413 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:35.918848 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.919241 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:35.923727 27261 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.917740 31091 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.926157 27260 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:35.897323 31841 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:35.885429 31744 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:35.928573 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.929297 27343 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:10:35.944883 27343 pending_rounds.cc:85] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:10:35.945128 27343 pending_rounds.cc:107] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:10:35.945353 27343 raft_consensus.cc:2889] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.945642 27343 pending_rounds.cc:107] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:35.945868 27343 raft_consensus.cc:2889] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:35.932921 31727 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:35.925217 31782 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:35.902200 31784 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:35.896291 31856 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:35.959403 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:35.948024 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.947973 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:35.965476 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.961218 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.956300 27413 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:35.907514 31711 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:35.962839 27266 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:35.961748 27261 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:35.927282 31801 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:35.922881 31710 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.943773 31841 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:35.927798 31778 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:35.925349 31799 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:35.975051 27409 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:35.969244 27260 raft_consensus.cc:2410] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:35.969566 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:35.971850 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.973222 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:35.904405 31794 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.962682 31856 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:35.982965 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.943447 31443 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:35.983996 27261 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:35.947495 31727 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:35.962977 31782 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:35.962577 31837 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.926224 31713 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.968711 31801 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.998097 27261 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:35.991405 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:35.995100 28015 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:35.999980 28012 raft_consensus.cc:606] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:36.000458 28012 raft_consensus.cc:614] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:35.969038 31711 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.981158 31804 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.007369 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:35.917814 31853 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.010426 27260 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:36.010360 31763 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:36.012900 31782 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:35.990824 31856 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.013370 31713 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:36.001893 31778 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:35.990978 31784 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:36.020155 27260 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:36.021237 31826 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.023473 31812 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:35.995215 31443 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.029543 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:36.008706 31711 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:35.983518 31716 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:10:36.027894 31784 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:36.030010 31794 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:36.002477 31801 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:36.030041 31851 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.285s	user 0.003s	sys 0.000s
I20260709 13:10:36.044124 31091 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:36.039778 31784 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.047577 27268 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:10:36.048643 31858 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:10:36.049062 27268 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:36.052762 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 167984us
I20260709 13:10:35.946877 27160 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.991775 31823 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.069785 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:36.070433 27409 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.070528 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:36.073614 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.052708 31131 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:36.031821 31782 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.090090 27417 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.091714 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.092535 27417 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:36.093689 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.098757 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.099521 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.099726 27408 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:36.098680 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:36.032274 31727 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.112917 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:36.107357 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.108006 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.115379 27410 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:36.115548 27409 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:36.037246 31799 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.110050 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:36.067219 31705 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:36.132400 31705 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:36.132835 31705 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.133183 31705 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:36.118026 27416 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:36.114424 27413 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
W20260709 13:10:36.116696 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 123855us
I20260709 13:10:36.138262 31790 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:36.138746 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 637) took 1341 ms. Trace:
I20260709 13:10:36.139181 27343 rpcz_store.cc:276] 0709 13:10:34.797538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.876122 (+ 78584us) service_pool.cc:224] Handling call
0709 13:10:34.877717 (+  1595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.957977 (+1080260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.138493 (+180516us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003309d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:36.138659 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417661312}
I20260709 13:10:36.139671 31790 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.140172 31790 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:36.141017 31790 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.142236 31790 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.143654 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.147081 31869 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:36.103523 31812 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.127518 27160 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.128897 31727 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:36.114396 31443 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:36.130723 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.151083 27980 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.050593 31710 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.117506 31823 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:36.157562 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 184568us
I20260709 13:10:36.120939 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.168005 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.172171 27413 raft_consensus.cc:2410] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:10:36.170328 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.148675 31782 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:36.147323 31744 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.151998 31854 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:36.202001 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:36.157328 31773 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.211086 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:36.171056 31091 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:36.220412 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 89792.4us
I20260709 13:10:36.225711 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.220274 27383 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:36.222002 27262 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:36.203354 31838 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.231383 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:36.234647 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.146905 31705 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.239387 31873 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:36.162154 31812 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.246320 27265 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:10:36.242547 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.248153 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:36.250434 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49186.4us
I20260709 13:10:36.251273 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:36.252630 27383 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:36.259050 27262 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:36.265486 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:36.244386 31443 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:36.271379 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:36.274391 27262 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:10:36.274775 27262 pending_rounds.cc:85] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 9
I20260709 13:10:36.274996 27262 pending_rounds.cc:107] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:10:36.275252 27262 raft_consensus.cc:2889] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.281255 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:36.214178 31871 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:10:36.255977 31782 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:36.247287 31870 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:36.272708 31850 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.625s	user 0.004s	sys 0.009s
W20260709 13:10:36.290225 31872 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:10:36.147389 31837 consensus_queue.cc:1175] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:10:36.292186 31852 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.600s	user 0.003s	sys 0.000s
I20260709 13:10:36.293387 27267 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:36.294739 27267 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:36.283505 31879 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:36.295608 31879 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:36.295964 31879 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:36.297272 27265 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:36.298947 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:36.272117 31744 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.242933 31841 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.314007 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:36.317586 27267 raft_consensus.cc:2410] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:10:36.314162 27264 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:36.320070 31091 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:36.307873 31718 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:36.309798 31778 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:36.333307 27261 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.272001 31838 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:36.279101 31594 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.314990 31131 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:36.328943 31789 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.004s
I20260709 13:10:36.340090 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:36.337396 31784 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.343271 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:36.344460 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 91903.1us
I20260709 13:10:36.346345 27264 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.352274 27266 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.326432 31856 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.334463 31782 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:36.229575 27160 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.362792 27266 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:36.363265 28011 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:36.365906 31884 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.370565 27266 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:36.372805 27408 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:36.372560 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91385.3us
I20260709 13:10:36.374595 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:36.376916 27266 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.329654 31801 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:36.382097 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 576567us
I20260709 13:10:36.304594 31854 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.351718 31713 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.384686 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.338495 31875 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:10:36.391501 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 525935us
I20260709 13:10:36.400743 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:36.402742 27308 leader_election.cc:400] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:36.396459 27334 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:36.396919 27339 raft_consensus.cc:1217] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-12.10]   Dedup: 7.8->[9.9-12.10]
I20260709 13:10:36.403048 27308 leader_election.cc:403] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:36.403326 27339 pending_rounds.cc:85] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:10:36.403586 27339 pending_rounds.cc:107] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:10:36.403806 27339 raft_consensus.cc:2889] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:36.397424 27340 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:36.397568 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:36.397964 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:36.399463 27343 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:36.399646 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:36.387780 27415 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 13:10:36.456795 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.499450 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.505152 27334 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:36.404806 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:36.510489 27334 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:36.516014 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:36.516776 27343 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:36.520680 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:36.389885 31884 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.532517 27342 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:36.392757 31873 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:36.384601 31543 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
W20260709 13:10:36.539146 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 137899us
I20260709 13:10:36.401825 31713 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.546878 27160 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.548187 31713 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:36.548863 27160 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 6 to 8, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 8 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:36.505406 31443 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:36.550876 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 152189us
I20260709 13:10:36.384660 31885 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.157s
I20260709 13:10:36.392174 31753 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 13:10:36.551716 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:36.514312 31749 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:36.560541 27306 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.513458 31798 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.404944 31800 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
W20260709 13:10:36.546947 31882 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:10:36.536749 31812 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:36.584069 31883 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:36.538481 31705 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.576175 27337 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:36.560742 31543 consensus_queue.cc:1243] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:36.577898 31749 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:36.580350 31499 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.003s
I20260709 13:10:36.581332 31784 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:36.566200 31782 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.595053 27264 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
W20260709 13:10:36.596416 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 221939us
W20260709 13:10:36.563709 31868 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:10:36.545022 31131 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:36.561012 31517 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:36.587106 31773 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:36.638547 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.647672 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:36.650846 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 98943.6us
I20260709 13:10:36.596025 31790 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:36.603454 31748 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.609432 31888 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:36.610224 31753 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:36.610066 31543 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:36.609326 31789 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:36.591449 31652 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:10:36.694092 31878 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:10:36.715556 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:36.610075 31798 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:10:36.660137 31841 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.691350 31432 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:10:36.758000 31838 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:36.694841 31790 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.716266 27160 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 3 to 8, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.764653 27160 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 10, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.727308 27264 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:36.730512 31713 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:36.732426 31131 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.733794 31801 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:36.696081 31443 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:36.737692 31823 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:10:36.715476 31707 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:36.743259 31748 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
W20260709 13:10:36.745661 31881 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:10:36.746150 31900 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:36.660521 31651 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.775606 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 215131us
I20260709 13:10:36.703409 31870 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:10:36.722193 31867 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.457s	user 0.000s	sys 0.003s
W20260709 13:10:36.783385 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63663.2us
I20260709 13:10:36.662968 31888 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:36.661550 31499 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:36.692546 31753 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:36.839345 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.734956 31778 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:36.786417 31713 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:36.827790 31902 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:36.824719 31651 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.714876 31727 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
W20260709 13:10:36.830777 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 483448us
I20260709 13:10:36.794858 31594 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:36.714073 31789 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.832360 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2542) took 1388 ms. Trace:
W20260709 13:10:36.840206 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.840755 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.852763 27259 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.853859 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:36.825001 31856 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:36.865123 28006 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.006s
I20260709 13:10:36.897249 28006 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:36.867551 31877 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:10:36.851558 31778 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:36.871855 27411 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:36.878774 27416 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:36.877997 27268 rpcz_store.cc:276] 0709 13:10:35.444268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.049840 (+605572us) service_pool.cc:224] Handling call
0709 13:10:36.050133 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.050354 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:36.067300 (+ 16946us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.328625 (+261325us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b18003fc6a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:10:36.826961 (+498336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.827029 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.827106 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.832110 (+  5004us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.832285 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16713,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":111,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"spinlock_wait_cycles":15960960,"thread_start_us":498015,"threads_started":1}
I20260709 13:10:36.851219 31753 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:36.860001 31713 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:36.851979 31718 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.907681 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:36.915987 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 200497us
I20260709 13:10:36.917209 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:36.877285 31900 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.919309 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:36.927562 31888 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.928260 31856 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:36.928768 31888 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:36.928838 31856 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:36.930100 31856 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.711942 31873 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.856030 31499 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.940021 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:36.940524 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:36.867484 31755 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:10:36.941800 27343 raft_consensus.cc:2410] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:36.922039 31763 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:36.958249 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:36.963317 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:36.980422 31789 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.940924 31748 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.981714 31748 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:36.983068 31713 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:36.983944 31895 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:36.985244 31651 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.988505 31499 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.923719 31718 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:36.997289 31718 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:37.000389 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.819562 27160 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:37.004367 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57957.9us
I20260709 13:10:37.004952 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.005713 27268 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:37.031631 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 628940us
I20260709 13:10:36.956228 31898 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:36.955789 31763 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:37.045511 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.048732 27268 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:37.042363 31879 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.746s	user 0.002s	sys 0.013s
I20260709 13:10:36.985226 31713 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:36.941495 31900 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.057291 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.052614 31763 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.047643 31903 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.083974 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 641) took 1675 ms. Trace:
I20260709 13:10:37.084440 27260 rpcz_store.cc:276] 0709 13:10:35.408833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.029054 (+620221us) service_pool.cc:224] Handling call
0709 13:10:36.030338 (+  1284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.030669 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.030709 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.034552 (+  3843us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.223079 (+188527us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:36.232437 (+  9358us) log.cc:844] Serialized 14 byte log entry
0709 13:10:36.243848 (+ 11411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.243920 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.083762 (+839842us) raft_consensus.cc:1685] finished
0709 13:10:37.083782 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.083913 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14512,"prepare.queue_time_us":9018,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":14659,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":7507,"thread_start_us":144333,"threads_started":1,"wal-append.queue_time_us":212605}
I20260709 13:10:37.073892 31749 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.097558 31790 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.100062 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 553) took 1239 ms. Trace:
I20260709 13:10:37.100589 28011 rpcz_store.cc:276] 0709 13:10:35.860445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.860567 (+   122us) service_pool.cc:224] Handling call
0709 13:10:35.883811 (+ 23244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.364966 (+481155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.099739 (+734773us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400492fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.099980 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102200192}
I20260709 13:10:37.070833 31879 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.048022 31778 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.057987 31898 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.104835 31846 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:37.111920 31846 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:37.112313 31846 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:37.113188 31846 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.114507 31846 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.116726 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:37.118392 31908 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:10:37.121867 31807 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.123986 31821 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:37.113636 31898 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.106779 31748 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.125324 31778 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.127504 31900 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.086035 31903 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.129940 31903 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:37.131341 31711 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.090s	user 0.009s	sys 0.005s
I20260709 13:10:37.132575 31711 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.134060 27266 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:37.140273 31716 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.143998 31716 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.146680 31716 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:37.148069 31880 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.886s	user 0.000s	sys 0.014s
I20260709 13:10:37.147922 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.149533 27266 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:37.135094 31711 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.161271 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1643) took 1753 ms. Trace:
I20260709 13:10:37.155035 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.173674 27259 rpcz_store.cc:276] 0709 13:10:35.407466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.993478 (+586012us) service_pool.cc:224] Handling call
0709 13:10:36.008099 (+ 14621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.886099 (+878000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.161008 (+274909us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b540024b8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.161199 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942104320}
I20260709 13:10:37.164862 31879 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:37.142684 31744 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.003s
W20260709 13:10:37.171804 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.136530 27160 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 2 to 7, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 7 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:37.179610 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1645) took 1771 ms. Trace:
W20260709 13:10:37.180274 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 123346us
I20260709 13:10:37.182253 27261 rpcz_store.cc:276] 0709 13:10:35.408086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.008833 (+600747us) service_pool.cc:224] Handling call
0709 13:10:36.009294 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.333831 (+324537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.179385 (+845554us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54003340d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.179553 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":744514944}
I20260709 13:10:37.180666 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.185096 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:37.186321 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 61923.5us
I20260709 13:10:37.188282 31912 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:37.192281 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2207) took 1084 ms. Trace:
I20260709 13:10:37.192682 27408 rpcz_store.cc:276] 0709 13:10:36.107815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.121879 (+ 14064us) service_pool.cc:224] Handling call
0709 13:10:36.122196 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.378019 (+255823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.192033 (+814014us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003a4b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.192215 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575874432}
I20260709 13:10:37.196364 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1771) took 1543 ms. Trace:
I20260709 13:10:37.209177 27414 rpcz_store.cc:276] 0709 13:10:35.652871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.652985 (+   114us) service_pool.cc:224] Handling call
0709 13:10:37.196120 (+1543135us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54000be5d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:37.196273 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927382912}
I20260709 13:10:37.178339 31790 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.186960 31744 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:37.194015 31091 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:37.219784 31897 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.194507 31900 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.227837 31897 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.227957 31900 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.230079 31897 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:37.219784 31921 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:10:37.230361 31900 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.193921 31773 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.231142 31773 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.231587 31773 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.232054 31837 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.232595 31837 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:37.225942 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.235466 31837 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.226651 31763 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.236953 28011 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.223495 31902 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.228041 31091 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:37.194068 31713 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:37.210513 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.211529 31898 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.247100 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.178896 31753 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.254206 31753 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.185755 31716 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:10:37.256784 31749 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.257434 31716 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.257858 31716 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:37.258006 31763 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.257434 31749 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.259217 31543 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.259343 31898 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.259747 31543 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.260926 31749 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.261438 31898 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.261768 31543 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.262306 31543 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:37.263312 31790 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.263818 31790 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.263856 31912 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:37.264436 31790 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.265080 31912 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.236129 27160 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.238236 31902 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.186054 31718 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:10:37.275985 31718 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:37.276383 31718 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:37.277329 31718 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.278644 31718 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:37.279740 31790 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.282567 31790 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.243916 31652 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:37.279762 31918 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:37.283437 31652 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.285451 31652 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.269371 31902 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.274371 31713 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.262976 31898 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.292754 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:37.293365 27262 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.262776 31543 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.298573 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.299839 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.299135 28012 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:37.301640 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:37.288719 31874 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.021s	user 0.014s	sys 0.000s
I20260709 13:10:37.287153 31846 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.295768 31898 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.258750 31716 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.307093 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.312815 28012 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:37.314939 31716 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.316143 31713 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.316321 31898 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.321779 27262 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:37.323269 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.314016 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.300808 31652 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:37.325428 31898 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:37.325428 31790 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:37.331722 31898 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.332341 31898 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.335495 31790 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:37.268158 27160 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 6 to 8, now has a pending config: VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129), VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130), VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131), NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:10:37.307739 31773 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.319943 31846 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:37.403796 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.327099 31091 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.455010 31790 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.350936 31853 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.459748 31853 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.462546 31853 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.465945 31543 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.336792 31652 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.467904 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.469164 31652 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:37.472637 31913 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:10:37.473357 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.473589 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.474303 28012 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:37.474510 31773 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.476030 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.477573 31744 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:37.477952 31744 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.478266 31744 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.481776 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:37.482839 27262 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.562922 27262 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:37.572111 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.568907 31652 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.593672 27339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:10:37.594542 27339 raft_consensus.cc:606] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Received request to transfer leadership to TS d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.594967 27339 raft_consensus.cc:614] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:37.569404 31838 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.569188 31713 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:37.573173 31912 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.574266 31543 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.574692 31626 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:37.585084 31773 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:37.581028 31748 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.605486 31713 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.620545 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:37.621649 31710 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:37.622181 31710 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:37.610849 31543 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.623251 28009 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:37.623703 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2198) took 1537 ms. Trace:
I20260709 13:10:37.624116 27415 rpcz_store.cc:276] 0709 13:10:36.085954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.088774 (+  2820us) service_pool.cc:224] Handling call
0709 13:10:36.089243 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:36.503539 (+414296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.623385 (+1119846us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54000f1c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.623633 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":681671040}
I20260709 13:10:37.625870 31543 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.612015 31626 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.625664 31710 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:37.614270 31866 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.373s	user 0.011s	sys 0.007s
W20260709 13:10:37.647571 31892 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.828s	user 0.004s	sys 0.010s
W20260709 13:10:37.650354 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:37.651742 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.03596e+06us
I20260709 13:10:37.652565 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.655869 31891 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.616928 31773 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:37.657421 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.657370 31773 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.599783 31652 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.661022 31763 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:37.662045 27259 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:37.662734 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 682) took 1492 ms. Trace:
I20260709 13:10:37.661022 31652 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.663066 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.663769 27266 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:37.664261 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.664546 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.666039 27260 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:10:37.666249 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 797324us
I20260709 13:10:37.667229 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 681) took 1497 ms. Trace:
I20260709 13:10:37.667073 31893 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.614636 31748 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.667627 27412 rpcz_store.cc:276] 0709 13:10:36.169421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.205373 (+ 35952us) service_pool.cc:224] Handling call
0709 13:10:36.221932 (+ 16559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.241330 (+ 19398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.241365 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.256241 (+ 14876us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.383088 (+126847us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:36.831846 (+448758us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.666930 (+835084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.666999 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.667036 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:37.667051 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.667150 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834749,"prepare.queue_time_us":228323,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3514,"raft.queue_time_us":842988,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":6075,"thread_start_us":535060,"threads_started":2,"wal-append.queue_time_us":339528}
I20260709 13:10:37.669618 31885 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:37.669893 31748 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.670444 31782 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.670631 31799 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:37.670969 31782 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:37.671900 31782 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.664283 27267 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:37.672927 31517 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:37.605588 31838 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.673310 31517 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:37.674727 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.608358 31912 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.675673 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.676728 27264 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:37.676877 27233 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.677775 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.678438 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.679046 27415 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:37.674211 31517 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.680011 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.680450 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.680891 27416 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.681609 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:37.682196 28009 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:37.683446 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:37.684146 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:37.643703 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:37.663239 27413 rpcz_store.cc:276] 0709 13:10:36.170126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.216717 (+ 46591us) service_pool.cc:224] Handling call
0709 13:10:36.217078 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.217350 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:36.504719 (+287369us) log.cc:844] Serialized 14 byte log entry
0709 13:10:37.662411 (+1157692us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.662475 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:37.662529 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.662581 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.662681 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1058501,"prepare.queue_time_us":342293,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":1018138,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":333991,"threads_started":2,"wal-append.queue_time_us":315449}
I20260709 13:10:37.672426 31885 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.692821 31652 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.694269 27309 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:37.680334 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.698050 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.677723 31905 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:37.704190 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.700519 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.701083 31652 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.702346 31517 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.703915 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.705475 27408 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.713284 27412 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:37.612226 31898 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.716739 27416 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:37.690917 31798 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:37.694571 31651 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.698575 31748 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:37.693425 31647 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:37.693671 31432 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:37.700169 31710 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.719990 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:37.730561 31939 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:37.681401 31543 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:10:37.709491 31784 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.753763 27408 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:37.750837 31929 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:37.718772 31912 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.757480 31929 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:37.759038 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.741657 31651 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.763070 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:37.764842 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:37.782526 27336 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:37.783814 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:37.759815 27414 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:37.703291 31885 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.786753 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.787611 27414 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:37.711113 31930 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:10:37.789040 27336 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:37.792022 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.727617 31807 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:37.794387 27414 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:37.756029 31647 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.796378 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.797293 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.789780 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.712102 31905 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.727272 31800 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:10:37.799496 27409 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:37.811304 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.799741 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.796108 27338 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.799527 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:37.806733 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.813619 27414 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:37.788810 31651 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:37.758003 31929 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:37.818367 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:37.819031 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.819288 27341 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:37.742291 31798 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.824488 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.828497 31838 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.829149 31838 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.829691 31838 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.832240 31870 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:37.832679 31870 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:37.833204 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.833495 31870 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.834532 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:37.833842 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 127738us
I20260709 13:10:37.837388 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.836571 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.839645 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.799991 31543 consensus_queue.cc:1243] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:37.800443 31784 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.858757 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:37.836699 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.845906 27409 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:37.849135 27410 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:37.797462 31846 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.751668 31432 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:37.859778 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 131770us
I20260709 13:10:37.871628 27268 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:37.863046 27260 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:37.863617 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:37.868393 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:37.874915 27337 raft_consensus.cc:2410] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:37.876471 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.792982 31499 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:37.877106 27409 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:37.863912 27266 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:37.888691 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:37.889093 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.889951 27266 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:37.881615 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:37.892079 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 185277us
I20260709 13:10:37.795858 31753 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:10:37.843981 31903 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:37.898562 27260 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:37.900935 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.903355 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:37.912632 27266 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:37.920838 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.924232 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.926519 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.906752 27338 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:37.813405 31647 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:37.944453 31933 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:10:37.945310 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.946309 31647 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.946604 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:37.932284 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.948290 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:37.949018 31651 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:37.949425 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.950695 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:37.951575 31938 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:37.952052 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.952828 27264 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:37.953215 31753 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:37.953660 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.955610 31941 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.956257 31941 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:37.957100 31902 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:37.958492 31941 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.962646 27343 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:37.975629 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.955762 31524 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:37.940182 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.943334 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:37.954876 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.963824 31652 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.965940 31798 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.909513 31903 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:37.977196 31838 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.976227 31905 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:37.901669 31626 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:37.980854 27343 pending_rounds.cc:85] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 5
I20260709 13:10:38.004091 27343 pending_rounds.cc:107] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:10:38.004499 27343 raft_consensus.cc:2889] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:37.953749 31753 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.978207 31901 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.202s	user 0.009s	sys 0.004s
I20260709 13:10:37.929963 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.968051 27340 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:37.964847 27335 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:10:37.983131 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:37.992415 27414 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:37.994414 27268 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:37.995565 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:37.859311 31899 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:10:37.998723 27341 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:37.999967 27266 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:10:37.992152 31744 consensus_meta.cc:287] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 13:10:37.951078 31651 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:37.984395 31524 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.011982 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:37.993798 31748 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:38.015604 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69066us
I20260709 13:10:38.016640 27416 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:38.051425 27414 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.051990 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.017194 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.053452 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.054116 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:37.931105 31891 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:38.020026 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 180434us
I20260709 13:10:38.030344 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.064060 27260 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:37.876169 31784 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.040926 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:37.992991 31938 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:38.043331 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 365397us
I20260709 13:10:38.079375 31626 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:38.080438 31626 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:38.081573 31626 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:38.081957 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.059358 27337 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:38.066157 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:38.089296 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.091189 27411 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.061721 31524 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.073050 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.015825 31753 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.095650 27416 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.028443 31755 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.062175 31798 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.083019 31838 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:38.015731 31902 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.085124 31930 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:38.085844 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.057797 27266 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:38.101430 27414 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:38.101913 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.104120 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:38.104849 28009 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.089411 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.091550 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.055891 31744 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:38.092201 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.096412 27268 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:38.094867 31626 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.083572 31846 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:38.029358 31652 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:38.100098 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.108758 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.114200 27414 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.112434 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.115298 27266 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:38.116981 27266 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:38.107498 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.111557 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:38.119979 28012 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.069072 31763 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.090135 31898 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.126160 31711 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.108285 31942 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.130586 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44818.3us
I20260709 13:10:38.172435 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.131295 31893 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.131955 31744 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:38.132576 31904 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.045s	user 0.004s	sys 0.008s
I20260709 13:10:38.112776 31798 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.123013 31888 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:10:38.132958 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.133419 31626 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.133862 31884 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.108156 31131 raft_consensus.cc:2764] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:10:38.123368 31652 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:38.211520 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78625.6us
I20260709 13:10:38.123196 31846 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:38.134359 31778 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:38.230185 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.135191 31894 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:38.199357 31711 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:38.136523 27260 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:38.145372 28012 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:38.164435 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 655) took 1833 ms. Trace:
I20260709 13:10:38.122088 31755 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.102900 31885 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:38.177793 27411 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:38.245553 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.186479 27414 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:38.247257 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.100876 31930 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:38.251463 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:38.233533 31947 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:10:38.209865 28009 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:38.219193 31890 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:38.219041 31652 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.195956 31893 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.223433 31948 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:38.091671 31891 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.246865 31937 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.172983 31823 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:38.226568 27268 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:38.227824 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 320082us
I20260709 13:10:38.131989 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.271901 27416 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.272867 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.273464 27416 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:38.273543 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.101351 31838 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:38.236330 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:38.122298 31902 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.276166 31902 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.276758 31902 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.277220 31902 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:38.278096 31902 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.103076 31903 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.235522 27265 rpcz_store.cc:276] 0709 13:10:36.331354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.394124 (+ 62770us) service_pool.cc:224] Handling call
0709 13:10:36.394495 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:36.549222 (+154727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.549257 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:36.549815 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.650709 (+100894us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:36.650750 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.627529 (+976779us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001b8fd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:37.627577 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.977437 (+349860us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:38.164119 (+186682us) raft_consensus.cc:1685] finished
0709 13:10:38.164149 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.164351 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2744,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7694,"spinlock_wait_cycles":369941248,"thread_start_us":100510,"threads_started":1,"wal-append.queue_time_us":172911}
I20260709 13:10:38.276206 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:38.249586 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.250650 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.252153 27411 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:38.255249 31890 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:38.249810 31517 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:10:38.261636 27263 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:10:38.262358 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 179021us
W20260709 13:10:38.295073 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.631s (SENT) [suppressed 17 similar messages]
I20260709 13:10:38.166903 31799 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:10:38.183771 31942 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.279641 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.207062 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.304143 27409 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:38.283896 27414 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
W20260709 13:10:38.304633 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 97664.2us
I20260709 13:10:38.293157 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.305238 31953 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.295593 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.305446 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.306151 28012 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:38.301533 27341 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:38.306810 27341 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:38.306514 31838 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.305696 31953 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:38.307127 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.308668 31443 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.309072 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.309850 31443 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.307351 31885 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.311455 31800 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.307510 31938 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:38.311972 31800 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.312417 31938 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:38.312628 31893 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.307545 27341 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.313133 31711 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.313319 31938 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.314108 27341 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.305248 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.315835 27414 raft_consensus.cc:2376] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15. Re-sending same reply.
I20260709 13:10:38.316704 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.317703 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.318610 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.307649 31884 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:10:38.319813 31951 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:38.320931 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.321240 31891 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.307819 31953 raft_consensus.cc:3060] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.322028 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.322642 27414 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:38.323449 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.324679 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.328220 27260 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:38.329773 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.331200 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.332280 27414 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:38.334370 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:38.335317 28012 raft_consensus.cc:2393] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 8: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:38.286501 31798 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.294126 31949 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.342103 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.331723 27341 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:38.344585 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.294705 31890 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.299489 31854 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.302184 31903 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.307557 31838 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.287278 31888 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:10:38.360894 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.375535 28009 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:38.377094 28012 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:38.377183 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.348925 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.363979 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 560) took 1256 ms. Trace:
I20260709 13:10:38.391752 28011 rpcz_store.cc:276] 0709 13:10:37.107836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.107967 (+   131us) service_pool.cc:224] Handling call
0709 13:10:37.108267 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.237395 (+129128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.363735 (+1126340us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54004c5754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:38.363925 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295520000}
I20260709 13:10:38.363049 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 557) took 1430 ms. Trace:
I20260709 13:10:38.393170 28015 rpcz_store.cc:276] 0709 13:10:36.933098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.933477 (+   379us) service_pool.cc:224] Handling call
0709 13:10:36.955856 (+ 22379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:36.956320 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.956382 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:36.968902 (+ 12520us) log.cc:844] Serialized 52 byte log entry
0709 13:10:37.964540 (+995638us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b18004b6280. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:38.172479 (+207939us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:38.172518 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.172593 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.346811 (+174218us) raft_consensus.cc:1685] finished
0709 13:10:38.346839 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.362971 (+ 16132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":8207,"spinlock_wait_cycles":11812608,"thread_start_us":207726,"threads_started":1,"wal-append.queue_time_us":1261599}
I20260709 13:10:38.391304 28012 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:38.396385 31949 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:38.397342 31949 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.400441 28008 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:38.400583 31800 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.389966 31849 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:38.349574 31826 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:38.412205 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:38.416213 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 142756us
I20260709 13:10:38.362703 31626 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.423398 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.417399 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:38.417695 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.418633 31891 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:38.293954 31846 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.414830 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:38.428665 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.340586 31929 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.391589 31854 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:38.419363 31826 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:38.437851 28006 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 556) took 2405 ms (client timeout 1631 ms). Trace:
I20260709 13:10:38.417914 31941 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:38.439543 28006 rpcz_store.cc:269] 0709 13:10:36.027764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.029261 (+  1497us) service_pool.cc:224] Handling call
0709 13:10:38.431930 (+2402669us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54002e45d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:38.432051 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736403840}
I20260709 13:10:38.428611 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:38.440057 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 162728us
I20260709 13:10:38.431561 31799 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.329643 31930 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.425712 31517 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:38.441077 31826 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.436672 31884 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:10:38.447826 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 152805us
I20260709 13:10:38.436512 31893 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:38.456130 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.460197 31846 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.495851 28006 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:38.497862 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.485924 31524 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.472563 31517 consensus_queue.cc:1243] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:38.499213 27414 raft_consensus.cc:2410] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:38.501910 27260 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:38.505522 27416 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:38.508440 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.526278 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.515194 27414 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:10:38.565532 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 121832us
W20260709 13:10:38.565800 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 188702us
W20260709 13:10:38.507602 31962 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:10:38.499779 31710 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.001s
I20260709 13:10:38.566514 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:38.507999 31954 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:10:38.567764 27414 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:38.497537 31755 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.501322 31524 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.574045 27264 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:38.509804 31890 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.580066 31890 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:38.581947 27414 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:10:38.582376 31870 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.583544 27414 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:38.566552 31902 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.591499 31902 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.592681 27410 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:38.593881 31902 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:38.576687 31965 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:38.500474 31784 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:38.502030 31798 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.595778 31798 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.597422 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.598335 31902 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:38.598935 31902 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.599360 31902 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.599416 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.600343 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.601006 31899 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:38.601140 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.601637 31899 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:38.601953 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.602156 31755 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.602536 31755 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.602741 31651 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:38.602936 31755 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.603150 31651 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.577010 31652 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.605115 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.557289 31854 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.628116 31838 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.584918 31929 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.586280 31782 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.590463 31753 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.637833 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.638935 27339 raft_consensus.cc:2410] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:38.594384 27410 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:38.605115 27414 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:10:38.641781 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.606387 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.575855 31942 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.613027 27261 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:38.614789 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.643373 27266 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:38.644430 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:38.645844 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.646536 27266 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.624696 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:38.647569 27338 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.603618 31651 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.650302 27340 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:38.650712 27340 pending_rounds.cc:85] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 6
I20260709 13:10:38.650944 27340 pending_rounds.cc:107] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:38.651186 27340 raft_consensus.cc:2889] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.651579 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.652269 27414 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 7.
I20260709 13:10:38.653321 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.510578 31432 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.601994 31899 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.628906 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.656405 27308 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:38.629670 31958 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:10:38.630409 31652 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.630577 31524 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:38.627900 31710 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.636499 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:38.518352 31968 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.659816 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.656522 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:38.672911 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 66608us
I20260709 13:10:38.677340 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.681514 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.684828 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:38.686388 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.687736 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.688575 27266 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.671634 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.633002 31838 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.658140 31763 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.694356 31763 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.695047 31838 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:38.695739 31912 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:38.681682 31432 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:38.684145 31879 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.658419 31784 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:10:38.681384 31870 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.687028 27261 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:38.705998 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:38.702122 31798 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.704092 27410 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:38.669907 31899 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.695047 27414 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:38.709466 27414 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:38.702768 27259 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:38.711460 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.713328 27338 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:38.675076 31897 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:38.674381 31929 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.721311 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.722635 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.723502 27337 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:38.725432 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.723518 27335 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:38.727964 27339 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:38.674767 31524 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.710216 27414 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.733023 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.733529 27414 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.733729 27410 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.696592 31763 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.737636 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.738804 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:38.740850 27341 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:38.742503 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:38.727964 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 161594us
I20260709 13:10:38.744356 27335 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:38.744473 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:38.745982 27340 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:38.750715 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.751885 27338 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:38.738209 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.756970 27337 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:38.708873 31968 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:38.711906 31912 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.712101 31432 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.723788 31800 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.776552 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.747459 31798 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:38.780408 27414 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:38.732215 31897 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:38.781734 28011 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.735445 31977 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.736064 31524 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.756819 31942 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.761925 31870 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.779369 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.735674 31710 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:10:38.790134 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.764261 31879 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.747334 31910 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:10:38.798256 27410 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:38.827445 27410 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:38.743418 31773 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:10:38.801077 28009 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:38.801239 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.798413 27341 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:10:38.735888 31652 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:10:38.840425 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:38.787506 27414 pending_rounds.cc:85] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 9
I20260709 13:10:38.792316 31897 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:38.785254 31798 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:38.771096 31838 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:10:38.842415 27414 pending_rounds.cc:107] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:38.856756 27414 raft_consensus.cc:2889] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.776012 31912 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.782948 31432 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.790302 31800 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:38.904038 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58375.1us
I20260709 13:10:38.834975 31879 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:38.910066 27341 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 13:10:38.903776 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 104981us
I20260709 13:10:38.912703 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2222) took 1104 ms. Trace:
I20260709 13:10:38.913123 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:38.913017 27416 rpcz_store.cc:276] 0709 13:10:37.808538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.571301 (+762763us) service_pool.cc:224] Handling call
0709 13:10:38.634511 (+ 63210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.634782 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:38.664198 (+ 29416us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.912373 (+248175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.912433 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:38.912494 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.912554 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.912652 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33432,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":237891,"threads_started":1}
I20260709 13:10:38.914186 27261 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:38.852033 31798 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:38.917687 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.918407 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.918423 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:38.806617 31870 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.926292 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:38.932483 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.928048 31898 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.924886 27337 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:38.940534 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.929482 31713 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.825110 31942 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.802258 31977 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.942184 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:38.942848 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 206553us
I20260709 13:10:38.940349 31753 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.946328 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.946487 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:38.974109 27309 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:38.974730 28010 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:38.947428 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.947618 31807 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:10:38.947768 31980 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:10:38.852742 31956 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:10:38.944687 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:38.945521 31949 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.984733 31977 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.985513 31912 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.981199 28015 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:38.991012 27412 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:10:38.991479 27412 pending_rounds.cc:85] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 5
I20260709 13:10:38.991735 27412 pending_rounds.cc:107] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 10.6
W20260709 13:10:38.991858 31953 consensus_meta.cc:287] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.670s	user 0.012s	sys 0.000s
I20260709 13:10:38.920378 31968 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.992326 31953 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:38.993667 28009 raft_consensus.cc:2410] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:10:38.954762 31749 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:38.982173 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.969341 31879 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:38.995512 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:38.996454 31953 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:38.997201 31749 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:38.991997 27412 raft_consensus.cc:2889] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:38.990828 31942 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:38.999014 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:38.997776 31749 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:39.001473 27415 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:39.026234 27308 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:39.031558 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:38.978063 31807 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:39.035109 31432 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:39.035398 31807 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.036075 31432 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.036551 31807 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.036600 31432 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.037304 31432 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:39.038266 31993 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:38.970062 31997 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 13:10:39.040450 31988 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:39.068899 31651 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.073284 31897 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.078365 28010 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:39.080047 31651 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:39.086184 31846 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.002s
I20260709 13:10:39.001061 31898 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:39.052143 31946 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:10:39.101464 31941 consensus_meta.cc:287] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 13:10:39.101918 31941 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:39.102692 31826 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.002s
I20260709 13:10:39.050973 31912 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:39.105911 31898 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:39.107355 31903 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.741s	user 0.004s	sys 0.007s
W20260709 13:10:39.110918 31902 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.004s
I20260709 13:10:39.137979 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1652) took 1478 ms. Trace:
I20260709 13:10:39.140507 27262 rpcz_store.cc:276] 0709 13:10:37.659486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.661121 (+  1635us) service_pool.cc:224] Handling call
0709 13:10:37.661447 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.661807 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.661833 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.662318 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.709145 (+1046827us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b54003028a0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82ba86b8 00007fbd82c3192b 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c
0709 13:10:38.709220 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:38.890099 (+180879us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.112180 (+222081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.112741 (+   561us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.112798 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:39.137650 (+ 24852us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.137892 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":329495,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":6552,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":16967,"spinlock_wait_cycles":147306368,"thread_start_us":442599,"threads_started":3,"wal-append.queue_time_us":62919,"wal-append.run_cpu_time_us":2415,"wal-append.run_wall_time_us":1076907}
W20260709 13:10:39.150671 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 316314us
I20260709 13:10:39.113137 31853 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.175655 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.178921 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:39.103147 31826 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.191748 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:39.193203 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 167056us
I20260709 13:10:39.173645 31800 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:39.173408 31897 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:39.195648 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:39.198843 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 289856us
I20260709 13:10:39.149820 31902 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:39.200542 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.203444 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:39.207156 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 203851us
I20260709 13:10:39.208035 27410 raft_consensus.cc:2468] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:39.209673 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.134016 31749 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.212335 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:39.196075 31870 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:39.227649 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.228962 27336 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:39.230427 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:39.190749 31524 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.241886 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.254040 27233 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.256230 31782 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:39.256883 31782 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:39.260706 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51143.9us
I20260709 13:10:39.261924 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:39.262506 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:39.266827 31984 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:10:39.215770 31897 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:39.268791 32013 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.269953 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.270493 32014 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:39.206166 31898 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.295329 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.272156 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.239498 32002 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.258389 31994 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:39.296406 31807 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:39.295053 31755 consensus_meta.cc:287] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.004s
W20260709 13:10:39.301290 31899 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 13:10:39.305316 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.307585 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.310496 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.310583 27416 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
W20260709 13:10:39.311961 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.312971 31800 raft_consensus.cc:2764] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:39.303344 32002 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.306883 31879 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.311561 31755 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.306413 31940 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:10:39.306140 31826 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:39.303884 31994 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:39.315024 32000 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:10:39.315483 32002 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.339248 31798 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.314054 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:39.351732 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.337160 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1772) took 1589 ms. Trace:
I20260709 13:10:39.352898 27416 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:39.352975 27412 rpcz_store.cc:276] 0709 13:10:37.748073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.748218 (+   145us) service_pool.cc:224] Handling call
0709 13:10:37.751142 (+  2924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.998376 (+1247234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.336790 (+338414us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400377154. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:39.337069 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2850537856}
I20260709 13:10:39.346040 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.357043 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.321455 27262 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:10:39.347054 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.361591 27261 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.322842 27233 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:39.363297 27233 leader_election.cc:403] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.358779 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:39.296777 32014 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:39.372922 27306 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:39.375571 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52860.4us
I20260709 13:10:39.315896 31974 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.164s
I20260709 13:10:39.322819 31994 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.508498 31998 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.201s
I20260709 13:10:39.520876 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.521625 27415 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:10:39.534729 27410 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:39.481766 31753 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:39.535508 31753 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.536586 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:39.537559 31753 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:39.537827 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.538383 32016 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:39.538583 27267 raft_consensus.cc:2393] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:39.538887 32016 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:39.539294 32016 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:39.481942 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89217.3us
I20260709 13:10:39.422821 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:39.348194 27266 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:10:39.473912 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.426532 32006 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:10:39.324090 31782 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:39.308625 32013 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:39.320957 31899 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.425331 31961 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:39.410400 31975 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:39.304170 31647 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:39.420609 28011 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:39.423593 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:39.415477 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:39.327695 31524 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:39.384518 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:39.577641 27416 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.317987 31902 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:39.401561 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.383672 31897 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:39.320453 31713 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:10:39.315722 31517 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.448521 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:39.584791 27412 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.457872 28015 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:39.320919 31755 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:39.324199 31950 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.040s	user 0.003s	sys 0.000s
I20260709 13:10:39.317924 31879 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:10:39.317718 31849 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:10:39.407262 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:39.595916 27262 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:39.320310 31846 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.337688 31905 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:10:39.405851 32014 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:39.350863 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:39.604660 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 253898us
I20260709 13:10:39.605624 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.458529 31711 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:39.498327 27261 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:39.499702 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 126847us
I20260709 13:10:39.549711 27410 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:39.541358 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 278908us
W20260709 13:10:39.607738 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.561725 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:39.608968 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 47338.4us
I20260709 13:10:39.574165 31782 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:39.577642 27408 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:39.612679 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.563488 31838 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:39.580353 31975 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:39.583123 31897 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.584658 31870 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.620568 31902 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.635593 31902 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.635844 31870 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:39.612850 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:39.607863 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:39.595536 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 218625us
I20260709 13:10:39.579468 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.636912 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:39.637519 28008 raft_consensus.cc:2376] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11. Re-sending same reply.
I20260709 13:10:39.615586 27262 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.616657 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:39.619729 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:39.640331 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.617107 27410 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:39.642261 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.644039 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:39.630571 27416 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:39.620528 31910 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:39.653820 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.655664 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.656128 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:39.656596 27339 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
W20260709 13:10:39.631934 32020 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:10:39.631783 31838 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:39.632961 31943 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.400s	user 0.002s	sys 0.000s
I20260709 13:10:39.618036 31755 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:39.633292 31975 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.634297 31897 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.635949 31902 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.613627 27261 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:39.609872 31905 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.645421 31870 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.648027 27266 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:10:39.649855 31912 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.650802 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.651553 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.694525 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.695472 27341 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:39.652680 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:39.642968 27410 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.701510 27410 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.655308 27980 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:39.702438 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 47279.4us
I20260709 13:10:39.663343 27337 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:39.665478 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:39.666676 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.609146 31826 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:39.590641 31517 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.669348 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:39.671046 27416 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.676362 27306 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:39.727962 27337 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:39.728425 27340 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:39.728480 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 52284.9us
I20260709 13:10:39.681115 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2279) took 1913 ms. Trace:
I20260709 13:10:39.730146 27340 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:39.729302 27334 rpcz_store.cc:276] 0709 13:10:37.768027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.769110 (+  1083us) service_pool.cc:224] Handling call
0709 13:10:37.769479 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.837581 (+ 68102us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:37.837609 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.837947 (+   338us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.098208 (+260261us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:38.098259 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.098334 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.323247 (+1224913us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:39.676027 (+352780us) raft_consensus.cc:1685] finished
0709 13:10:39.676049 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.681020 (+  4971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77020,"raft.queue_time_us":85273,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":17424,"spinlock_wait_cycles":4927872,"thread_start_us":201964,"threads_started":1,"wal-append.queue_time_us":370834}
I20260709 13:10:39.731719 27261 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:39.732178 27334 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:39.682099 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1774) took 1932 ms. Trace:
I20260709 13:10:39.667673 31974 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:39.674268 31945 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.443s	user 0.004s	sys 0.000s
I20260709 13:10:39.661219 32003 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:39.662322 31652 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.687400 27343 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.605317 31846 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.651815 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.766310 27335 raft_consensus.cc:2393] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:39.660519 31903 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:39.697395 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.699450 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.767737 27260 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:39.678215 31755 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.735500 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:39.736025 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:39.776755 27261 raft_consensus.cc:2393] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:39.733253 27417 rpcz_store.cc:276] 0709 13:10:37.750023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.750140 (+   117us) service_pool.cc:224] Handling call
0709 13:10:37.750454 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.755757 (+  5303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.755793 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.757851 (+  2058us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.043806 (+285955us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:38.043867 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.043969 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.632380 (+1588411us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:39.681702 (+ 49322us) raft_consensus.cc:1685] finished
0709 13:10:39.681726 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.682017 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"raft.queue_time_us":849,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5151,"spinlock_wait_cycles":16384768,"thread_start_us":285466,"threads_started":1,"wal-append.queue_time_us":368968}
I20260709 13:10:39.735265 27415 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:39.780694 27410 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:10:39.754037 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:39.673858 31798 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:39.781193 27410 pending_rounds.cc:85] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 6
W20260709 13:10:39.736061 32020 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:10:39.769752 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 341230us
I20260709 13:10:39.755403 31974 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:39.738304 31977 raft_consensus.cc:2804] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.797735 27268 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:39.748817 31524 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:39.678860 31994 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.805644 27417 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:39.810868 27264 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:39.698194 31905 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.812454 27410 pending_rounds.cc:107] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:10:39.759702 31979 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.775650 31652 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.703028 31912 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.816815 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:39.884829 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1773) took 2136 ms. Trace:
I20260709 13:10:39.849638 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2546) took 4318 ms. Trace:
I20260709 13:10:39.885468 27263 rpcz_store.cc:276] 0709 13:10:35.497238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.227281 (+730043us) service_pool.cc:224] Handling call
0709 13:10:36.227697 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.294353 (+2066656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.815565 (+1521212us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540024c2d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:39.815827 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4676948736}
I20260709 13:10:39.723836 32002 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:39.870153 27260 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:39.887948 27262 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:39.869596 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:39.769264 31898 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:10:39.769784 31749 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:10:39.877372 27410 raft_consensus.cc:2889] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:39.762131 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 178698us
I20260709 13:10:39.792066 31755 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:39.796644 31903 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.889791 27260 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:39.931071 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.885355 27413 rpcz_store.cc:276] 0709 13:10:37.748544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.748662 (+   118us) service_pool.cc:224] Handling call
0709 13:10:37.748982 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.749379 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.749413 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.753948 (+  4535us) log.cc:844] Serialized 26 byte log entry
0709 13:10:37.878674 (+124726us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:37.878743 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.878853 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.515794 (+1636941us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:39.880228 (+364434us) raft_consensus.cc:1685] finished
0709 13:10:39.880258 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.884749 (+  4491us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2072,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":4146,"spinlock_wait_cycles":7157632,"thread_start_us":75859,"threads_started":1,"wal-append.queue_time_us":326545}
W20260709 13:10:39.931878 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 115214us
I20260709 13:10:39.904953 27412 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:39.939814 27260 raft_consensus.cc:1240] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:39.949406 27343 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:39.885181 31979 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.003814 27343 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:39.952682 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105448us
W20260709 13:10:40.029326 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 96483.5us
I20260709 13:10:40.028581 27343 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:39.940043 32030 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:40.037686 27412 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:39.945727 31838 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.050455 27412 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:40.039428 27413 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:40.050788 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:40.021226 31432 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.983s	user 0.014s	sys 0.001s
I20260709 13:10:39.950258 31899 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.058867 31838 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.059065 31713 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.954948 31974 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:39.953347 32036 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:10:39.966542 32031 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:40.060894 31979 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:39.978753 32028 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:40.098481 32034 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:40.100185 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:39.996945 32012 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
I20260709 13:10:40.073734 27413 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:40.067407 31846 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.075754 27343 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:40.082979 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.047243 31517 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:40.117648 27413 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:39.997831 31753 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:40.134253 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.094426 32026 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:10:40.136548 27340 raft_consensus.cc:1240] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:40.109524 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.119277 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:40.101856 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:40.140928 27336 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.120321 27343 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:40.152635 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.142995 27413 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.159848 27340 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:40.096086 32028 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:40.167284 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 83081.6us
I20260709 13:10:40.168686 27413 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.171408 27334 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:40.169998 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:40.172652 27263 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:40.144646 31753 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.175531 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.178194 27231 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.078547 31432 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.095319 31713 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.085707 31838 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.184733 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:40.181669 31912 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.187644 31744 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.165835 31517 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:40.231462 31744 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.203020 31903 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.102265 32031 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.221314 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:40.188802 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.232038 31744 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.235886 27268 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:40.185086 31994 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.188499 31652 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:40.239674 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51031.3us
I20260709 13:10:40.241859 27335 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:40.243297 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:40.243633 27268 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:40.244131 27340 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:40.154475 27308 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.241773 27231 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:40.210022 32036 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.250598 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:40.251037 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.221235 31799 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:40.260715 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106326us
I20260709 13:10:40.261303 31652 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.261071 27268 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:40.248658 31849 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:40.245292 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:40.252444 27336 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:40.237556 32002 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.270066 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:40.253242 27343 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:10:40.259642 32037 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:10:40.250089 31905 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:40.289659 27409 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1790) took 2445 ms (client timeout 1871 ms). Trace:
W20260709 13:10:40.268476 32041 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:10:40.350718 27268 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:40.351624 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:40.361897 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 186449us
W20260709 13:10:40.267068 32044 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:40.363125 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:40.267735 32039 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:10:40.348353 27259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2565) took 2417 ms (client timeout 1810 ms). Trace:
I20260709 13:10:40.352849 27336 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:10:40.355983 27409 rpcz_store.cc:269] 0709 13:10:37.829313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.923968 (+ 94655us) service_pool.cc:224] Handling call
0709 13:10:40.274972 (+2351004us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000acb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:40.275111 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871700736}
W20260709 13:10:40.349655 31929 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.036s	sys 0.000s
I20260709 13:10:40.386039 27336 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:40.286299 31849 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:40.388252 27336 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:40.373087 27259 rpcz_store.cc:269] 0709 13:10:37.861225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.863279 (+  2054us) service_pool.cc:224] Handling call
0709 13:10:40.278608 (+2415329us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540011e9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:40.278749 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744673664}
W20260709 13:10:40.385380 31929 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.037s	sys 0.000s
I20260709 13:10:40.393669 27268 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:10:40.279752 31910 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:10:40.379829 31749 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.402292 32016 consensus_meta.cc:287] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.863s	user 0.008s	sys 0.002s
I20260709 13:10:40.364287 32048 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.406898 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 665) took 1649 ms. Trace:
W20260709 13:10:40.407055 32053 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:10:40.413851 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:40.385586 32051 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:10:40.421128 31902 consensus_meta.cc:287] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.002s
I20260709 13:10:40.359472 31912 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.444463 31912 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.349162 31899 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:10:40.397469 31930 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.279676 31879 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:10:40.253156 32028 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.451689 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.453606 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.454470 27409 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:40.431816 31849 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:40.440620 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54884.8us
I20260709 13:10:40.442868 27338 rpcz_store.cc:276] 0709 13:10:38.757252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.763898 (+  6646us) service_pool.cc:224] Handling call
0709 13:10:38.764334 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.931963 (+167629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.931993 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.932032 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:38.932067 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.406610 (+1474543us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54001685d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:40.406674 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.406823 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385085824}
W20260709 13:10:40.461262 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 197763us
I20260709 13:10:40.461362 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.291429 31524 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:10:40.471486 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.472265 27410 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:40.472967 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.441385 31846 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:40.457053 32037 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:40.476433 27380 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.460134 31890 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.488590 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.463771 32036 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.498029 31890 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:40.518900 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56905.6us
I20260709 13:10:40.478078 31910 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:40.500612 31744 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.447343 32016 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.503193 31905 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:10:40.504103 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:40.504577 32027 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:40.505997 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.496654 32051 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.507957 32031 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:40.508796 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63101.9us
W20260709 13:10:40.498903 32054 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:10:40.446497 31749 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:40.463269 31799 consensus_queue.cc:1175] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" responder_term: 12 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:40.477258 32059 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.555698 31432 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.458461 31902 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.556535 32064 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:40.557710 31902 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.529726 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:40.557992 32064 consensus_queue.cc:1059] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:40.558805 32064 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:40.559347 31975 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:40.559867 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:40.560900 31975 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:40.506590 32030 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:40.565814 27413 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:40.531534 27415 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.449580 32048 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.536643 31131 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:40.568202 31879 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:40.568617 31879 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:40.569389 32048 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.519371 31713 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.541709 27342 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.573724 32072 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.574199 32072 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:40.575120 32072 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.570075 32031 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.484597 31937 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:40.543485 32066 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:40.544476 31744 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.522142 31910 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:40.589365 31910 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:40.546514 31982 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.612s	user 0.001s	sys 0.006s
I20260709 13:10:40.548499 32002 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:40.549338 31782 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:10:40.596707 31543 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:40.596838 31782 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:40.597934 31782 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:40.554328 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.605257 27410 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:10:40.606405 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.607465 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.609396 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.554708 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:40.569617 31879 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.572804 32059 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:40.588407 32063 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:10:40.591444 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.535921 31838 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.620515 31879 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.621899 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2581) took 1275 ms. Trace:
I20260709 13:10:40.622290 27264 rpcz_store.cc:276] 0709 13:10:39.346817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.346940 (+   123us) service_pool.cc:224] Handling call
0709 13:10:39.409821 (+ 62881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.876825 (+467004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.621664 (+744839us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54001d88d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:40.621841 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921045376}
W20260709 13:10:40.626519 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 206753us
I20260709 13:10:40.627377 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:40.593426 27342 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:40.522048 32036 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.636602 32036 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:40.611354 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:40.544476 31890 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:40.616003 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2586) took 1267 ms. Trace:
I20260709 13:10:40.559152 32064 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:40.684098 32064 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.685792 32064 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:40.579524 31517 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:40.687628 31517 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:40.688172 31517 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:40.693475 32025 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.941s	user 0.003s	sys 0.000s
W20260709 13:10:40.693742 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82464.5us
I20260709 13:10:40.695870 31890 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:40.696574 31890 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:40.535230 32065 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 13:10:40.641650 31870 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.939s	user 0.009s	sys 0.001s
I20260709 13:10:40.596390 32002 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:40.727804 32002 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.729462 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:40.729825 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2583) took 1382 ms. Trace:
I20260709 13:10:40.628094 27308 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:40.730275 27266 rpcz_store.cc:276] 0709 13:10:39.347499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.573907 (+226408us) service_pool.cc:224] Handling call
0709 13:10:39.579805 (+  5898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.691001 (+111196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.697832 (+1006831us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b54001f7cd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:40.729748 (+ 31916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130353024}
W20260709 13:10:40.730851 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 102839us
I20260709 13:10:40.697624 31890 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.731995 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2300) took 1077 ms. Trace:
I20260709 13:10:40.733433 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:40.613596 31782 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:40.631521 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.736013 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.646037 31905 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:40.737685 31905 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:40.738221 31930 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:40.646037 31778 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.739106 31930 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:40.739452 31778 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.741417 32002 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:40.741777 31778 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.743937 32048 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:40.652735 31897 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.971s	user 0.011s	sys 0.002s
W20260709 13:10:40.656728 32014 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.036s	user 0.007s	sys 0.006s
I20260709 13:10:40.664165 31912 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.667296 31849 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.667892 27415 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:40.671124 27334 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
W20260709 13:10:40.672282 31755 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260709 13:10:40.677620 32028 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:40.682044 32016 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:40.732381 27341 rpcz_store.cc:276] 0709 13:10:39.654163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.725614 (+ 71451us) service_pool.cc:224] Handling call
0709 13:10:39.726040 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.953131 (+227091us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:40.252250 (+299119us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.360665 (+108415us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.624757 (+264092us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18000ece60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:10:40.624939 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.624997 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:40.625050 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.667256 (+ 42206us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b18000ece60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1
0709 13:10:40.668747 (+  1491us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b18000ece60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:40.679016 (+ 10269us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b18000ece60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:40.731760 (+ 52744us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540020ab54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:40.731811 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.731943 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209553,"prepare.queue_time_us":98030,"prepare.run_cpu_time_us":141,"prepare.run_wall_time_us":7553,"raft.queue_time_us":264553,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":40434,"spinlock_wait_cycles":646911232,"thread_start_us":405638,"threads_started":2,"wal-append.queue_time_us":172669}
I20260709 13:10:40.730306 27264 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:40.682121 31753 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.647024 27262 rpcz_store.cc:276] 0709 13:10:39.348290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.777029 (+428739us) service_pool.cc:224] Handling call
0709 13:10:39.887724 (+110695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.894358 (+  6634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.615777 (+721419us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540011e4d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:40.615939 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253824256}
I20260709 13:10:40.633327 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.771768 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:40.772928 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 139733us
I20260709 13:10:40.735562 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:40.749687 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2298) took 1096 ms. Trace:
I20260709 13:10:40.743395 32051 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.756636 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 569) took 1144 ms. Trace:
I20260709 13:10:40.778635 27342 rpcz_store.cc:276] 0709 13:10:39.653449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.665083 (+ 11634us) service_pool.cc:224] Handling call
0709 13:10:40.749412 (+1084329us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b540014b9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:40.749598 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904757632}
I20260709 13:10:40.780282 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.781657 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.781917 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.757902 31807 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.738636 31905 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.770947 32036 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:40.786177 31912 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:40.816771 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.869076 27408 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:40.823668 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.801586 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:40.873267 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71788.2us
I20260709 13:10:40.874967 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:40.788429 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.747638 31870 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.890347 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.821056 31763 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.783520 28010 rpcz_store.cc:276] 0709 13:10:39.612467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.620992 (+  8525us) service_pool.cc:224] Handling call
0709 13:10:39.634468 (+ 13476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.634708 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:39.635021 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:10:39.805483 (+170462us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.277998 (+472515us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18004b6b80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:40.755908 (+477910us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b18004b6b80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd82c29060 00007fbd82c3b716 00007fbd82c4c287 00007fbd82c4c208
0709 13:10:40.756109 (+   201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:40.756195 (+    86us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:40.756273 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.756373 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.756553 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":899704,"prepare.queue_time_us":6453,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":81,"raft.queue_time_us":956219,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":31936,"spinlock_wait_cycles":30503808,"thread_start_us":169467,"threads_started":1,"wal-append.queue_time_us":309494}
I20260709 13:10:40.753727 31897 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.772187 31755 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.906625 32047 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:40.912919 31755 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.827376 31807 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.895429 32016 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:40.917969 31875 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.918535 31994 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:40.919307 31994 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.919872 31823 consensus_queue.cc:1059] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:40.923336 31969 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:40.923859 31969 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:40.924846 31969 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.925479 31716 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:40.926424 31969 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:40.926220 31716 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.771129 31930 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:40.935519 32023 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:40.936635 31594 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:40.937048 31594 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:40.937927 31594 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.940125 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.941676 31849 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:40.941716 32047 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:40.945024 27409 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:10:40.753369 32048 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:40.948982 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 411912us
I20260709 13:10:40.904603 27309 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.953814 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:40.954577 27414 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:40.807691 32049 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:40.960995 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:40.823638 31778 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.074s
W20260709 13:10:40.965054 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60579.6us
I20260709 13:10:40.967514 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:41.121336 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 153952us
I20260709 13:10:40.889345 31905 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:41.020716 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.128225 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:40.772024 31977 raft_consensus.cc:697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:40.757462 32014 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:40.907862 32051 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:40.943668 31753 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:10:41.150790 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.044s	sys 0.110s
I20260709 13:10:40.819628 31524 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:40.825671 32027 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:10:40.769671 31846 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:40.908738 31763 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.109458 27339 raft_consensus.cc:2368] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12.
I20260709 13:10:41.071666 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:40.822954 31903 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:10:41.128947 28009 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:41.127878 31755 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.137638 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.138794 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:41.168310 27267 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:41.168584 28012 raft_consensus.cc:2368] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:41.137753 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:41.170512 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:40.922995 31994 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.135301 31652 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:41.144558 27259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.041s	sys 0.044s
W20260709 13:10:41.175107 27259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.041s	sys 0.044s
I20260709 13:10:41.127259 31961 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:40.918584 31875 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.143814 31949 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:41.111436 32059 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.109426 31799 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.159323 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.044s	sys 0.110s
I20260709 13:10:41.120333 31929 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.160023 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:41.160924 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.019s	sys 0.042s
I20260709 13:10:41.161331 27340 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:41.152195 31647 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:10:41.158773 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.191898 27262 raft_consensus.cc:2410] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:41.164793 27415 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:41.144559 31854 raft_consensus.cc:3055] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.151311 31826 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.154285 31524 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:41.111460 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.151460 32049 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:41.028066 32047 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.169s
I20260709 13:10:41.175293 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:41.146628 27414 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:41.151207 31773 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:41.136989 31979 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:10:40.990679 31910 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:41.183938 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 664209us
W20260709 13:10:41.163426 31974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.004s
I20260709 13:10:41.194886 31854 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:41.175069 31753 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:41.249842 31753 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.250187 31716 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.250468 31753 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.253026 31594 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.155565 32051 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.239499 31902 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.256283 31902 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.256814 32051 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.212721 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:41.257668 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60519.2us
I20260709 13:10:41.243490 31912 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:10:41.258808 31902 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:41.260510 27339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2299) took 1606 ms (client timeout 1631 ms). Trace:
I20260709 13:10:41.260865 32067 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.243975 31773 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:41.261022 27339 rpcz_store.cc:269] 0709 13:10:39.653834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.627024 (+973190us) service_pool.cc:224] Handling call
0709 13:10:41.260330 (+633306us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540025c6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:41.260457 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001050880}
I20260709 13:10:41.261376 32067 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.171904 31432 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:41.214264 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.221477 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:41.299487 27415 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.180434 31899 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:41.163412 31846 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.183902 31652 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:41.241429 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:41.212318 31131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.024s
W20260709 13:10:41.193248 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.019s	sys 0.042s
I20260709 13:10:41.246176 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:41.316120 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 754370us
W20260709 13:10:41.317256 27265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.013s	sys 0.020s
W20260709 13:10:41.317634 27265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.013s	sys 0.020s
I20260709 13:10:41.233938 31749 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.193845 31799 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.259927 31849 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.196846 27413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.022s	sys 0.012s
W20260709 13:10:41.335254 27413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.023s	sys 0.012s
I20260709 13:10:41.259851 32071 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.271342 31753 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.263955 32067 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.272780 31763 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.274976 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 674) took 1041 ms. Trace:
W20260709 13:10:41.272962 32070 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 13:10:41.275974 32014 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.276116 31773 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.206099 31977 consensus_queue.cc:237] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.348064 31753 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.276732 31897 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.277307 31870 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.195928 31929 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.352777 31929 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.278061 31807 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:41.266530 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 112097us
W20260709 13:10:41.265823 32002 consensus_meta.cc:287] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 13:10:41.259279 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:41.355863 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96694.8us
W20260709 13:10:41.357240 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.357903 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.278548 32048 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.239842 32003 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.340327 31849 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.283499 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.361065 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.361441 31849 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.361718 27409 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:41.362066 31849 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:41.362720 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.284240 32049 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.368397 31846 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.278457 31910 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.291013 31875 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.211942 31826 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.369590 31854 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.177727 31755 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.293784 27264 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:41.304003 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.381261 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.308029 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.215404 31778 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.314088 27260 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:41.315310 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73977.2us
I20260709 13:10:41.212056 31524 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:41.326882 27417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.018s	sys 0.028s
I20260709 13:10:41.383877 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:41.385779 27417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.019s	sys 0.029s
I20260709 13:10:41.376534 31755 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.340360 27340 rpcz_store.cc:276] 0709 13:10:40.233797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.351306 (+117509us) service_pool.cc:224] Handling call
0709 13:10:41.274754 (+923448us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540032ffd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:41.274913 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836817152}
W20260709 13:10:41.322861 31131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.009s	sys 0.024s
I20260709 13:10:41.312635 31903 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:41.412103 27263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.013s	sys 0.005s
I20260709 13:10:41.312429 31953 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:41.337491 32071 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.346700 27267 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:41.355396 31652 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.189783 32059 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:41.243026 31974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.004s
W20260709 13:10:41.363314 31517 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 13:10:41.365159 27415 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:41.413596 32051 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.370940 31854 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.327049 31647 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:41.374287 31826 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.377555 27409 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:41.309617 31899 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.386582 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:41.433145 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53398.1us
I20260709 13:10:41.415545 32071 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.434303 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:41.326604 32027 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.394124 28011 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:41.395895 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:41.396576 31879 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.001s
I20260709 13:10:41.439141 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.312446 31432 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.342687 31749 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.344061 32016 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:41.396962 31799 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.397349 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.398459 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.404831 31846 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.398365 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:41.355032 31782 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.001s
I20260709 13:10:41.418601 32048 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:41.417562 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:41.388469 32064 consensus_meta.cc:287] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.003s
W20260709 13:10:41.387488 31798 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.019s	sys 0.018s
I20260709 13:10:41.377827 31849 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:41.365401 32003 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.412487 32030 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.439425 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:41.476313 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.476261 31974 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:41.477193 27409 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:41.396478 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.450484 31902 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:41.436465 27308 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:41.435073 31899 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:41.480247 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 43860.1us
I20260709 13:10:41.408721 31778 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.445812 27268 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:10:41.412489 27263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.013s	sys 0.005s
I20260709 13:10:41.431114 32072 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.420322 31626 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:10:41.431784 31784 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:41.416152 31903 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.419220 31953 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.450091 31749 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.469107 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:41.438923 31755 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.490608 31755 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.491012 31755 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.492022 31749 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.492647 31778 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.482474 32048 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:41.493134 32048 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:41.493250 31784 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.494071 32048 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.440802 31949 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.495424 32048 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:41.495537 31949 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.474572 32003 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.471012 31846 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:41.480360 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2593) took 1015 ms. Trace:
I20260709 13:10:41.502144 27259 rpcz_store.cc:276] 0709 13:10:40.465388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.465578 (+   190us) service_pool.cc:224] Handling call
0709 13:10:40.466026 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.521823 (+ 55797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.521860 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.522442 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.175899 (+653457us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:41.175941 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.176011 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:41.480155 (+304144us) raft_consensus.cc:1685] finished
0709 13:10:41.480174 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.480306 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93738,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":708420,"threads_started":2,"wal-append.queue_time_us":954106}
I20260709 13:10:41.484707 31902 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:41.507632 31902 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.512240 31953 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.483245 32016 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.481340 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:41.478529 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:41.428824 31937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.024s	sys 0.028s
I20260709 13:10:41.430485 31131 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:10:41.427724 31517 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:41.467813 31798 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.019s	sys 0.018s
I20260709 13:10:41.429812 32051 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.476222 31713 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:41.473410 31849 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.498265 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:41.484637 31807 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:41.495353 31784 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.437364 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.566001 27415 raft_consensus.cc:2393] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:41.520567 27409 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:41.445420 32027 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:41.526486 31899 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.475592 32030 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.529984 31524 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.533639 31903 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:41.537571 27410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.004s	sys 0.028s
I20260709 13:10:41.521574 32014 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.519670 32016 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:41.560931 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 62759.5us
I20260709 13:10:41.599972 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:41.534933 31626 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.567420 31910 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:41.569020 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2594) took 1014 ms. Trace:
I20260709 13:10:41.558542 32076 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.568923 31131 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.547502 31782 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:41.568996 31807 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:41.595528 27410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.004s	sys 0.029s
W20260709 13:10:41.561592 31930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.006s	sys 0.019s
W20260709 13:10:41.543021 31937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.025s	sys 0.028s
W20260709 13:10:41.602946 27416 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.004s	sys 0.027s
I20260709 13:10:41.594883 31784 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:41.621176 32028 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.850s	user 0.008s	sys 0.003s
I20260709 13:10:41.621588 27268 rpcz_store.cc:276] 0709 13:10:40.554203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.554390 (+   187us) service_pool.cc:224] Handling call
0709 13:10:41.567053 (+1012663us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54001b80d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:41.568959 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919742720}
I20260709 13:10:41.619771 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:41.601336 32016 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.601281 31626 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.629091 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.630774 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.632341 28007 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:41.634124 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.657755 28011 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:41.662114 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:41.664218 28008 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:41.640450 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.667834 27415 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:41.669137 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.669914 27415 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:41.672578 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:41.673496 28013 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:41.672691 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:41.625680 31890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.017s	sys 0.052s
I20260709 13:10:41.670933 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.676474 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.677466 27264 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:41.601046 32014 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:41.638371 31930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.006s	sys 0.019s
I20260709 13:10:41.679728 27268 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 19: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:41.643359 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:41.680114 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.653024 31903 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:41.649022 32059 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.650395 31647 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:41.650839 31870 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:41.653218 27411 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:10:41.630162 31838 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:10:41.632234 31131 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.651753 31784 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.638505 32076 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.689813 32014 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:41.691965 32078 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:41.664101 31626 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.712944 31903 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.695358 31517 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.696197 31432 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.702529 31937 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:41.704789 31524 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.626365 31846 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:41.651412 27231 connection.cc:256] RPC call timeout handler was delayed by -1.229300230999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 13:10:41.752630 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1888002309998456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:10:41.678532 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:41.648355 27412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.007s	sys 0.025s
W20260709 13:10:41.756040 27412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.007s	sys 0.025s
W20260709 13:10:41.642421 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.004s	sys 0.024s
W20260709 13:10:41.756605 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.004s	sys 0.025s
W20260709 13:10:41.756928 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 839327us
W20260709 13:10:41.675861 31890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.018s	sys 0.052s
W20260709 13:10:41.638863 27416 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.027s
I20260709 13:10:41.665351 31974 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:41.639441 31910 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:41.720607 27411 pending_rounds.cc:85] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 6
I20260709 13:10:41.768612 27411 pending_rounds.cc:107] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:41.742475 31903 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:41.698928 32051 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:41.695096 31798 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.725733 32030 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:41.823602 31798 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:41.762522 27415 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:41.755653 31647 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:41.765020 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.758839 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:41.768915 27411 raft_consensus.cc:2889] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.632139 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:41.771116 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:41.785468 27309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.025s	sys 0.026s
I20260709 13:10:41.830914 27409 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:41.831269 27309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.025s	sys 0.026s
W20260709 13:10:41.831894 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 661436us
W20260709 13:10:41.797111 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.010s	sys 0.033s
I20260709 13:10:41.753054 31937 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:41.748270 32014 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:41.760142 31517 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:41.748035 31930 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.796548 27408 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.034s	sys 0.021s
W20260709 13:10:41.967648 27408 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.036s	sys 0.022s
I20260709 13:10:41.743938 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:41.752465 31949 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:41.826227 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:41.764438 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:41.827592 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:41.833557 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.010s	sys 0.034s
I20260709 13:10:42.034479 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2250) took 1434 ms. Trace:
I20260709 13:10:41.765090 31713 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.835704 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:42.039076 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 203505us
I20260709 13:10:42.039917 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:42.041286 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:41.841657 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.945654 28015 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.004s	sys 0.040s
W20260709 13:10:42.043536 28015 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.005s	sys 0.041s
W20260709 13:10:41.897080 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:41.862357 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 91354.7us
W20260709 13:10:41.882869 27262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.009s	sys 0.042s
W20260709 13:10:42.044863 27262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.012s	sys 0.049s
I20260709 13:10:41.774673 32074 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.775487 31974 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.072513 31974 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:42.054327 32085 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.430s	user 0.004s	sys 0.000s
I20260709 13:10:42.074107 27268 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:42.069837 31910 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.075142 31912 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:41.962687 31517 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.033638 32027 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.077991 31517 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:42.078832 31755 consensus_meta.cc:287] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.003s
I20260709 13:10:42.078737 31937 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.079370 31755 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.080509 32076 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.033080 31749 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.860757 31524 consensus_queue.cc:1059] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:10:42.081554 31749 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.082412 31524 raft_consensus.cc:3055] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:42.082784 31524 raft_consensus.cc:740] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:41.866433 31647 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.083664 31749 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.023720 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.084312 31432 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.084494 27340 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:42.084758 31432 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.085223 31432 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.085402 31647 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.085608 32083 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:42.035707 32014 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.064375 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:42.087929 32014 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.088104 32081 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
W20260709 13:10:42.089090 32079 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.319s	user 0.000s	sys 0.000s
I20260709 13:10:42.089857 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:42.090327 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2251) took 1490 ms. Trace:
W20260709 13:10:42.090682 31854 consensus_meta.cc:287] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.001s
W20260709 13:10:42.091073 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.091610 27264 raft_consensus.cc:2410] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:42.089692 27231 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.631s (SENT)
I20260709 13:10:42.034886 27413 rpcz_store.cc:276] 0709 13:10:40.599924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.602972 (+  3048us) service_pool.cc:224] Handling call
0709 13:10:40.603328 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.603764 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:40.603792 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.604253 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.335825 (+731572us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:41.335884 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.335978 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.034274 (+698296us) raft_consensus.cc:1685] finished
0709 13:10:42.034296 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.034422 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":731124,"threads_started":1,"wal-append.queue_time_us":954942}
I20260709 13:10:42.119860 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1832) took 1669 ms. Trace:
I20260709 13:10:42.119936 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.046952 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.120347 27411 rpcz_store.cc:276] 0709 13:10:40.450782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.450941 (+   159us) service_pool.cc:224] Handling call
0709 13:10:40.451389 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.830538 (+1379149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.119644 (+289106us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000be5d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:42.119809 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763172608}
I20260709 13:10:42.060582 31713 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.124063 31713 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.126641 27409 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
W20260709 13:10:41.829272 31970 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.013s	sys 0.020s
I20260709 13:10:42.063872 32065 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:42.068668 31807 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.068866 31870 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:42.069365 31784 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.069794 31798 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.032333 31846 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:42.070472 31131 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.070591 31838 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:42.083544 31879 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:41.861078 31899 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.083568 31524 consensus_queue.cc:260] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:42.099323 32071 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
I20260709 13:10:42.067939 32074 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:42.101541 32080 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:42.101976 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.031812 32047 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.090704 27417 rpcz_store.cc:276] 0709 13:10:40.600253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.604648 (+  4395us) service_pool.cc:224] Handling call
0709 13:10:40.615545 (+ 10897us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:40.616020 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.616047 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:40.616724 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 13:10:41.386350 (+769626us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:41.386410 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.386505 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.090083 (+703578us) raft_consensus.cc:1685] finished
0709 13:10:42.090110 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.090268 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":769168,"threads_started":1,"wal-append.queue_time_us":1102444}
I20260709 13:10:42.107702 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.172173 31131 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:42.112277 31854 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.113750 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.064669 32023 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.116086 32016 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.081346 31755 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.118057 32072 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.001s
I20260709 13:10:42.121548 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:41.784786 31961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.013s
I20260709 13:10:42.234050 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.235059 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:41.975301 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 231468us
I20260709 13:10:42.236249 27341 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:42.146386 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.237057 27339 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:42.149742 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.060720 31949 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:42.155082 28008 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:42.158602 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:42.159945 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:42.148061 31970 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.013s	sys 0.020s
W20260709 13:10:42.162602 27380 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.011s	sys 0.015s
W20260709 13:10:42.148777 31826 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.037s	sys 0.036s
I20260709 13:10:42.152585 32065 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.261794 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:42.177049 31652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.039s	sys 0.048s
W20260709 13:10:42.167356 27414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.004s	sys 0.029s
I20260709 13:10:42.169677 27415 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:10:42.268335 27414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.005s	sys 0.029s
I20260709 13:10:42.173025 31131 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.172657 27340 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
W20260709 13:10:42.177546 27263 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.010s	sys 0.001s
W20260709 13:10:42.271622 27263 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.010s	sys 0.002s
W20260709 13:10:42.173195 31799 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.000s	sys 0.011s
I20260709 13:10:42.161468 31846 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.180622 27261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.011s	sys 0.015s
W20260709 13:10:42.283211 27261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.012s	sys 0.015s
I20260709 13:10:42.163642 31879 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:42.199267 28012 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.013s	sys 0.014s
W20260709 13:10:42.302002 28012 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.014s	sys 0.015s
I20260709 13:10:42.023460 27412 raft_consensus.cc:2368] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:10:42.237738 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:42.303184 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 65515.4us
I20260709 13:10:42.156529 31823 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:42.239907 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:42.306128 27342 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.241328 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:42.307081 27339 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.243731 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:42.245211 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 86900.5us
W20260709 13:10:42.245420 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85587.6us
I20260709 13:10:42.308445 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:42.056082 31930 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.246351 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.310451 27306 leader_election.cc:400] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:42.310843 27306 leader_election.cc:403] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.310765 27411 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:42.171692 32047 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:42.188973 31902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.005s	sys 0.009s
W20260709 13:10:42.248690 27380 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.011s	sys 0.015s
W20260709 13:10:42.318701 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 882121us
I20260709 13:10:42.319087 27342 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:42.320220 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.320757 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2263) took 1208 ms. Trace:
I20260709 13:10:42.321147 27412 rpcz_store.cc:276] 0709 13:10:41.112386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.319961 (+1207575us) service_pool.cc:224] Handling call
0709 13:10:42.320284 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.320462 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.320490 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.320529 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.320565 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.320614 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.320705 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.174448 31854 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:42.259414 27338 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:42.326993 31131 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.327559 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:42.237749 31961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.013s	sys 0.018s
W20260709 13:10:42.177902 31977 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.011s	sys 0.006s
I20260709 13:10:42.146042 31975 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.166810 31838 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.262697 27417 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
W20260709 13:10:42.355949 32086 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:10:42.356140 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 722) took 1225 ms. Trace:
I20260709 13:10:42.356527 27417 rpcz_store.cc:276] 0709 13:10:41.130434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.355086 (+1224652us) service_pool.cc:224] Handling call
0709 13:10:42.355480 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.355704 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.355732 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.355778 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.355826 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.355887 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.356013 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:42.357303 32048 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.000s
I20260709 13:10:42.358206 27413 raft_consensus.cc:2410] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:42.358502 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 724) took 1226 ms. Trace:
I20260709 13:10:42.274091 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.359613 27340 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:42.332613 32031 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:42.360608 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.360922 32031 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.361930 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.362783 27340 raft_consensus.cc:2393] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:42.363533 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:42.364889 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1836) took 1584 ms. Trace:
I20260709 13:10:42.364975 32074 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.365432 27410 rpcz_store.cc:276] 0709 13:10:40.780555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.780794 (+   239us) service_pool.cc:224] Handling call
0709 13:10:40.781111 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.818891 (+ 37780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.818930 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.819449 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.638075 (+818626us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:41.638112 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.638172 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.364658 (+726486us) raft_consensus.cc:1685] finished
0709 13:10:42.364680 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.364825 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37352,"raft.queue_time_us":41394,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7748,"thread_start_us":818328,"threads_started":1,"wal-append.queue_time_us":1349073}
I20260709 13:10:42.369028 28010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 600) took 1422 ms. Trace:
I20260709 13:10:42.369488 28010 rpcz_store.cc:276] 0709 13:10:40.946736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.947618 (+   882us) service_pool.cc:224] Handling call
0709 13:10:41.115556 (+167938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.213598 (+ 98042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.213642 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.214178 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.713938 (+499760us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:41.713995 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.080997 (+367002us) spinlock_profiling.cc:243] Waited 97.5 ms on lock 0x7b540060ead4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:42.081076 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.368699 (+287623us) raft_consensus.cc:1685] finished
0709 13:10:42.368723 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.368961 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4715,"raft.queue_time_us":1082,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":832,"spinlock_wait_cycles":224344960,"thread_start_us":499126,"threads_started":1,"wal-append.queue_time_us":1071464}
I20260709 13:10:42.230052 31899 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:42.371937 31899 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.277073 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.333961 32093 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:42.279691 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2592) took 1889 ms. Trace:
I20260709 13:10:42.378700 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.317801 31755 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:10:42.291675 27260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.017s	sys 0.026s
W20260709 13:10:42.291103 28009 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.003s	sys 0.032s
I20260709 13:10:42.381968 28015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 601) took 1434 ms. Trace:
W20260709 13:10:42.382016 27260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.017s	sys 0.026s
I20260709 13:10:42.382484 28015 rpcz_store.cc:276] 0709 13:10:40.947110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.947270 (+   160us) service_pool.cc:224] Handling call
0709 13:10:40.947728 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.181426 (+233698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.181470 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.182020 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.044008 (+861988us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:42.044061 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.084557 (+ 40496us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54006608d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:42.084611 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.376625 (+292014us) raft_consensus.cc:1685] finished
0709 13:10:42.376650 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.381897 (+  5247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15026,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18967,"spinlock_wait_cycles":536383360,"thread_start_us":810550,"threads_started":1,"wal-append.queue_time_us":1115715}
I20260709 13:10:42.256201 32072 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:42.423902 32072 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:42.425174 27411 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:42.424829 32072 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.425835 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 726) took 1287 ms. Trace:
I20260709 13:10:42.426158 27411 rpcz_store.cc:276] 0709 13:10:41.138147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.424680 (+1286533us) service_pool.cc:224] Handling call
0709 13:10:42.425011 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.425583 (+   572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.425785 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.171948 32071 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.256932 31798 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:42.427510 31798 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:42.428025 31798 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:42.270023 31652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.040s	sys 0.048s
I20260709 13:10:42.234194 32089 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:42.276366 31799 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.000s	sys 0.012s
W20260709 13:10:42.309419 27232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.015s	sys 0.022s
W20260709 13:10:42.430742 27232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.022s
I20260709 13:10:42.431665 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:42.309434 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.297015 31846 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.325387 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:42.330080 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:42.436576 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 106634us
I20260709 13:10:42.437250 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:42.348708 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:42.348969 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:42.349402 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:42.440279 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:42.323014 31902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.005s	sys 0.009s
I20260709 13:10:42.324607 32047 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:42.432293 31626 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.002s
I20260709 13:10:42.352599 32016 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.352950 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:42.470098 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 117207us
I20260709 13:10:42.471208 27308 leader_election.cc:400] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:10:42.471508 27308 leader_election.cc:403] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.353540 31749 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:42.348299 32002 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.275501 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.367558 32031 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.376170 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.278756 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:42.377207 27410 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:42.477190 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 725) took 1339 ms. Trace:
I20260709 13:10:42.477552 27410 rpcz_store.cc:276] 0709 13:10:41.137757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.368296 (+1230539us) service_pool.cc:224] Handling call
0709 13:10:42.377000 (+  8704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.476899 (+ 99899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.477129 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.380105 27340 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 9.
I20260709 13:10:42.480047 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.358975 27417 rpcz_store.cc:276] 0709 13:10:41.131933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.357610 (+1225677us) service_pool.cc:224] Handling call
0709 13:10:42.357951 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.358155 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.358187 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.358235 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:42.358275 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.358337 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.358446 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.379436 27263 rpcz_store.cc:276] 0709 13:10:40.441401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.454477 (+ 13076us) service_pool.cc:224] Handling call
0709 13:10:40.455043 (+   566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.455349 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:40.467976 (+ 12627us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.746322 (+278346us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b1800348dc0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:10:42.084981 (+1338659us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:42.272153 (+187172us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.272581 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.279320 (+  6739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.279374 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:42.279428 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.279496 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.279633 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6460,"prepare.queue_time_us":12300,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3136,"raft.queue_time_us":10481,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":33125,"spinlock_wait_cycles":86782208,"thread_start_us":1525255,"threads_started":2,"wal-append.queue_time_us":1306947}
W20260709 13:10:42.261181 32080 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:10:42.382189 28009 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.004s	sys 0.032s
W20260709 13:10:42.260111 31826 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.037s	sys 0.036s
I20260709 13:10:42.333585 31961 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:42.407862 31937 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:42.408787 31903 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.582s	user 0.005s	sys 0.012s
I20260709 13:10:42.410637 31838 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.381764 31755 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.412052 31432 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.378505 31975 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.414180 31899 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.416033 31744 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.417272 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.535962 27413 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:42.492110 31807 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:10:42.327358 31784 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:42.349943 31977 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.011s	sys 0.007s
I20260709 13:10:42.333204 31854 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.247872 32023 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.433096 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 727) took 1291 ms. Trace:
I20260709 13:10:42.559479 27411 rpcz_store.cc:276] 0709 13:10:41.142003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.426916 (+1284913us) service_pool.cc:224] Handling call
0709 13:10:42.432450 (+  5534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.432674 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.432712 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.432781 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:42.432834 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.432906 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.433032 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.561223 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.437358 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:42.428968 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
W20260709 13:10:42.563580 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126291us
I20260709 13:10:42.564131 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.448540 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.564734 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:42.565585 27337 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:42.566756 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.566905 31953 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:42.567704 31953 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.568138 31953 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.568251 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.449409 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.569701 27259 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:42.571415 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:42.572216 27411 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.451237 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.574921 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.576501 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.451902 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.384595 31879 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.452538 31713 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.578415 31713 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.578547 31879 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:42.578866 31713 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.579138 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.452979 32074 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.580164 32074 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.580893 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.455083 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:42.582355 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.455267 32065 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.428692 32071 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.430459 32089 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:42.461925 31870 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.351699 28008 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:42.483002 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.484803 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2266) took 1218 ms. Trace:
I20260709 13:10:42.489173 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:42.490856 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.447923 31594 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:42.584659 31870 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.582356 32074 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.585645 31594 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:42.585062 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.586143 31594 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:42.586467 27340 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:42.586630 31594 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:42.587301 32089 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.583364 31647 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:42.588805 31647 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:42.589255 31647 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.475054 32030 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:42.526414 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.520002 31849 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.010s	sys 0.025s
W20260709 13:10:42.591670 31849 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.011s	sys 0.025s
W20260709 13:10:42.419880 32087 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:10:42.542937 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:42.592649 27417 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.593802 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.594400 27259 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:42.527995 31755 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.594987 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.595993 27337 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:42.597245 27334 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:42.597348 27337 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:10:42.598727 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.485623 31626 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:42.582728 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 135542us
I20260709 13:10:42.599978 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:42.600792 31626 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.587491 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:42.601599 27233 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:42.602409 27410 rpcz_store.cc:276] 0709 13:10:41.266006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.478617 (+1212611us) service_pool.cc:224] Handling call
0709 13:10:42.479054 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.484443 (+  5389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.484474 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.484520 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.484560 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.484625 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.484745 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:42.604141 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.591497 32030 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:42.605299 32030 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:42.605350 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:42.500262 31949 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:42.606137 27410 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.606467 31949 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:42.607005 31949 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.608661 27334 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:42.549095 27341 raft_consensus.cc:2368] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:10:42.610471 32065 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:42.610845 32065 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.611150 32065 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.537297 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.612757 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.613797 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:42.614326 27413 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:42.586856 31870 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.619860 31594 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:42.638677 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.645613 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.651192 31594 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.653201 31713 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.499503 32002 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.515292 31903 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.682842 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2578) took 3361 ms. Trace:
W20260709 13:10:42.749532 27416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.017s	sys 0.016s
W20260709 13:10:42.774564 27416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.018s	sys 0.016s
I20260709 13:10:42.732795 27410 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:42.776116 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:42.744961 27417 raft_consensus.cc:2468] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:42.776672 27410 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:42.782146 27413 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:42.783728 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.810755 27410 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:42.977131 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:42.819785 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.012s	sys 0.031s
W20260709 13:10:42.979480 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.012s	sys 0.032s
W20260709 13:10:42.979889 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 917676us
W20260709 13:10:42.728775 32049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.022s	sys 0.041s
I20260709 13:10:42.825296 31713 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.751302 31755 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.546711 31744 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:42.826251 31903 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.988889 32049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.022s	sys 0.044s
I20260709 13:10:42.826881 31953 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.827896 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.833762 31524 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.835558 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2260) took 1876 ms. Trace:
I20260709 13:10:42.556428 31899 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:42.544531 31930 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.851835 31652 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.789721 31749 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.879865 27408 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.020s	sys 0.037s
W20260709 13:10:43.029529 27408 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.021s	sys 0.037s
I20260709 13:10:42.996968 32023 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:42.685811 31961 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:42.884490 31910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.008s	sys 0.050s
I20260709 13:10:42.931679 31432 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.952142 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.007s	sys 0.007s
W20260709 13:10:43.041059 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.007s	sys 0.007s
W20260709 13:10:43.041889 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 1.2143e+06us
I20260709 13:10:42.939232 32002 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:42.949882 32003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.000s	sys 0.023s
I20260709 13:10:42.992074 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:42.667065 31647 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:43.007273 28012 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.003s	sys 0.011s
I20260709 13:10:42.991130 31975 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:42.557758 31784 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:43.004935 31970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.013s	sys 0.015s
W20260709 13:10:43.047819 28012 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.003s	sys 0.012s
W20260709 13:10:43.037055 31798 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.007s
I20260709 13:10:43.007638 31949 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:43.047369 32003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.000s	sys 0.024s
W20260709 13:10:43.047139 31910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.008s	sys 0.056s
W20260709 13:10:43.062094 31970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.014s	sys 0.015s
I20260709 13:10:43.030890 32065 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.031032 32030 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.030371 31899 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:43.067134 32038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.001s	sys 0.022s
I20260709 13:10:43.042372 32089 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:43.073239 31937 consensus_meta.cc:287] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
W20260709 13:10:43.071669 32092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.021s	sys 0.054s
W20260709 13:10:43.081174 32038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.002s	sys 0.022s
W20260709 13:10:43.085207 32092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.021s	sys 0.054s
W20260709 13:10:43.099328 32072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.008s	sys 0.036s
W20260709 13:10:43.099810 32072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.008s	sys 0.036s
I20260709 13:10:43.118220 32089 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.107959 32116 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:10:43.116550 32111 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
W20260709 13:10:43.121008 32110 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
I20260709 13:10:43.136013 32116 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:43.136660 32116 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:43.137867 32116 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:43.139626 32114 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:10:43.121681 32121 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:10:43.150554 32141 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:43.151197 32141 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:43.152403 32141 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.160629 32116 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:42.776371 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:43.194711 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 418165us
W20260709 13:10:43.195530 27231 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.019s	sys 0.018s
W20260709 13:10:43.196213 27231 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.019s	sys 0.018s
W20260709 13:10:43.196993 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.06834e+06us
I20260709 13:10:42.819133 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.745280 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:43.202108 27263 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:43.203470 27262 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.008s	sys 0.015s
I20260709 13:10:43.203049 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.203540 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:43.204190 27262 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.008s	sys 0.015s
I20260709 13:10:43.205513 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:42.772565 27265 rpcz_store.cc:276] 0709 13:10:39.321003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.321114 (+   111us) service_pool.cc:224] Handling call
0709 13:10:39.321443 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.527708 (+1206265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:40.562127 (+ 34419us) log.cc:844] Serialized 14 byte log entry
0709 13:10:41.318256 (+756129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.318681 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.318838 (+   157us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:41.318869 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.452466 (+133597us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800399340. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419
0709 13:10:41.487648 (+ 35182us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003034d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:41.487695 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.100947 (+613252us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:42.682593 (+581646us) raft_consensus.cc:1685] finished
0709 13:10:42.682619 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.682775 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36118,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":53321,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":12438,"spinlock_wait_cycles":2601365504,"thread_start_us":876007,"threads_started":2,"wal-append.queue_time_us":1151669}
I20260709 13:10:43.206177 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 682) took 1980 ms. Trace:
I20260709 13:10:43.206629 27259 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:42.852449 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.207939 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:42.866140 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2595) took 1548 ms (client timeout 1586 ms). Trace:
I20260709 13:10:43.208354 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.208858 27265 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
W20260709 13:10:43.208886 27266 rpcz_store.cc:269] 0709 13:10:41.307528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.307700 (+   172us) service_pool.cc:224] Handling call
0709 13:10:42.843465 (+1535765us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000b86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:42.855652 (+ 12187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783928704}
I20260709 13:10:43.205578 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.210181 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.210951 27263 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.212170 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.208276 27264 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.213537 27263 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:43.212285 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:43.210203 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:43.214159 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.214587 27265 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.215669 27259 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 13: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.217039 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.214243 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.218570 27264 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:43.218675 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.219803 27259 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:10:43.219759 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.220965 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.221380 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.222236 27259 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:10:43.223658 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:43.226827 27306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.002s	sys 0.010s
W20260709 13:10:43.229818 27306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.003s	sys 0.010s
W20260709 13:10:43.227097 27336 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.012s	sys 0.008s
W20260709 13:10:43.231561 27336 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.012s	sys 0.008s
W20260709 13:10:43.227422 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.016s
W20260709 13:10:43.229300 27335 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.010s	sys 0.021s
I20260709 13:10:43.030675 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 720) took 2208 ms. Trace:
I20260709 13:10:43.279795 27408 rpcz_store.cc:276] 0709 13:10:40.822375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.870034 (+ 47659us) service_pool.cc:224] Handling call
0709 13:10:40.870369 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.870621 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:41.968071 (+1097450us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.030131 (+1062060us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.030213 (+    82us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:43.030296 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.030393 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.030580 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38551,"prepare.queue_time_us":291600,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5041,"raft.queue_time_us":1319,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8950,"thread_start_us":1996253,"threads_started":2,"wal-append.queue_time_us":1138014}
W20260709 13:10:43.266322 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.006s	sys 0.014s
W20260709 13:10:43.283396 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.007s	sys 0.014s
W20260709 13:10:43.283855 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 656656us
I20260709 13:10:43.285240 32065 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:43.287652 32047 consensus_meta.cc:287] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.824s	user 0.008s	sys 0.005s
I20260709 13:10:43.288496 32047 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:42.983035 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:42.918958 27411 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:43.011679 27414 rpcz_store.cc:276] 0709 13:10:40.959196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.218746 (+259550us) service_pool.cc:224] Handling call
0709 13:10:41.219136 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.386014 (+166878us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:41.397629 (+ 11615us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.268810 (+871181us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:42.269444 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.269602 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:42.269635 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.332089 (+ 62454us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54000adf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:42.332170 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.835259 (+503089us) raft_consensus.cc:1685] finished
0709 13:10:42.835359 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.835500 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":675,"prepare.queue_time_us":12574,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":53,"raft.queue_time_us":1962,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":23960,"spinlock_wait_cycles":289166208,"thread_start_us":870740,"threads_started":1,"wal-append.queue_time_us":1316327}
W20260709 13:10:43.049257 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.999150 27415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.016s	sys 0.016s
W20260709 13:10:43.292502 31807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.014s
W20260709 13:10:43.293061 27415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.017s	sys 0.016s
W20260709 13:10:43.293174 31807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.003s	sys 0.014s
I20260709 13:10:43.293673 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1838) took 2512 ms. Trace:
W20260709 13:10:43.256194 27335 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.010s	sys 0.022s
I20260709 13:10:43.294562 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2262) took 2182 ms. Trace:
I20260709 13:10:43.034088 31749 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.295879 31953 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:43.100955 32023 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:43.256336 27340 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.002s	sys 0.013s
W20260709 13:10:43.298414 27340 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.002s	sys 0.013s
W20260709 13:10:43.257331 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.256748 31626 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:43.257838 27412 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.009s	sys 0.006s
W20260709 13:10:43.259179 28009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.018s	sys 0.000s
W20260709 13:10:43.259078 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 266966us
W20260709 13:10:43.260433 27343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.000s	sys 0.031s
I20260709 13:10:43.261929 31744 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.031742 31652 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:43.263492 27380 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.006s	sys 0.022s
I20260709 13:10:43.066064 31798 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.265687 27417 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:43.266278 31755 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.269740 31784 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:43.271494 31902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.013s	sys 0.019s
I20260709 13:10:43.274155 31899 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:43.096009 31826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.014s
W20260709 13:10:43.275868 27342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.002s	sys 0.019s
W20260709 13:10:43.276423 27338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.009s	sys 0.009s
W20260709 13:10:43.277064 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.005s	sys 0.016s
I20260709 13:10:43.278234 31647 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:42.978790 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.335563 31870 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:43.289141 31949 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.337575 31949 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.298455 32142 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.338295 31949 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.257025 27339 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:43.306906 32047 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:43.340094 31826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.012s	sys 0.015s
I20260709 13:10:43.274801 32030 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.298310 31749 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:43.321713 28009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.018s	sys 0.000s
W20260709 13:10:43.323446 27380 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.007s	sys 0.023s
I20260709 13:10:43.343156 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:43.343969 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 1.02128e+06us
W20260709 13:10:43.322176 27343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.000s	sys 0.032s
I20260709 13:10:43.346585 31652 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.346824 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2330) took 1069 ms. Trace:
I20260709 13:10:43.347262 27343 rpcz_store.cc:276] 0709 13:10:42.276946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.277092 (+   146us) service_pool.cc:224] Handling call
0709 13:10:42.305417 (+ 28325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.307536 (+  2119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.307581 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.308113 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.346222 (+1038109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.346308 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.346429 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.346489 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:43.346509 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.346682 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9572,"raft.queue_time_us":1764,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12891,"thread_start_us":984337,"threads_started":1,"wal-append.queue_time_us":797451}
W20260709 13:10:43.321211 27412 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.009s	sys 0.006s
W20260709 13:10:43.329413 27342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.002s	sys 0.019s
I20260709 13:10:43.349685 31798 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.350452 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2333) took 1068 ms. Trace:
I20260709 13:10:43.206835 27262 rpcz_store.cc:276] 0709 13:10:41.225918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.226181 (+   263us) service_pool.cc:224] Handling call
0709 13:10:41.226662 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:41.227233 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.227272 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:41.228027 (+   755us) log.cc:844] Serialized 52 byte log entry
0709 13:10:42.045329 (+817302us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.204926 (+1159597us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.205597 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.205736 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.205823 (+    87us) raft_consensus.cc:1685] finished
0709 13:10:43.205834 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.206083 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":670635,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":1104,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7420,"thread_start_us":1881422,"threads_started":2,"wal-append.queue_time_us":1069812}
I20260709 13:10:43.352772 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.353665 27262 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:43.354339 31949 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.354717 31937 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.355381 27266 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:43.355443 31937 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.294235 27416 rpcz_store.cc:276] 0709 13:10:40.781178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.782156 (+   978us) service_pool.cc:224] Handling call
0709 13:10:40.782451 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.830065 (+ 47614us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:41.760075 (+930010us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.802066 (+1041991us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.802744 (+   678us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.802932 (+   188us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:42.803549 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 13:10:42.804028 (+   479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.804144 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.293171 (+489027us) raft_consensus.cc:1685] finished
0709 13:10:43.293210 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.293442 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60727,"prepare.queue_time_us":303483,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":74319,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":12063,"thread_start_us":1684401,"threads_started":2,"wal-append.queue_time_us":1208979}
I20260709 13:10:43.357070 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.357903 27416 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:43.305188 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.358830 27408 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.295089 27415 rpcz_store.cc:276] 0709 13:10:41.112102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.268802 (+1156700us) service_pool.cc:224] Handling call
0709 13:10:42.269172 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.269546 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.269588 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.280136 (+ 10548us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.293941 (+1013805us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.294054 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.294203 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.294286 (+    83us) raft_consensus.cc:1685] finished
0709 13:10:43.294298 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.294483 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"raft.queue_time_us":1422,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":23854,"thread_start_us":1013203,"threads_started":1,"wal-append.queue_time_us":869651}
W20260709 13:10:43.330824 31902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.014s	sys 0.019s
I20260709 13:10:43.361348 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1848) took 1982 ms. Trace:
I20260709 13:10:43.361865 27415 rpcz_store.cc:276] 0709 13:10:41.378647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.359866 (+1981219us) service_pool.cc:224] Handling call
0709 13:10:43.360405 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.360902 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.360939 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.361010 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.361057 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.361133 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.361259 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.336274 27410 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:43.363142 31910 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:43.336771 27409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.011s	sys 0.020s
W20260709 13:10:43.364905 27409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.202s	user 0.012s	sys 0.020s
I20260709 13:10:43.366106 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2261) took 2399 ms. Trace:
I20260709 13:10:43.338927 32142 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.367219 32104 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.368198 32104 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.369424 32142 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.373068 31626 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:43.374085 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 729) took 2109 ms. Trace:
I20260709 13:10:43.374796 31626 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.375378 32030 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:43.376354 32030 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.340791 31713 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:43.329818 27338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.010s	sys 0.009s
I20260709 13:10:43.361613 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 730) took 2091 ms. Trace:
I20260709 13:10:43.373106 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:43.381642 27417 rpcz_store.cc:276] 0709 13:10:41.270326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.015366 (+1745040us) service_pool.cc:224] Handling call
0709 13:10:43.015800 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.358377 (+342577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.361303 (+  2926us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400086954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:43.361536 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573146880}
I20260709 13:10:43.366494 27409 rpcz_store.cc:276] 0709 13:10:40.966803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.147260 (+1180457us) service_pool.cc:224] Handling call
0709 13:10:42.161626 (+ 14366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.162025 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:42.162054 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.162528 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.365574 (+1203046us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.365664 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.365789 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.365846 (+    57us) raft_consensus.cc:1685] finished
0709 13:10:43.365858 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.366023 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":452,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":1202495,"threads_started":1,"wal-append.queue_time_us":973439}
W20260709 13:10:43.393767 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 56381.3us
I20260709 13:10:43.358217 31937 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:43.374680 27412 rpcz_store.cc:276] 0709 13:10:41.264695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.427750 (+1163055us) service_pool.cc:224] Handling call
0709 13:10:42.427998 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.428180 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:42.428473 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.373359 (+944886us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.373495 (+   136us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.373607 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.373741 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.374001 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23850,"prepare.queue_time_us":636,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":28677,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":920476,"threads_started":1,"wal-append.queue_time_us":718922}
I20260709 13:10:43.350936 27342 rpcz_store.cc:276] 0709 13:10:42.281999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.321283 (+ 39284us) service_pool.cc:224] Handling call
0709 13:10:42.321620 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.330639 (+  9019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.330672 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.331125 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.349907 (+1018782us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.349992 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.350094 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.350132 (+    38us) raft_consensus.cc:1685] finished
0709 13:10:43.350145 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.350373 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8577,"raft.queue_time_us":26762,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":1001612,"threads_started":1,"wal-append.queue_time_us":780264}
I20260709 13:10:43.402750 32104 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:43.432554 27308 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.434095 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.435396 27409 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:43.436890 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.438158 27409 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:43.439990 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 97134.5us
I20260709 13:10:43.440330 31902 raft_consensus.cc:2804] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:43.441022 31902 raft_consensus.cc:697] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:43.442230 31902 consensus_queue.cc:237] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:43.444335 31854 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.003s
I20260709 13:10:43.444825 31854 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.446121 27267 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:43.449652 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:43.451769 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:43.452342 27233 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.452697 27416 raft_consensus.cc:1240] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:43.453724 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2268) took 2093 ms. Trace:
I20260709 13:10:43.453909 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.454237 27416 rpcz_store.cc:276] 0709 13:10:41.359995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.358873 (+1998878us) service_pool.cc:224] Handling call
0709 13:10:43.390422 (+ 31549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.453294 (+ 62872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.453621 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.456584 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:43.459287 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.420277 31953 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.474241 27265 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:43.477604 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1736) took 1020 ms. Trace:
I20260709 13:10:43.479754 31823 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:10:43.480770 27261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.009s	sys 0.005s
W20260709 13:10:43.481175 27261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.009s	sys 0.006s
W20260709 13:10:43.483340 27337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.009s	sys 0.005s
I20260709 13:10:43.427837 31713 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:43.478032 27265 rpcz_store.cc:276] 0709 13:10:42.457663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.209765 (+752102us) service_pool.cc:224] Handling call
0709 13:10:43.477524 (+267759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.447067 31854 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.466357 31647 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.512400 27408 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:43.471387 31937 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:43.527233 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.534516 27408 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.530902 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.532384 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.537106 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.539610 27409 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:43.540762 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 734) took 2135 ms. Trace:
I20260709 13:10:43.541285 27409 rpcz_store.cc:276] 0709 13:10:41.404929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.439036 (+2034107us) service_pool.cc:224] Handling call
0709 13:10:43.502161 (+ 63125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.540305 (+ 38144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.540680 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:43.519598 27306 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.515s (SENT) [suppressed 5 similar messages]
I20260709 13:10:43.543300 32150 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:43.544152 32150 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.545523 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.546777 27413 raft_consensus.cc:2410] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:10:43.547780 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.548064 32072 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:43.548480 32072 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:43.543344 27260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.022s	sys 0.019s
W20260709 13:10:43.549692 27260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.022s	sys 0.019s
I20260709 13:10:43.548540 27408 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:43.518939 31647 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.553943 27334 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:43.542974 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.548921 32072 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:43.558168 27409 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:43.560071 27308 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.578154 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1850) took 2193 ms. Trace:
I20260709 13:10:43.578878 27415 rpcz_store.cc:276] 0709 13:10:41.379848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.382701 (+2002853us) service_pool.cc:224] Handling call
0709 13:10:43.424397 (+ 41696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.562810 (+138413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.562876 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.573302 (+ 10426us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.573368 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.573460 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.573665 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.559823 31647 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.606137 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2271) took 1837 ms. Trace:
I20260709 13:10:43.607319 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2334) took 1324 ms. Trace:
I20260709 13:10:43.622776 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:43.627377 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 254503us
I20260709 13:10:43.626849 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 733) took 2227 ms. Trace:
I20260709 13:10:43.633774 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.634265 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.627895 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.623790 27416 rpcz_store.cc:276] 0709 13:10:41.768336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.478582 (+1710246us) service_pool.cc:224] Handling call
0709 13:10:43.559430 (+ 80848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.605627 (+ 46197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.605674 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.605752 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.605800 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.605894 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.606060 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:43.626449 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 124213us
I20260709 13:10:43.630503 27414 rpcz_store.cc:276] 0709 13:10:41.348932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.292601 (+1943669us) service_pool.cc:224] Handling call
0709 13:10:43.551578 (+258977us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:43.551904 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.568799 (+ 16895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.568829 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.574531 (+  5702us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:43.574597 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.574676 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.576190 (+  1514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27820928}
I20260709 13:10:43.582777 32150 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:43.628827 27233 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.646073 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:43.672173 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 169699us
I20260709 13:10:43.577121 31953 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.636561 31854 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.624631 27338 rpcz_store.cc:276] 0709 13:10:42.282449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.328549 (+ 46100us) service_pool.cc:224] Handling call
0709 13:10:42.328919 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.329322 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.329365 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.329904 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.524161 (+1194257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.569934 (+ 45773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.574828 (+  4894us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.574899 (+    71us) raft_consensus.cc:1685] finished
0709 13:10:43.574917 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.607249 (+ 32332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19312,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":1053558,"threads_started":1,"wal-append.queue_time_us":821986}
I20260709 13:10:43.561426 32153 consensus_queue.cc:1059] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
W20260709 13:10:43.676923 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 115083us
I20260709 13:10:43.682487 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.684144 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:43.698760 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2272) took 1571 ms. Trace:
I20260709 13:10:43.699333 27412 rpcz_store.cc:276] 0709 13:10:42.127411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.478152 (+1350741us) service_pool.cc:224] Handling call
0709 13:10:43.559622 (+ 81470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.691928 (+132306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.691973 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.698398 (+  6425us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:43.698462 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.698544 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.698692 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:43.691710 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 479657us
I20260709 13:10:43.704511 31713 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.708048 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:43.709200 28008 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:43.711504 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.711798 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.713133 28006 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:43.713281 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.715950 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.716836 27342 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:43.717976 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.719348 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:43.720098 27417 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:43.720366 31953 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.718446 27265 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.720582 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:43.701591 27980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.021s	sys 0.023s
I20260709 13:10:43.728509 27263 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:43.718539 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.730156 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:43.733685 27980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.021s	sys 0.024s
I20260709 13:10:43.735942 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:43.737604 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:43.738375 28007 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:43.730938 28015 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 8.
I20260709 13:10:43.745797 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:43.743938 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52136.9us
W20260709 13:10:43.751083 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 64245.6us
I20260709 13:10:43.697757 32064 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:43.746351 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.726951 31937 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.739219 32142 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:43.737941 32154 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:43.766410 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.701407 31854 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:43.757586 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 705298us
I20260709 13:10:43.767407 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:43.783053 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.783325 31975 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:43.784096 32151 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:10:43.784526 27308 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.787786 31854 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:43.789969 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:43.792327 31798 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:43.792372 32142 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:43.783466 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2332) took 1502 ms. Trace:
I20260709 13:10:43.795419 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.795774 32142 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.796788 31937 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.797708 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:43.798050 32116 consensus_meta.cc:287] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.002s
I20260709 13:10:43.799427 31798 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:43.803304 31798 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:43.796281 27263 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:43.809082 27409 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
W20260709 13:10:43.811609 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 122806us
I20260709 13:10:43.811911 28007 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:10:43.812253 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 311127us
I20260709 13:10:43.816552 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.828894 27417 raft_consensus.cc:2410] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:43.830929 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:43.832818 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.833467 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1861) took 1336 ms. Trace:
I20260709 13:10:43.835229 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:43.832235 27408 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:43.833949 27414 rpcz_store.cc:276] 0709 13:10:42.497334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.653586 (+1156252us) service_pool.cc:224] Handling call
0709 13:10:43.730268 (+ 76682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.821837 (+ 91569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.821870 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.833129 (+ 11259us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.833193 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.833264 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.833402 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7256}
I20260709 13:10:43.804159 31798 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:43.804591 32154 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:43.795310 27336 rpcz_store.cc:276] 0709 13:10:42.280637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.280759 (+   122us) service_pool.cc:224] Handling call
0709 13:10:42.281172 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.281455 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:43.257841 (+976386us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.735949 (+478108us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.737317 (+  1368us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18001fcc60. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:43.778975 (+ 41658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.783015 (+  4040us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.783122 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.783234 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.783412 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177032,"prepare.queue_time_us":931635,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":129805,"raft.run_cpu_time_us":501,"raft.run_wall_time_us":54213,"spinlock_wait_cycles":4298496,"thread_start_us":1182150,"threads_started":2,"wal-append.queue_time_us":434717}
W20260709 13:10:43.851917 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.846203 27412 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:10:43.853513 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1867) took 1320 ms. Trace:
I20260709 13:10:43.855562 27412 rpcz_store.cc:276] 0709 13:10:42.533572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.722379 (+1188807us) service_pool.cc:224] Handling call
0709 13:10:43.770689 (+ 48310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.853188 (+ 82499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.853449 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.858438 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.854652 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:43.859838 28008 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:43.814782 31784 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:43.862979 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 81196.7us
I20260709 13:10:43.865360 28015 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:43.867551 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:43.860550 31937 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.890796 27414 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:10:43.885553 31910 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.000s
I20260709 13:10:43.895920 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:43.899523 32067 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:43.900249 32067 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:43.900393 31798 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.896821 27263 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:43.914814 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 697) took 2518 ms. Trace:
I20260709 13:10:43.916805 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:43.919358 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 135488us
I20260709 13:10:43.909049 31910 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:43.932950 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 133799us
I20260709 13:10:43.934079 27417 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:43.915417 28009 rpcz_store.cc:276] 0709 13:10:41.389847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.389988 (+   141us) service_pool.cc:224] Handling call
0709 13:10:41.390309 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.390549 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:42.487386 (+1096837us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.770990 (+1283604us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.832756 (+ 61766us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.848076 (+ 15320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.855756 (+  7680us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.855816 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.868439 (+ 12623us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.908593 (+ 40154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72817,"prepare.queue_time_us":942839,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":78467,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":117092,"spinlock_wait_cycles":11258752,"thread_start_us":2188627,"threads_started":3,"wal-append.queue_time_us":666983}
I20260709 13:10:43.950109 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:43.946549 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:43.955860 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 696) took 2487 ms. Trace:
W20260709 13:10:43.965456 32159 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:43.967738 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1724) took 1514 ms. Trace:
I20260709 13:10:43.968380 32067 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:43.952174 32023 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:43.977537 31784 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:43.979259 32123 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:10:43.979661 32156 log.cc:927] Time spent T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:10:43.980288 32140 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:44.029295 32140 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:44.030743 32134 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:44.030646 32140 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.980733 32030 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:43.983222 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1734) took 1526 ms. Trace:
I20260709 13:10:44.032217 27259 rpcz_store.cc:276] 0709 13:10:42.457105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.224827 (+767722us) service_pool.cc:224] Handling call
0709 13:10:43.225445 (+   618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.395377 (+169932us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:43.395426 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.451439 (+ 56013us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.745064 (+293625us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:43.745115 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.745199 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.982902 (+237703us) raft_consensus.cc:1685] finished
0709 13:10:43.982931 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.983124 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141515,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":311,"spinlock_wait_cycles":27776,"thread_start_us":454805,"threads_started":2,"wal-append.queue_time_us":455778}
W20260709 13:10:43.992831 32130 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:10:44.035890 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2598) took 2655 ms. Trace:
I20260709 13:10:44.036268 27261 rpcz_store.cc:276] 0709 13:10:41.380814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.381003 (+   189us) service_pool.cc:224] Handling call
0709 13:10:41.381434 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.409510 (+ 28076us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:42.297346 (+887836us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.482097 (+1184751us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.482351 (+   254us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.483005 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.494717 (+ 11712us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.494783 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.500986 (+  6203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.004499 (+503513us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b48002907d8. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd87b5aaa1 00007fbd87b51b37 00007fbd87b519ca 00007fbd87c4926f 00007fbd87c48f37 00007fbd87c5d55c 00007fbd87c5d508 00007fbd87c5d488 00007fbd87c5d443 00007fbd87c5c6ec 00007fbd86b86a96
0709 13:10:44.035636 (+ 31137us) raft_consensus.cc:1685] finished
0709 13:10:44.035660 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.035813 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35864,"prepare.queue_time_us":1263779,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":129,"raft.queue_time_us":32552,"raft.run_cpu_time_us":1989,"raft.run_wall_time_us":524564,"spinlock_wait_cycles":30666752,"thread_start_us":2008722,"threads_started":2,"wal-append.queue_time_us":1382565}
W20260709 13:10:43.990329 32117 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.920s	user 0.000s	sys 0.003s
I20260709 13:10:44.006371 32151 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:44.057509 32151 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:44.057993 32151 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:44.058128 27339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2609) took 1670 ms (client timeout 2022 ms). Trace:
W20260709 13:10:44.060253 32164 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:10:44.064663 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1718) took 1615 ms. Trace:
I20260709 13:10:44.065114 27267 rpcz_store.cc:276] 0709 13:10:42.449137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.450039 (+   902us) service_pool.cc:224] Handling call
0709 13:10:42.450442 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.446528 (+996086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.064359 (+617831us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540031f1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:44.064599 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288962944}
I20260709 13:10:43.968219 27264 rpcz_store.cc:276] 0709 13:10:42.453697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.222433 (+768736us) service_pool.cc:224] Handling call
0709 13:10:43.223022 (+   589us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:43.427487 (+204465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.427538 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.487468 (+ 59930us) log.cc:844] Serialized 52 byte log entry
0709 13:10:43.696567 (+209099us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.893304 (+196737us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.893567 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.893697 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.967529 (+ 73832us) raft_consensus.cc:1685] finished
0709 13:10:43.967548 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.967677 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11984,"prepare.queue_time_us":74423,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":31193,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":41044,"thread_start_us":340818,"threads_started":2,"wal-append.queue_time_us":370248}
W20260709 13:10:43.989475 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 221024us
I20260709 13:10:43.969445 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2600) took 1616 ms. Trace:
W20260709 13:10:44.058661 27339 rpcz_store.cc:269] 0709 13:10:42.387781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.563891 (+176110us) service_pool.cc:224] Handling call
0709 13:10:44.057839 (+1493948us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54001685d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:44.058028 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590388480}
I20260709 13:10:44.015631 28008 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:10:44.018596 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 68226.3us
W20260709 13:10:44.018750 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 89127.4us
W20260709 13:10:44.021281 32163 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:10:44.021731 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2324) took 1779 ms. Trace:
I20260709 13:10:44.023475 31652 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:44.024976 31846 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.561s	user 0.003s	sys 0.025s
I20260709 13:10:43.960271 32154 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:43.969059 31626 raft_consensus.cc:3055] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:44.029367 32145 log.cc:927] Time spent T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:10:44.000783 32141 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:44.049122 27342 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:44.051684 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126088us
I20260709 13:10:44.054369 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2599) took 2673 ms. Trace:
I20260709 13:10:44.055636 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:44.056174 32064 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:43.961409 28012 rpcz_store.cc:276] 0709 13:10:41.381893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.382377 (+   484us) service_pool.cc:224] Handling call
0709 13:10:41.382734 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.383004 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:42.302411 (+919407us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.766007 (+1463596us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.813549 (+ 47542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.821909 (+  8360us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.842756 (+ 20847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.854906 (+ 12150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.868826 (+ 13920us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19244,"prepare.queue_time_us":1375621,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":6950,"raft.queue_time_us":101527,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":1359,"thread_start_us":2204845,"threads_started":4,"wal-append.queue_time_us":822445}
I20260709 13:10:44.010021 31647 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.075207 27340 rpcz_store.cc:276] 0709 13:10:42.352649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.601902 (+249253us) service_pool.cc:224] Handling call
0709 13:10:42.602161 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.602486 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.299186 (+696700us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.778874 (+479688us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.793073 (+ 14199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.793731 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.793917 (+   186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:43.793958 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.794061 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.969157 (+175096us) raft_consensus.cc:1685] finished
0709 13:10:43.969182 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.969376 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74484,"prepare.queue_time_us":564300,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":184953,"raft.run_cpu_time_us":522,"raft.run_wall_time_us":52778,"thread_start_us":1038164,"threads_started":2,"wal-append.queue_time_us":544940}
I20260709 13:10:44.104723 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:44.112879 27336 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.106290 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.110180 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:44.089308 31975 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:44.096890 31626 raft_consensus.cc:740] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:44.103395 32064 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.097909 27260 rpcz_store.cc:276] 0709 13:10:41.381159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.383984 (+  2825us) service_pool.cc:224] Handling call
0709 13:10:41.384312 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.414516 (+ 30204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:42.383093 (+968577us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.550538 (+1167445us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.550722 (+   184us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.628587 (+ 77865us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.634597 (+  6010us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:43.839797 (+205200us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.840021 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.845279 (+  5258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.039208 (+193929us) raft_consensus.cc:1685] finished
0709 13:10:44.039227 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.054305 (+ 15078us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92783,"prepare.queue_time_us":1313638,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":123,"raft.queue_time_us":59808,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":19042,"thread_start_us":2290909,"threads_started":3,"wal-append.queue_time_us":1512821}
I20260709 13:10:44.109651 31652 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:44.139133 31652 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:44.143621 31524 consensus_meta.cc:287] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.115s	user 0.006s	sys 0.010s
I20260709 13:10:44.144382 31524 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:44.148814 27306 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.152153 32047 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:44.152679 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 217174us
I20260709 13:10:44.152734 27341 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:44.152766 31949 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.154948 31949 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.134930 31975 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.156304 31744 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:44.157356 31744 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.157714 31744 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:44.155370 27338 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 8.
W20260709 13:10:44.159898 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61281.5us
I20260709 13:10:44.158828 31744 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.161774 31744 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.150154 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.084707 27335 rpcz_store.cc:276] 0709 13:10:42.242235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.242406 (+   171us) service_pool.cc:224] Handling call
0709 13:10:42.272700 (+ 30294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.272929 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:43.295141 (+1022212us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.736616 (+441475us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.793752 (+ 57136us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.793958 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.794017 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:43.794105 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.794265 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.021439 (+227174us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b54001fb650. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:44.021669 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125224,"prepare.queue_time_us":900798,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":133,"raft.queue_time_us":92095,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":24884,"spinlock_wait_cycles":68760832,"thread_start_us":1340804,"threads_started":2,"wal-append.queue_time_us":495931}
I20260709 13:10:44.163025 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1851) took 2782 ms. Trace:
I20260709 13:10:44.146581 31524 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:44.189155 31647 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.200898 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:44.167838 27410 rpcz_store.cc:276] 0709 13:10:41.380144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.363492 (+1983348us) service_pool.cc:224] Handling call
0709 13:10:43.363994 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:43.637577 (+273583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.637617 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:43.694638 (+ 57021us) log.cc:844] Serialized 52 byte log entry
0709 13:10:43.942690 (+248052us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:43.942726 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.942807 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.162799 (+219992us) raft_consensus.cc:1685] finished
0709 13:10:44.162821 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.162966 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7070,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":261,"thread_start_us":446415,"threads_started":2,"wal-append.queue_time_us":400642}
W20260709 13:10:44.216087 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 81690us
W20260709 13:10:44.216101 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 66046.9us
I20260709 13:10:44.217584 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.222218 32137 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.221097 31807 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.223877 31970 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:44.223819 31807 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.224676 32178 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:10:44.105321 31846 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.226091 31807 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.233031 27268 raft_consensus.cc:2368] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
W20260709 13:10:44.232847 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 135971us
W20260709 13:10:44.234431 27268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1722) took 1783 ms (client timeout 1807 ms). Trace:
I20260709 13:10:44.240549 32104 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:44.241287 32104 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:44.241971 32072 consensus_meta.cc:287] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.005s
I20260709 13:10:44.242455 32072 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.227072 31626 consensus_queue.cc:260] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.228245 27408 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:44.220963 32023 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:44.229009 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2599) took 1876 ms. Trace:
I20260709 13:10:44.233063 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:44.243664 32104 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:44.262082 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 44623us
W20260709 13:10:44.248413 32160 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.353s	user 0.004s	sys 0.000s
I20260709 13:10:44.086576 32151 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.252476 31807 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:44.252696 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.253121 31974 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:44.254180 32155 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:44.226578 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71633.5us
I20260709 13:10:44.221580 31784 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:44.269435 31784 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:44.269838 31784 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:44.269726 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:44.270334 27408 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.274580 32151 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.278695 31949 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.279345 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.261037 27336 raft_consensus.cc:2468] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
W20260709 13:10:44.234921 27268 rpcz_store.cc:269] 0709 13:10:42.450574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.599698 (+149124us) service_pool.cc:224] Handling call
0709 13:10:44.234159 (+1634461us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003093d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:44.234348 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3753489152}
I20260709 13:10:44.227120 31846 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:44.278422 31432 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:44.265563 31902 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.294116 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2608) took 1091 ms. Trace:
I20260709 13:10:44.269449 31807 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.294484 31755 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.295436 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.294611 27266 rpcz_store.cc:276] 0709 13:10:43.202862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.356323 (+153461us) service_pool.cc:224] Handling call
0709 13:10:43.356731 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.357189 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.357215 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.357897 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.673290 (+315393us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:43.673345 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.673433 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.247475 (+574042us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:44.293803 (+ 46328us) raft_consensus.cc:1685] finished
0709 13:10:44.293823 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.294058 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34942336,"thread_start_us":300877,"threads_started":1,"wal-append.queue_time_us":486649}
I20260709 13:10:44.296327 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.296738 31807 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.297077 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.297755 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.268501 31974 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:44.292114 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2281) took 1688 ms. Trace:
I20260709 13:10:44.291785 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.306496 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.300726 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:44.262075 27337 rpcz_store.cc:276] 0709 13:10:42.352336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.598066 (+245730us) service_pool.cc:224] Handling call
0709 13:10:42.817209 (+219143us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:42.817462 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.823066 (+  5604us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:43.484271 (+661205us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.943319 (+459048us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.948604 (+  5285us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.992794 (+ 44190us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4800221f58. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd87b5aaa1 00007fbd87b51b37 00007fbd87b519ca 00007fbd87c4926f 00007fbd87c48f37 00007fbd87c5d55c 00007fbd87c5d508 00007fbd87c5d488 00007fbd87c5d443 00007fbd87c5c6ec 00007fbd86b86a96
0709 13:10:44.010934 (+ 18140us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.012322 (+  1388us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:44.012742 (+   420us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.044975 (+ 32233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.077300 (+ 32325us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.228763 (+151463us) raft_consensus.cc:1685] finished
0709 13:10:44.228791 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.228948 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71452,"prepare.queue_time_us":319349,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":144,"raft.queue_time_us":96004,"raft.run_cpu_time_us":3408,"raft.run_wall_time_us":218023,"spinlock_wait_cycles":77877888,"thread_start_us":944934,"threads_started":3,"wal-append.queue_time_us":731893}
I20260709 13:10:44.288806 32104 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:44.314492 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 79617.9us
I20260709 13:10:44.290562 31902 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.290861 32178 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.303642 27413 rpcz_store.cc:276] 0709 13:10:42.603846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.706172 (+1102326us) service_pool.cc:224] Handling call
0709 13:10:43.706610 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.706964 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:43.894118 (+187154us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.291075 (+396957us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.291753 (+   678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.291807 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:44.291859 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.291930 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.292058 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2726,"prepare.queue_time_us":389620,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5146,"thread_start_us":479893,"threads_started":2}
I20260709 13:10:44.313736 31647 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:44.335464 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.339743 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.280095 32141 consensus_queue.cc:1175] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 13 index: 12 } }
I20260709 13:10:44.316429 32104 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:44.323505 31854 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:44.341760 27408 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:44.314491 31807 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.352200 32179 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:44.353880 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.354185 27268 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:10:44.354651 27268 pending_rounds.cc:85] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 5
I20260709 13:10:44.354934 27268 pending_rounds.cc:107] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:10:44.355278 27268 raft_consensus.cc:2889] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.319360 31755 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:44.319896 31902 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.343211 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:44.351154 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.334331 31626 raft_consensus.cc:3060] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.346601 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:44.351975 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.364038 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.323246 32155 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:10:44.369096 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.399477 27264 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:44.370317 27260 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:44.370843 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.370500 31974 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.371811 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.401728 27267 raft_consensus.cc:2393] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:44.349687 32104 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.403718 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.404467 27262 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:44.405457 32161 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:44.377470 32116 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:44.365077 31899 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.387799 32064 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.368965 27978 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:44.333624 31949 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:44.397356 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.403200 31974 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:44.407337 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 106731us
I20260709 13:10:44.363866 32186 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.413411 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44529.7us
I20260709 13:10:44.414250 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.368710 31854 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:44.419484 27413 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 10.
I20260709 13:10:44.359918 32178 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.449499 27265 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:44.449896 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:44.452224 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.454382 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2276) took 2095 ms. Trace:
I20260709 13:10:44.455554 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.408720 32116 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.476756 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.453701 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:44.455440 27416 rpcz_store.cc:276] 0709 13:10:42.359449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.641028 (+1281579us) service_pool.cc:224] Handling call
0709 13:10:43.677122 (+ 36094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.747404 (+ 70282us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:44.201265 (+453861us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.446867 (+245602us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.454055 (+  7188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.454111 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.454161 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.454218 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.454329 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6853,"prepare.queue_time_us":370922,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7037,"thread_start_us":567342,"threads_started":2}
I20260709 13:10:44.424398 32151 raft_consensus.cc:2804] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:44.496686 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 45064.1us
I20260709 13:10:44.500865 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.412441 31899 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.418679 31949 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:44.557611 32192 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
W20260709 13:10:44.567863 32194 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:10:44.568735 32064 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.578413 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1869) took 1096 ms. Trace:
I20260709 13:10:44.567863 31784 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.566262 31975 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.418628 32155 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:44.538028 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47586.8us
I20260709 13:10:44.505127 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.582125 27413 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 7.
I20260709 13:10:44.587926 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:44.547379 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.523765 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.578889 27415 rpcz_store.cc:276] 0709 13:10:43.481731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.737758 (+256027us) service_pool.cc:224] Handling call
0709 13:10:43.738093 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.738614 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:43.947461 (+208847us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.282343 (+334882us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.301279 (+ 18936us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.301454 (+   175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:44.301490 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.301538 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.578202 (+276664us) raft_consensus.cc:1685] finished
0709 13:10:44.578225 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.578349 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3231,"prepare.queue_time_us":402606,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":17409,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":18834,"thread_start_us":495955,"threads_started":2,"wal-append.queue_time_us":387359}
I20260709 13:10:44.499104 32116 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:44.555362 27414 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:44.597942 27260 raft_consensus.cc:2368] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:10:44.599964 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:44.534170 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.457623 31807 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.598877 27414 pending_rounds.cc:85] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 6
I20260709 13:10:44.611790 27414 pending_rounds.cc:107] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:10:44.612186 27414 raft_consensus.cc:2889] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:44.613086 31524 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:44.613381 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.614087 27260 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
W20260709 13:10:44.614923 32190 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:44.615060 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.613555 31524 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.615976 32047 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:44.616250 31524 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.616680 27260 raft_consensus.cc:1275] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:10:44.617283 32195 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:44.529510 32151 raft_consensus.cc:697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:44.619019 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.619100 32151 consensus_queue.cc:237] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.595767 32178 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.596024 32155 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:44.620477 32104 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.621186 32155 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.516878 32072 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.622404 32155 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:44.596024 32064 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.623637 32064 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.624182 31899 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.625692 32064 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.626020 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.560987 31854 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.543705 32186 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.630184 27266 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:44.619748 31949 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:44.634495 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 314353us
I20260709 13:10:44.630757 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:44.631660 27259 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:44.504357 31652 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:44.634243 27417 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [9.5-12.6]
I20260709 13:10:44.646586 27261 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:44.643282 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.625857 32104 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:44.654023 27267 raft_consensus.cc:2368] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14.
I20260709 13:10:44.654646 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.657503 27262 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:44.661266 27260 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:44.634925 32047 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:44.669498 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:44.653837 31652 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.690711 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:44.688927 31652 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:44.700873 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:44.671382 31807 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:44.712532 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104386us
I20260709 13:10:44.708505 32104 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:44.711796 32186 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:44.722126 31784 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:44.769052 32212 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:10:44.812541 32207 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:10:44.729353 31975 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:44.843827 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 165723us
I20260709 13:10:44.817867 32023 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.870424 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.872532 31975 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:44.873090 31975 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.875145 31975 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:44.899873 32203 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:10:44.902599 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1847) took 3603 ms. Trace:
W20260709 13:10:44.903321 32196 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:10:44.904523 31807 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:44.904978 32210 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:10:44.731372 32047 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.865355 32023 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:44.917097 27264 consensus_meta.cc:287] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:10:44.819049 31902 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.917790 27264 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:44.925822 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:44.903040 27411 rpcz_store.cc:276] 0709 13:10:41.298980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.292030 (+1993050us) service_pool.cc:224] Handling call
0709 13:10:44.003157 (+711127us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b5800003698. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:44.003458 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.004029 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:44.268158 (+264129us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.529473 (+261315us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.550897 (+ 21424us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.551040 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:44.551074 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.551137 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.902022 (+350885us) raft_consensus.cc:1685] finished
0709 13:10:44.902267 (+   245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.902422 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33402,"prepare.queue_time_us":138303,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":28126,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5575,"spinlock_wait_cycles":17769728,"thread_start_us":448434,"threads_started":2,"wal-append.queue_time_us":389128}
W20260709 13:10:44.928164 31974 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 13:10:44.916392 31784 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:44.940455 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:44.942603 31784 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:44.943033 31784 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:44.943993 31784 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.944842 32116 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.945351 31784 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:44.945585 32121 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:44.946010 32121 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:44.903363 31524 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:44.948947 31524 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:44.952065 27265 raft_consensus.cc:2410] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:44.960156 31902 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:44.963984 31647 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.964581 31647 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:44.975361 32023 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:44.976791 32201 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.373s	user 0.009s	sys 0.002s
W20260709 13:10:44.982486 32198 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.402s	user 0.004s	sys 0.008s
W20260709 13:10:44.991657 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 696564us
I20260709 13:10:44.993083 27266 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:44.997854 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:44.998483 27336 raft_consensus.cc:2393] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 9: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:45.000408 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 80678.6us
W20260709 13:10:44.992533 32142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.009s	sys 0.008s
I20260709 13:10:45.006879 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:44.996070 32104 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.010735 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.010876 28014 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.010941 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.011494 28007 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:45.012413 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:45.006026 32142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.010s	sys 0.009s
I20260709 13:10:45.014663 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.014936 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:10:45.021740 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.004298 31974 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:45.013015 28013 raft_consensus.cc:2376] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12. Re-sending same reply.
I20260709 13:10:45.023876 28015 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:45.016842 32137 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.026000 31647 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.027323 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.031241 28007 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.028522 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.032074 31974 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.033345 27412 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:45.033502 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.034163 27416 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:45.036031 32141 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.037763 32002 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:45.038039 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.038341 32002 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.039489 32089 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:45.040346 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.040889 32002 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.041016 32089 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.041849 32089 consensus_queue.cc:1048] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:45.043462 32206 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.044188 27411 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:10:45.044874 32140 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:45.046609 32047 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.046991 32047 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.047958 27380 leader_election.cc:400] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:10:45.048309 27380 leader_election.cc:403] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.048064 32047 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.049332 32047 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.049539 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.026587 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.055109 32211 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:10:45.056075 32002 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.056288 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.056644 32002 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.057732 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.070430 28007 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:45.034840 31974 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:45.054131 27231 connection.cc:256] RPC call timeout handler was delayed by -1.4308176279999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:10:45.074935 32142 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:45.074294 31937 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.077618 31937 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:45.078248 31937 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.084583 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.085403 32209 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:45.086648 27380 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.091778 32002 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.093305 32205 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.094022 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.094692 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:45.100162 32200 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.487s	user 0.000s	sys 0.001s
I20260709 13:10:45.102079 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.102978 32209 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.103847 32209 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.106534 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.026014 32121 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.107551 32209 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:45.109570 32023 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:45.111152 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 864191us
W20260709 13:10:45.111999 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85491.5us
I20260709 13:10:45.115837 31652 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.118135 31652 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.066452 31798 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.107985 32121 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:45.125245 32222 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:10:45.050428 32178 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.143747 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.143953 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.144918 27412 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.142689 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:45.130270 32155 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
W20260709 13:10:45.131261 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.135768 27413 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:45.136449 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.148567 27409 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.118271 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:45.138350 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.126781 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:45.146672 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52801.3us
W20260709 13:10:45.147228 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 49145.9us
I20260709 13:10:45.153724 27306 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:45.155093 27410 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:45.128880 32142 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.160511 27416 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:10:45.163440 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57029.7us
I20260709 13:10:45.163887 27233 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.164342 31970 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:45.164557 31807 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.164860 32220 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:10:45.167382 31524 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:45.167920 32140 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:45.171669 31854 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:45.180611 27309 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.159575 32137 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.186224 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.186784 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.160063 32151 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:10:45.187880 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 61219.2us
I20260709 13:10:45.182471 32204 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:45.183511 31974 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:45.187628 32213 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.176798 31970 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:45.185025 31854 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:45.218852 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 43808.8us
I20260709 13:10:45.159066 32178 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.191324 31524 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.195884 32151 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.199679 32121 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.203996 32161 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:45.237618 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.204507 32204 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:45.239094 28009 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:45.240260 28015 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:10:45.226649 31974 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.242528 28007 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:45.246976 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.231653 32151 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.228132 31798 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.251143 28013 raft_consensus.cc:2393] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 10: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:45.204151 32140 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.253669 31798 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.257408 31798 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.258844 32116 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.260637 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.261349 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.262341 28014 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:45.263670 27410 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:45.261592 28013 raft_consensus.cc:2410] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:45.264751 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.266364 28006 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:45.267668 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.268306 28011 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 8.
I20260709 13:10:45.275676 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.224647 32137 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:10:45.220315 31807 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:10:45.279834 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.279021 27978 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.252321 31784 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.288305 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 174550us
I20260709 13:10:45.303818 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.224908 32213 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:45.284646 32226 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:10:45.307762 27409 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:45.312834 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.313583 28014 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:45.314497 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.315052 28013 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:45.315513 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.296078 32116 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:45.322803 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.324208 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.278430 31970 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.327359 31970 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.331071 32213 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:45.332818 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 100859us
I20260709 13:10:45.334736 28011 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:10:45.308557 31524 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.322889 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.339516 27409 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.335152 28011 pending_rounds.cc:85] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Aborting all ops after (but not including) 9
I20260709 13:10:45.342986 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.353372 28011 pending_rounds.cc:107] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:10:45.343041 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 91891.2us
I20260709 13:10:45.353713 28011 raft_consensus.cc:2889] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:45.344017 28014 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.354429 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.344214 32211 consensus_queue.cc:1059] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:45.348356 32161 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:45.357721 28009 raft_consensus.cc:2393] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 9: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:45.358215 27413 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:45.358451 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 128964us
I20260709 13:10:45.361068 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.362208 27416 raft_consensus.cc:2410] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:45.318769 31784 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.352298 28013 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:45.281944 32142 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.382303 32232 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.350051 27412 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 9.
I20260709 13:10:45.307502 31854 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.393558 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:45.366474 32178 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:45.381778 32205 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:45.320310 32204 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.365263 32161 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.387079 32211 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:45.362560 31974 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.421945 27409 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:45.425786 32161 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:45.427224 32215 consensus_queue.cc:1175] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 15 status { last_received { term: 14 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:45.431623 32140 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:45.440579 31784 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.441174 32209 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.416026 32205 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.441901 32209 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.443526 32205 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.444365 32047 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:45.444720 32209 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.444929 32047 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.457213 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.461113 27416 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:45.417122 32211 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:45.472955 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.447018 32047 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.471385 31784 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.473582 32121 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.482199 32121 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.470718 31937 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.484571 32121 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.463951 32205 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:45.486364 31937 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:45.487941 32231 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:45.488147 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.488909 32186 consensus_queue.cc:1059] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:45.489625 32113 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:45.490455 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.490535 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.491381 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.531747 28013 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:45.491544 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.491597 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.491416 32047 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:45.501443 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.471670 32030 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:45.509574 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.514778 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:45.516788 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.517535 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.533900 32030 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.534868 27413 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:45.525393 32211 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.514215 31524 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:45.530181 28012 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:45.530265 27412 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:45.544752 27337 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:45.523521 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:45.536816 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 149511us
I20260709 13:10:45.495209 32161 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.540184 27416 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:45.517613 32204 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.543486 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.548667 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:45.551452 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.553525 27413 raft_consensus.cc:2393] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
W20260709 13:10:45.554912 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 66866.5us
I20260709 13:10:45.556731 32186 consensus_queue.cc:1243] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:45.556855 32178 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:45.562109 32227 log.cc:927] Time spent T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.319s	user 0.002s	sys 0.000s
I20260709 13:10:45.548110 32161 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.569908 32161 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:45.579516 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.579833 28013 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:45.580843 27413 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:45.529016 32205 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.556885 31937 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:45.539422 31784 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.586162 32155 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:10:45.603869 32178 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:45.580405 32245 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:45.584128 32219 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.610366 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 161205us
I20260709 13:10:45.584954 32211 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.601619 31937 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.614948 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:45.615537 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57138.7us
I20260709 13:10:45.586863 32151 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:45.617404 27306 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Timed out: RequestConsensusVote RPC to 127.25.139.132:42123 timed out after 1.515s (SENT)
I20260709 13:10:45.620502 27308 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.622432 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.618212 31937 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.623411 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:45.660468 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48008.3us
I20260709 13:10:45.653738 32236 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.664148 28007 raft_consensus.cc:2368] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:45.675084 32236 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.675500 32236 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.675745 32151 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.668025 31784 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.617237 32047 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:45.671720 32030 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.672789 32205 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:45.673135 31937 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.616376 31798 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.693174 31798 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.619218 32245 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.677425 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.695327 32113 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:45.680398 27408 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:45.658731 32178 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:45.695686 32245 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.696673 32178 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:45.697151 32178 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:45.697952 31937 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:45.657786 31854 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:10:45.700558 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:45.701254 28011 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:45.703732 31854 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:45.704157 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:45.704773 32186 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:45.706565 32186 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:45.707108 32186 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.708189 32186 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.706712 31974 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:45.709597 31974 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:45.709954 31974 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.710768 31974 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.712060 31974 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.716954 27416 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:45.684177 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:45.721624 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:45.722280 27337 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:10:45.729851 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 109435us
I20260709 13:10:45.730844 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.738224 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.739127 27408 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 11: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:45.739312 32237 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:45.739884 32237 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.740533 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.741020 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.740770 32237 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.744606 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.746023 27309 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.746531 31755 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:45.747669 32245 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.747062 27309 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.751559 27337 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:45.756378 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.618257 32219 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.727308 31937 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:45.761682 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 77571.8us
I20260709 13:10:45.762185 28011 raft_consensus.cc:2468] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:45.771453 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:45.772131 27417 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:10:45.772907 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.750272 31798 raft_consensus.cc:2804] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:45.750751 31755 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:45.779613 31798 raft_consensus.cc:697] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.780555 31798 consensus_queue.cc:237] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.785148 32219 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:45.734218 32140 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:45.786558 32140 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:45.786967 32140 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:45.787360 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:45.788280 27260 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:45.788655 32064 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:45.789115 32064 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.790354 32072 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:45.789992 32064 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.790737 32072 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.791882 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.787992 32140 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.801126 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:45.795958 27411 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:45.760315 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:45.798288 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.819448 28013 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 9. Current term is 10. Ops: []
W20260709 13:10:45.821041 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 60819.5us
I20260709 13:10:45.810947 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.761830 32232 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:45.791600 32072 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.792990 32064 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:45.849023 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 92745.6us
I20260709 13:10:45.823949 31937 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:45.823269 32205 raft_consensus.cc:2764] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:10:45.831656 32089 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:45.856057 32142 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:45.854971 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:45.842480 32030 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:45.840584 32151 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:10:45.863145 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.862959 27417 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:45.843138 32239 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:45.848294 32232 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.843957 32113 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:45.850687 32186 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.824620 32208 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:10:45.889361 27266 raft_consensus.cc:3055] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:45.907676 27266 raft_consensus.cc:740] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:45.853760 31937 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.900275 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:45.859333 32089 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.881556 32142 consensus_queue.cc:1243] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:10:45.874094 32030 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:45.920836 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.920629 28010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:45.921938 28008 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:10:45.923770 28010 raft_consensus.cc:606] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:45.902551 32151 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:45.853855 32178 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.901820 32232 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:45.895618 31524 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:45.926676 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71786.7us
I20260709 13:10:45.929711 27380 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.873430 31652 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:45.933960 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:45.935732 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:45.936751 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.923098 32089 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:45.962177 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.919814 31937 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:45.921849 27266 consensus_queue.cc:260] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.925594 32030 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:45.926054 32140 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:45.931226 31784 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.982278 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:45.917969 32113 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:45.998349 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:46.004587 27414 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:45.969738 31755 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:45.966470 31854 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.014346 27266 raft_consensus.cc:3060] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:45.967769 32233 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.917917 32186 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:45.969054 32116 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.976743 31807 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:46.022265 31755 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:46.025607 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64940us
I20260709 13:10:46.034808 27309 leader_election.cc:400] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:10:46.035235 27309 leader_election.cc:403] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.034400 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.039664 27414 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.026993 31807 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:46.053500 27980 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:46.039145 31784 raft_consensus.cc:2804] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.059031 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:46.062165 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:46.027544 31854 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:46.074132 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 75848.8us
I20260709 13:10:46.075332 27383 leader_election.cc:400] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14.
I20260709 13:10:46.075745 27383 leader_election.cc:403] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.077661 28015 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:46.083251 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.084190 27415 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:46.060343 32137 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:46.094225 32254 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:10:46.095981 32258 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:10:46.099299 32256 log.cc:927] Time spent T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:10:46.100615 32253 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:10:46.102337 32178 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.064821 32116 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:46.076778 32204 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260709 13:10:46.029378 32233 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.083339 32208 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:46.083721 31974 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:46.108996 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:46.138815 28015 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:46.082561 31784 raft_consensus.cc:697] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:46.103086 32178 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.044582 32151 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.072160 32220 consensus_queue.cc:1059] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:10:46.089919 32272 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:46.107120 27266 raft_consensus.cc:1275] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:10:46.156378 27266 pending_rounds.cc:85] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 8
I20260709 13:10:46.156733 27266 pending_rounds.cc:107] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:10:46.157011 27266 raft_consensus.cc:2889] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.142827 32205 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14.
W20260709 13:10:46.161538 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.158885 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 95378.2us
I20260709 13:10:46.071540 31755 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:46.164636 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 235032us
I20260709 13:10:46.162789 28015 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 9.
I20260709 13:10:46.133395 32236 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.170253 27231 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:46.163192 32179 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:10:46.145865 31974 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.156447 32178 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:46.170063 32205 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:46.173247 32274 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.233799 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105221us
I20260709 13:10:46.238902 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:46.213171 32245 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.184780 31647 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:46.162300 32273 consensus_queue.cc:1059] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:10:46.263988 27414 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:46.213531 32275 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:10:46.263414 32261 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 13:10:46.287925 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45132.4us
W20260709 13:10:46.279263 32263 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:10:46.244930 32274 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.233484 32205 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.296590 32280 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.339283 27306 leader_election.cc:400] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
I20260709 13:10:46.339663 27306 leader_election.cc:403] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.290833 32249 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:46.304914 32267 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:10:46.282759 31647 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.310086 28014 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:46.323979 32269 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:10:46.315564 32274 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.241741 31784 consensus_queue.cc:237] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.343118 32237 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.372251 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61615.6us
I20260709 13:10:46.347795 32245 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12.
W20260709 13:10:46.395200 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 320027us
I20260709 13:10:46.351974 32233 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.409943 32236 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.355736 32276 consensus_queue.cc:1048] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 13:10:46.416285 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.419981 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.433598 27412 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:46.374593 31854 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.343742 32280 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.440610 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.453779 27408 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 10.
I20260709 13:10:46.375849 32208 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:46.451812 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.427994 32236 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:46.347440 32178 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.436542 32275 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:46.395902 32237 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.465585 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.467499 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.468220 27266 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:46.467612 31974 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.469376 32297 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.469880 32297 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.471096 32205 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:46.473346 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.473961 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.475948 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.476569 27261 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
W20260709 13:10:46.480091 27160 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 130) took 34572 ms (client timeout 15000 ms). Trace:
I20260709 13:10:46.459208 32233 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.485028 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.487766 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.489032 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.489912 27266 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:46.491205 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.488842 27260 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:46.492146 27261 raft_consensus.cc:2410] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:46.492321 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.492939 27259 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:46.494122 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.494443 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.472105 32297 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:46.485176 32089 consensus_meta.cc:287] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 13:10:46.498588 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:46.500641 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 184855us
I20260709 13:10:46.500736 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.501608 27267 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:46.503484 27262 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:46.498160 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:46.505465 27265 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:46.506294 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.506536 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.482875 31937 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.507685 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.464051 32236 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.508500 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:46.509208 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.464553 32232 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.511898 32294 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:46.512547 32294 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.513651 32232 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.514850 32294 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.503352 32089 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.515431 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.518276 31647 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.496894 32233 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.519716 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.528736 27261 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:46.523988 32270 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.526549 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.532366 32236 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.533366 32104 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:46.480558 27160 rpcz_store.cc:269] 0709 13:10:11.907914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.908304 (+   390us) service_pool.cc:224] Handling call
0709 13:10:46.479816 (+34571512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:38.401824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:38.402669 (+   845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:38.402735 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:10:38.402761 (+    26us) tablet.cc:662] Decoding operations
0709 13:10:38.728228 (+325467us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:38.728336 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:38.728366 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:10:38.729846 (+  1480us) tablet.cc:701] Row locks acquired
0709 13:10:38.729897 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:10:38.730064 (+   167us) write_op.cc:270] Start()
0709 13:10:38.730226 (+   162us) write_op.cc:276] Timestamp: P: 1783602638729997 usec, L: 0
0709 13:10:38.730267 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:10:38.805151 (+ 74884us) log.cc:844] Serialized 7392 byte log entry
0709 13:10:39.620973 (+815822us) op_driver.cc:464] REPLICATION: finished
0709 13:10:40.058746 (+437773us) write_op.cc:301] APPLY: starting
0709 13:10:40.058879 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:41.590651 (+1531772us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:41.590785 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:42.406728 (+815943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:42.450750 (+ 44022us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:10:42.450799 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:42.451331 (+   532us) log.cc:844] Serialized 164 byte log entry
0709 13:10:43.087641 (+636310us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:43.090826 (+  3185us) write_op.cc:454] Released schema lock
0709 13:10:43.090944 (+   118us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:43.102904 (+ 11960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:43.104526 (+  1622us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11221984,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":341686,"apply.run_cpu_time_us":66629,"apply.run_wall_time_us":3052020,"cfile_cache_hit":70,"cfile_cache_hit_bytes":73045,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":162895,"lbm_reads_10-100_ms":6,"lbm_reads_lt_1ms":6,"num_ops":18,"prepare.queue_time_us":318559,"prepare.run_cpu_time_us":101736,"prepare.run_wall_time_us":783515,"raft.queue_time_us":314239,"raft.run_cpu_time_us":21070,"raft.run_wall_time_us":322984,"replication_time_us":864424,"thread_start_us":1460691,"threads_started":5,"wal-append.queue_time_us":986262,"wal-append.run_cpu_time_us":107727,"wal-append.run_wall_time_us":2364153}]]}
I20260709 13:10:46.533955 32104 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.536525 32089 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.536780 27413 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:46.536898 32233 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.537320 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.536528 32270 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:46.539453 32030 consensus_meta.cc:287] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 13:10:46.519740 32237 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.542438 32104 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:46.543712 32237 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.544567 32140 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.002s
I20260709 13:10:46.544312 32237 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.544790 32291 raft_consensus.cc:3055] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:46.545368 32291 raft_consensus.cc:740] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:46.545828 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.546525 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.546231 32291 consensus_queue.cc:260] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.548395 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:46.549674 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:46.549913 32270 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:46.540004 32030 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:46.523152 32064 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.005s
I20260709 13:10:46.546880 32237 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.548456 32137 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:10:46.552309 32113 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:46.552675 31937 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:46.555100 32072 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:46.579195 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.555717 32294 consensus_queue.cc:1059] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:46.556433 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.556612 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.580071 27408 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.557554 27262 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:46.558199 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.563731 27337 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.581760 27336 raft_consensus.cc:2368] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11.
I20260709 13:10:46.558350 27233 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.575093 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.578130 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.584052 27410 raft_consensus.cc:2393] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:46.538893 31807 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.585254 31807 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:46.586148 27410 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:46.588203 27414 raft_consensus.cc:1240] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:46.590088 27263 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:46.591681 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.592280 27413 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:46.606170 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.572917 32275 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.505031 32208 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:46.619062 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60751.7us
I20260709 13:10:46.623459 27267 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:10:46.624244 27411 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:46.624678 27417 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:46.627985 27268 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:46.639621 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.640574 27416 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.643613 27408 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:46.650220 27337 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:46.618129 32291 raft_consensus.cc:3060] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.654407 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.654587 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.651989 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.626873 32064 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.629487 31975 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:46.629693 31647 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:46.655265 32215 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:46.655336 27336 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:46.649538 32297 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:10:46.657194 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.657373 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.703933 27268 raft_consensus.cc:2410] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:46.704818 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.705269 27261 raft_consensus.cc:1275] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:10:46.705614 27261 pending_rounds.cc:85] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 6
I20260709 13:10:46.705892 27261 pending_rounds.cc:107] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:10:46.705968 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:46.706207 27261 raft_consensus.cc:2889] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:46.706579 27266 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.707743 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:46.708398 32292 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:10:46.659847 32064 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.660343 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:46.711488 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51240.2us
I20260709 13:10:46.712219 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.712984 31647 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:46.713603 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:46.713985 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.714974 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.715332 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.716238 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.716586 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:46.716946 27342 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:46.717656 27343 raft_consensus.cc:2368] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11.
I20260709 13:10:46.717958 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:46.718684 27342 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.671325 32280 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.719535 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.720867 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.723688 32293 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:46.724046 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.725574 32293 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:46.727629 32295 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:46.684036 31937 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:46.692157 32155 raft_consensus.cc:3055] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:46.691470 27263 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:46.729848 32155 raft_consensus.cc:740] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:46.730856 32155 consensus_queue.cc:260] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:46.731727 32296 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.184s	user 0.003s	sys 0.000s
I20260709 13:10:46.732177 32155 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:46.697376 28013 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:46.707913 27260 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:46.732968 27266 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:46.699916 32215 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.708422 27265 raft_consensus.cc:3060] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.756350 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.757303 27260 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:46.757548 27336 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:46.696758 27414 raft_consensus.cc:1240] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:46.698550 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.760932 27337 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:46.664705 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.762720 27417 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:46.659514 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.765085 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:46.695763 28012 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:46.729286 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.774672 27342 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:46.777575 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.779078 27411 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:46.779584 27413 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:46.728575 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55754 (request call id 713) took 1237 ms. Trace:
W20260709 13:10:46.735491 27231 leader_election.cc:336] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.676s (SENT)
I20260709 13:10:46.788300 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:46.789152 28013 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:46.789502 28015 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.785545 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.780676 28014 rpcz_store.cc:276] 0709 13:10:45.490745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.491102 (+   357us) service_pool.cc:224] Handling call
0709 13:10:46.728387 (+1237285us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54004d49d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:46.728512 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372642688}
I20260709 13:10:46.787241 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:46.794245 28015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:46.795122 28015 raft_consensus.cc:606] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:46.795696 28015 raft_consensus.cc:614] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:46.679384 32264 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.567s	user 0.012s	sys 0.008s
I20260709 13:10:46.804072 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.710440 32064 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.826386 27268 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:46.698240 32186 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:46.827425 27980 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.828452 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.824321 27340 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:46.671576 32030 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:46.825523 27267 raft_consensus.cc:1217] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Deduplicated request from leader. Original: 7.3->[8.4-12.6]   Dedup: 9.5->[12.6-12.6]
I20260709 13:10:46.845301 27267 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [8.4-12.6]
W20260709 13:10:46.827375 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91935.7us
I20260709 13:10:46.809260 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.807842 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:46.847790 27414 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:46.848076 27262 raft_consensus.cc:2410] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:10:46.829511 28012 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:46.830220 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.827482 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:46.848698 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.695012 32206 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.824885 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:46.840999 27265 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:46.851054 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:46.786608 31975 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:46.851763 27408 raft_consensus.cc:2376] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14. Re-sending same reply.
I20260709 13:10:46.729300 31937 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.862972 32270 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:46.892777 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:46.893090 27416 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:46.893512 28014 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:46.895823 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.896325 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.900401 27409 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:46.868702 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:46.870029 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.833695 32204 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.876493 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:46.926335 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 49924.3us
W20260709 13:10:46.915586 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52210.7us
I20260709 13:10:46.927737 27340 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:46.927515 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:46.928710 32205 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.876065 32272 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:46.929407 32272 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:46.929605 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.930732 32205 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.930912 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.931257 32205 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.931375 32283 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:46.934410 32205 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.934844 32283 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:46.935838 32283 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:46.939414 32211 raft_consensus.cc:2764] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:46.940696 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:46.944443 32140 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:46.944933 28012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:46.945612 28012 raft_consensus.cc:606] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:46.945977 28012 raft_consensus.cc:614] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:46.825776 32161 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:10:46.947830 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:46.949685 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.950601 27416 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:10:46.951632 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.969835 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.971434 32213 raft_consensus.cc:993] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:10:46.971975 32213 raft_consensus.cc:1081] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:10:46.875910 32209 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:46.860592 31975 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.891099 32276 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:46.961941 27409 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [9.5-12.6]
I20260709 13:10:46.867064 32237 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.989320 27410 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:46.970458 32161 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:46.994855 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:46.869305 32206 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:46.997605 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.966369 32211 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:47.007175 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:46.969677 32270 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:47.012054 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:47.012434 27259 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:46.988641 32284 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.012461 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:47.014940 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 250645us
I20260709 13:10:46.997148 31975 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:46.993533 32209 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:47.018040 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.029398 28011 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:47.002532 27342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
W20260709 13:10:47.019446 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 191801us
I20260709 13:10:47.037501 27338 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:47.037762 27342 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:46.966297 32204 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.039433 27342 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.002642 32161 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:47.041121 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.045958 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:47.047252 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:47.048764 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:47.049532 27262 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:10:47.015430 32249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.008s	sys 0.006s
I20260709 13:10:47.008169 32215 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.010152 32211 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:47.028697 31854 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:47.048640 27342 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.068351 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.073096 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:47.080547 27338 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.080616 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:47.059233 27266 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:47.017463 32276 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:47.016080 32284 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:47.060436 27308 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:47.081663 27260 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.040841 32209 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.057423 32140 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:10:46.996629 32064 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:47.111357 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48616.4us
W20260709 13:10:47.058753 32249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.010s	sys 0.007s
I20260709 13:10:47.007529 32237 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:47.154476 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.030589 32104 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:10:47.079800 31854 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.016125 32179 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:10:47.080209 32211 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.084712 32236 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:10:47.010669 31807 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:10:47.037701 32275 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.191706 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 131517us
I20260709 13:10:47.084926 32272 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.084038 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:47.200058 32304 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:10:47.250468 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:47.200592 31937 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.201026 27337 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:47.201154 27342 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.046583 32234 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:10:47.103735 32284 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.195873 32297 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.243963 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.274770 27340 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:47.201814 32113 raft_consensus.cc:3055] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:47.206081 32137 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.252869 27261 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:47.234373 31854 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:47.270637 27308 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:47.358713 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 88190.3us
I20260709 13:10:47.272656 32142 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:47.351284 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.338711 32297 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.395213 32276 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.397118 32297 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.254976 32161 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.398658 32161 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:47.400133 32303 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:10:47.405200 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.406751 27341 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:47.407361 32233 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:47.407567 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.408077 32233 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:47.409145 32233 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.313144 32113 raft_consensus.cc:740] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:47.411537 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.411940 32113 consensus_queue.cc:260] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.412745 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.413620 27339 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:47.414403 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.416210 27341 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:10:47.419551 32204 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.424676 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.425814 27337 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:47.431113 27338 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:47.432945 27268 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
I20260709 13:10:47.447429 27334 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:47.449362 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:47.451874 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 113698us
I20260709 13:10:47.450292 27336 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:47.350783 32291 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:47.459946 27336 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:47.465847 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:47.451747 32178 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.017s	sys 0.008s
I20260709 13:10:47.354956 32072 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.357963 32137 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.219324 32270 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.472297 27343 raft_consensus.cc:1240] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:10:47.453564 32205 consensus_meta.cc:287] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
W20260709 13:10:47.474318 27380 leader_election.cc:336] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.655s (SENT)
I20260709 13:10:47.498420 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:47.258810 32275 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.443245 32064 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:47.469058 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.489089 27410 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:10:47.479722 32178 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.017s	sys 0.009s
I20260709 13:10:47.451009 32142 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:47.497352 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:47.555809 27340 raft_consensus.cc:2368] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13.
I20260709 13:10:47.516502 28012 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:47.630649 27409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:10:47.519771 27343 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:47.637413 27409 raft_consensus.cc:606] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:47.519466 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 449662us
I20260709 13:10:47.637895 27409 raft_consensus.cc:614] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:10:47.554762 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.639384 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.524127 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:47.640349 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.633553 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:47.640897 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.641537 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.466339 32140 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:47.458887 32204 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.492204 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:47.469003 32311 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.523576 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:47.455380 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 475908us
I20260709 13:10:47.638429 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:47.644640 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.472563 32206 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:47.637627 27413 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.516981 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:47.495150 32137 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.501106 32294 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:47.566130 32308 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.211s	user 0.000s	sys 0.000s
I20260709 13:10:47.673813 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:47.529973 32155 consensus_meta.cc:287] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.002s
I20260709 13:10:47.718214 32211 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.566879 32284 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.719825 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:47.720602 28013 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:47.721036 32284 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.722503 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1780) took 1017 ms. Trace:
I20260709 13:10:47.722893 27263 rpcz_store.cc:276] 0709 13:10:46.705129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.730551 (+ 25422us) service_pool.cc:224] Handling call
0709 13:10:46.730948 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.731230 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.731267 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.731793 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.014456 (+282663us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:47.045238 (+ 30782us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.045452 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.045525 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.722310 (+676785us) raft_consensus.cc:1685] finished
0709 13:10:47.722328 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.722448 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31043,"raft.queue_time_us":12738,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":12882,"spinlock_wait_cycles":82392576,"thread_start_us":282271,"threads_started":1,"wal-append.queue_time_us":899415}
W20260709 13:10:47.725011 32312 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:10:47.725366 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:47.725936 28012 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:47.726251 28012 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:10:47.727305 32305 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.372s	user 0.000s	sys 0.001s
I20260709 13:10:47.727031 28012 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.728600 27412 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1917) took 1167 ms. Trace:
I20260709 13:10:47.728890 32288 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:10:47.728953 27412 rpcz_store.cc:276] 0709 13:10:46.561651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.562734 (+  1083us) service_pool.cc:224] Handling call
0709 13:10:46.563099 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.567210 (+  4111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.567257 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.574647 (+  7390us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.993666 (+419019us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.993715 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.993793 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.726638 (+732845us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:47.728322 (+  1684us) raft_consensus.cc:1685] finished
0709 13:10:47.728344 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.728533 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3553,"raft.queue_time_us":7252,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8264,"spinlock_wait_cycles":21777152,"thread_start_us":344859,"threads_started":1,"wal-append.queue_time_us":602199}
W20260709 13:10:47.732026 32314 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:10:47.735867 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:47.742214 27339 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:47.710963 32275 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.748019 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.748756 27339 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:47.749509 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.750216 27339 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:47.751613 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 77866.2us
I20260709 13:10:47.752697 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:47.754004 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:47.675529 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:47.755128 27233 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:47.755873 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 80452.3us
I20260709 13:10:47.755982 32330 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:47.756157 32333 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.756477 32330 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.522639 32321 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.756896 32330 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.756989 32333 raft_consensus.cc:2764] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:10:47.681797 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.757293 32321 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.758692 32329 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:47.759240 32329 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:47.759640 32329 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:47.757386 32213 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:47.759929 32321 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:47.760252 32213 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:47.760730 32213 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:47.764447 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:47.765043 28007 raft_consensus.cc:606] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Received request to transfer leadership to TS d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:47.765383 28007 raft_consensus.cc:614] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:47.768250 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:47.771351 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:47.775926 28012 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:47.777122 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:47.779451 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:47.780079 27412 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:47.781381 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:47.567229 32317 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:10:47.664826 27260 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:47.680389 27267 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:47.585227 32328 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:47.532913 32089 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.552791 32293 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:47.689136 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.690207 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:47.789670 27410 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:47.485024 32291 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.696599 32324 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:47.701000 32064 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.796715 32064 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.797079 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:47.797313 32293 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.798439 32219 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:47.798820 32219 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.798882 32064 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:47.800083 32293 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.801532 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:47.802281 32137 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.704257 27336 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
W20260709 13:10:47.692711 32313 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:10:47.708873 32142 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.821228 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.496670 32072 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.823426 32330 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.824923 32072 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.694970 32294 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.825523 32330 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.814836 32219 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:47.827634 32294 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:47.685266 32283 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.002s
I20260709 13:10:47.828685 32283 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.682499 32311 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.833191 28015 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:47.686761 32234 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:47.714891 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.833877 32219 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.716185 27409 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:47.835901 32219 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:47.533792 32205 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:47.671787 32318 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:10:47.790292 27233 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:47.836885 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46659.3us
I20260709 13:10:47.791602 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.791502 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.790869 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:47.674995 32204 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.789124 32328 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:47.671456 32140 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:47.802542 31854 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:47.803308 32233 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.803823 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:47.703291 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 237876us
I20260709 13:10:47.807843 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.813392 27413 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:47.769315 32213 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:47.886360 31975 consensus_meta.cc:287] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.841s	user 0.007s	sys 0.003s
I20260709 13:10:47.818770 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:47.902592 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 637) took 1138 ms. Trace:
W20260709 13:10:47.849521 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.906519 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:48.105027 28015 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 17: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:47.843500 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:47.792855 32274 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:47.909691 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.842159 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2338) took 1057 ms. Trace:
I20260709 13:10:47.838400 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.108238 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:48.108806 28015 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:47.861325 27343 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:47.963145 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:47.793157 32155 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:47.876459 27414 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:48.051780 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:48.114063 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.114411 28013 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
W20260709 13:10:48.058429 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 267621us
I20260709 13:10:48.107937 27415 rpcz_store.cc:276] 0709 13:10:46.784424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.875375 (+ 90951us) service_pool.cc:224] Handling call
0709 13:10:46.875743 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.876139 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.876172 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.876648 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.126247 (+249599us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:47.126296 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.126403 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.841966 (+715563us) raft_consensus.cc:1685] finished
0709 13:10:47.841986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.842103 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2501,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":249140,"threads_started":1,"wal-append.queue_time_us":478466}
I20260709 13:10:48.116011 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.059463 27339 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:48.057986 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.032979 32291 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:48.117429 27336 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:48.120419 27412 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:48.121208 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:48.121595 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.122116 27264 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:48.075589 32330 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.064894 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.875464 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:47.842872 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1787) took 1031 ms. Trace:
W20260709 13:10:48.067389 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 228345us
I20260709 13:10:47.793867 32211 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.080044 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:48.006759 32323 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.910858 32249 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:47.977242 32234 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:47.814947 32286 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.857977 32237 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:47.871503 32151 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:47.838975 32275 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.244s
I20260709 13:10:47.804327 32089 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.082891 32204 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.084082 32328 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.015154 32329 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.086854 32140 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:48.091631 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.815670 27266 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
W20260709 13:10:47.893899 32209 consensus_meta.cc:287] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.001s
I20260709 13:10:48.093892 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:48.094887 28012 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:48.097859 32113 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:48.097707 32233 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.106494 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:48.328876 27337 raft_consensus.cc:2376] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14. Re-sending same reply.
I20260709 13:10:48.101861 28011 rpcz_store.cc:276] 0709 13:10:46.764019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.764740 (+   721us) service_pool.cc:224] Handling call
0709 13:10:47.902363 (+1137623us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54006608d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:47.902504 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605888768}
W20260709 13:10:48.209460 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.109036 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 711) took 1075 ms. Trace:
I20260709 13:10:47.837694 32205 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.112612 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:47.838749 32331 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:48.124500 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:48.335067 27259 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:48.087896 32219 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:48.130283 32272 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:48.347326 32219 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.347793 32219 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.347713 32272 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.127065 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:47.839327 32064 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.279s
I20260709 13:10:48.350575 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:48.351215 32064 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:48.351727 32064 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:48.333196 32323 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.352813 32233 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:48.352500 32064 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.092327 32137 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:48.138782 32283 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.130836 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.351228 27339 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.354955 27166 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 2 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:10:48.263108 28006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.015s	sys 0.051s
I20260709 13:10:48.309645 27266 pending_rounds.cc:85] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 11
W20260709 13:10:48.356226 28006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.019s	sys 0.051s
I20260709 13:10:48.356302 27266 pending_rounds.cc:107] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:10:48.179607 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:48.357141 27268 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.356882 27166 catalog_manager.cc:5697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 7, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 7 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:48.130105 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.359563 27336 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:48.312079 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.187722 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:48.309581 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.314499 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:48.314999 32209 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.315879 32275 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:48.316635 32140 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:48.131896 32047 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.320688 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:48.368319 27264 raft_consensus.cc:2410] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:10:48.117168 32161 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:48.177000 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.383103 27334 raft_consensus.cc:2376] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14. Re-sending same reply.
W20260709 13:10:48.322724 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 228931us
I20260709 13:10:48.384795 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:48.323299 32294 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:48.324306 27261 rpcz_store.cc:276] 0709 13:10:46.811376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.820905 (+  9529us) service_pool.cc:224] Handling call
0709 13:10:46.821332 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.358024 (+536692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.842644 (+484620us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540011e4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:47.842819 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991778688}
I20260709 13:10:48.193455 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.385664 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.121218 32311 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.196314 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.292738 28015 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:48.330492 27262 rpcz_store.cc:276] 0709 13:10:47.033574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.273594 (+240020us) service_pool.cc:224] Handling call
0709 13:10:47.352264 (+ 78670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.029359 (+677095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.029404 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.029461 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:48.029505 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.108742 (+ 79237us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540031f6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:48.108802 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.108969 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556606720}
I20260709 13:10:48.163997 32330 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.114794 31975 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.430972 27166 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 11, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 11 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:48.341544 32206 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:48.342089 32328 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:48.131312 32215 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.211s
I20260709 13:10:48.118031 32155 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.342607 32204 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.343308 32331 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:48.460700 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:48.462546 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:48.464967 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.353943 32323 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:47.880684 27410 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:10:48.355641 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.356694 27266 raft_consensus.cc:2889] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.359913 27259 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:48.364326 32275 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:48.326468 32234 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.362167 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:48.360924 27335 raft_consensus.cc:2376] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16. Re-sending same reply.
I20260709 13:10:48.431046 32283 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.370801 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.372408 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.381450 27416 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:48.350853 32272 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:48.353731 32064 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.388302 27268 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:48.389346 27265 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.391664 27343 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:10:48.450837 27341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.016s	sys 0.078s
I20260709 13:10:48.338449 32237 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:48.458514 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:48.338692 32249 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.475909 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:48.476071 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.470438 27166 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 8, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:48.479015 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:48.309912 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.452296 32276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.011s
W20260709 13:10:48.489725 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 127656us
I20260709 13:10:48.367019 28007 raft_consensus.cc:606] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:48.490073 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:48.467553 32142 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.018s
I20260709 13:10:48.494187 27263 raft_consensus.cc:2368] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12.
I20260709 13:10:48.494961 27336 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:48.448161 32140 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.449007 32284 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:48.454295 32155 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.497416 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:48.391916 32205 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:48.393585 32294 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.501516 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:48.391726 32047 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.469558 27339 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:48.337538 32151 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.338025 32286 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:48.451182 32161 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:48.894192 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.501732 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:48.549737 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 449166us
I20260709 13:10:48.928184 27334 raft_consensus.cc:2376] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12. Re-sending same reply.
W20260709 13:10:48.928475 27380 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.712s (SENT) [suppressed 43 similar messages]
W20260709 13:10:48.929824 27341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.036s	sys 0.134s
I20260709 13:10:48.929432 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.933435 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.927578 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 719) took 1133 ms. Trace:
W20260709 13:10:48.935643 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 477179us
I20260709 13:10:48.941756 27336 rpcz_store.cc:276] 0709 13:10:47.794006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.372071 (+578065us) service_pool.cc:224] Handling call
0709 13:10:48.927515 (+555444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.941983 27337 raft_consensus.cc:2376] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12. Re-sending same reply.
W20260709 13:10:48.656303 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.651893 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:48.730405 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71089.1us
I20260709 13:10:48.654386 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:48.945587 27410 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.508286 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:48.515749 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.954962 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.956182 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:48.956902 27268 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:48.957616 28007 raft_consensus.cc:614] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:48.957463 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:48.957856 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:48.958370 27264 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:48.958455 27266 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 10.
W20260709 13:10:48.958474 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.960371 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.961364 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.477226 32186 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.970870 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.971702 27335 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
W20260709 13:10:49.000054 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 70362.1us
I20260709 13:10:48.987709 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.972841 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.001530 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.002132 27166 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 8, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 8 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.006835 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:48.933979 32276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.015s	sys 0.032s
I20260709 13:10:49.007220 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.008898 27411 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:10:49.009815 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:48.976933 32284 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.006842 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:48.976613 32280 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.011654 32330 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.012202 32284 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.012084 32280 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.975919 32237 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.012743 27336 raft_consensus.cc:1240] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:49.013504 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2373) took 1401 ms. Trace:
I20260709 13:10:49.014197 32280 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.013857 27336 rpcz_store.cc:276] 0709 13:10:47.612197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.012300 (+1400103us) service_pool.cc:224] Handling call
0709 13:10:49.012573 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.013274 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.013451 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:49.016367 32113 consensus_meta.cc:287] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.001s
I20260709 13:10:49.017081 32237 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.019099 27264 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:48.469871 32204 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.021790 27414 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:49.022387 32204 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:48.949224 32294 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.973657 32205 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.024475 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.025897 27334 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:49.026540 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 717) took 1338 ms. Trace:
I20260709 13:10:49.036952 32151 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.039249 32286 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.025897 32205 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.044371 32234 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:49.049755 32219 consensus_meta.cc:287] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.000s
I20260709 13:10:49.050369 32219 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.051546 32089 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:48.970853 32137 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.052230 32272 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.054531 32270 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.055251 32284 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.062162 32140 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.064169 27342 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:49.102536 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2368) took 1580 ms. Trace:
I20260709 13:10:49.103004 27342 rpcz_store.cc:276] 0709 13:10:47.522603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.063554 (+1540951us) service_pool.cc:224] Handling call
0709 13:10:49.063943 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.102196 (+ 38253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.102464 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.076958 27265 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:49.079824 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.105736 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:48.926800 32341 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.342s	user 0.000s	sys 0.000s
I20260709 13:10:48.471143 32206 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.026844 27334 rpcz_store.cc:276] 0709 13:10:47.687702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.025347 (+1337645us) service_pool.cc:224] Handling call
0709 13:10:49.025604 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.026325 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.026487 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.488615 32323 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:48.948972 32142 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.019s	sys 0.030s
I20260709 13:10:49.005330 27166 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:10:49.155669 27309 connection.cc:256] RPC call timeout handler was delayed by -1.296412217000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:10:49.091739 27978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.019s	sys 0.017s
I20260709 13:10:49.095153 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:49.156651 27340 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:49.156383 27166 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:48.576402 31975 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:48.577338 31854 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:48.576840 32179 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:49.169751 32179 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.170290 32179 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:48.584417 32274 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.171463 32274 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:48.503480 32311 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.172581 32311 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.173031 32311 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:48.750953 32213 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.110085 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:49.176044 27267 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:49.115398 27413 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.034s	sys 0.121s
W20260709 13:10:49.177017 27413 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.034s	sys 0.121s
W20260709 13:10:49.097494 32343 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
I20260709 13:10:49.083091 27339 raft_consensus.cc:2393] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:49.092797 32137 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.179481 32137 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:48.729959 32275 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.128674 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.128629 32329 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.129647 27262 raft_consensus.cc:1275] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:49.133358 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:49.145751 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.005s	sys 0.035s
W20260709 13:10:49.187201 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.005s	sys 0.036s
W20260709 13:10:49.187570 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 802574us
I20260709 13:10:49.110855 32270 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.081845 32186 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.155076 32347 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:48.503938 32283 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:48.580709 32209 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:49.158808 27978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.019s	sys 0.017s
I20260709 13:10:48.575747 32331 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.158083 27166 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 10, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 10 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:49.204425 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.159245 27309 connection.cc:256] RPC call timeout handler was delayed by -1.2658122169999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:10:49.119628 27417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.009s	sys 0.028s
W20260709 13:10:49.205682 27309 connection.cc:256] RPC call timeout handler was delayed by -1.2244122170000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:10:49.184763 32047 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.184928 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.185771 32275 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:49.115490 32284 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.101333 32272 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.187208 27334 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:49.150082 32219 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.191646 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.190457 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.205834 27417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.010s	sys 0.028s
I20260709 13:10:49.211699 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2378) took 1477 ms. Trace:
W20260709 13:10:49.129163 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.021s	sys 0.091s
W20260709 13:10:49.212366 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.021s	sys 0.091s
I20260709 13:10:49.212112 27342 rpcz_store.cc:276] 0709 13:10:47.734041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.210776 (+1476735us) service_pool.cc:224] Handling call
0709 13:10:49.211097 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.211321 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.211358 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.211401 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:49.211449 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.211505 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.211615 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:49.213012 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 828261us
W20260709 13:10:49.206245 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0192122170000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
W20260709 13:10:49.214540 27309 connection.cc:256] RPC call timeout handler was delayed by -1.0075122169999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
I20260709 13:10:49.214053 27342 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:49.187371 32178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.014s
I20260709 13:10:49.235096 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35486 (request call id 8) took 1467 ms. Trace:
I20260709 13:10:49.235453 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2379) took 1501 ms. Trace:
I20260709 13:10:49.236045 27342 rpcz_store.cc:276] 0709 13:10:47.734429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.213455 (+1479026us) service_pool.cc:224] Handling call
0709 13:10:49.213802 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.234572 (+ 20770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.235370 (+   798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.130728 32323 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.235633 28007 rpcz_store.cc:276] 0709 13:10:47.767865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.768122 (+   257us) service_pool.cc:224] Handling call
0709 13:10:49.234865 (+1466743us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54006617d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2b853 00007fbd87bf960a 00007fbd8117f7d4 00007fbd8117f762 00007fbd8117f691 00007fbd8117f60c 00007fbd8117e8c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:49.235018 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375759104}
I20260709 13:10:49.238409 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:49.245710 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 718) took 1554 ms. Trace:
I20260709 13:10:49.252506 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.253474 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.254287 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:49.254679 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.258010 27340 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:49.258818 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 721) took 1353 ms. Trace:
I20260709 13:10:49.260253 27340 rpcz_store.cc:276] 0709 13:10:47.905538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.983126 (+1077588us) service_pool.cc:224] Handling call
0709 13:10:49.258724 (+275598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.262281 27340 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:49.262971 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2387) took 1526 ms. Trace:
I20260709 13:10:49.263399 27340 rpcz_store.cc:276] 0709 13:10:47.736630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.261504 (+1524874us) service_pool.cc:224] Handling call
0709 13:10:49.261865 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.262673 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.262905 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.246335 27334 rpcz_store.cc:276] 0709 13:10:47.691401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.208010 (+1516609us) service_pool.cc:224] Handling call
0709 13:10:49.245034 (+ 37024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.245251 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.245287 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.245347 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.245393 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.245468 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.245617 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.241714 27342 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:49.277143 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2380) took 1542 ms. Trace:
I20260709 13:10:49.280248 27264 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:10:49.274940 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1598700389999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:10:49.282068 27231 connection.cc:256] RPC call timeout handler was delayed by -1.1018903960000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3669s for a response
W20260709 13:10:49.282518 27231 connection.cc:256] RPC call timeout handler was delayed by -1.0635700389999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:10:49.277547 27342 rpcz_store.cc:276] 0709 13:10:47.734735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.236855 (+1502120us) service_pool.cc:224] Handling call
0709 13:10:49.237185 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.276785 (+ 39600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.277063 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:49.229894 32178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.000s	sys 0.015s
I20260709 13:10:49.347788 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:49.376893 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1940) took 1915 ms. Trace:
W20260709 13:10:49.377964 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.378458 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.426216 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.379127 32179 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.278981 32351 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:49.381073 32294 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:49.383502 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.422698 27417 rpcz_store.cc:276] 0709 13:10:47.461894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.462023 (+   129us) service_pool.cc:224] Handling call
0709 13:10:47.495820 (+ 33797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.788840 (+293020us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:47.788884 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:47.815180 (+ 26296us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.211904 (+1396724us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.211958 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.212047 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.376668 (+164621us) raft_consensus.cc:1685] finished
0709 13:10:49.376688 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.376832 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3241,"raft.queue_time_us":141209,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":24021,"thread_start_us":1391766,"threads_started":2,"wal-append.queue_time_us":1106423}
W20260709 13:10:49.434898 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 446115us
I20260709 13:10:49.385314 32089 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:49.386022 32204 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.387537 32161 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.278774 32213 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.395824 32249 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.415746 32270 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:49.244693 32328 consensus_meta.cc:287] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.006s
W20260709 13:10:49.399634 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 183797us
I20260709 13:10:49.242398 32219 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.227967 32104 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.403767 27340 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 10. Current term is 11. Ops: []
W20260709 13:10:49.405838 27442 heartbeater.cc:646] Failed to heartbeat to 127.25.139.190:43657 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.25.139.190:43657 timed out after 15.000s (SENT)
I20260709 13:10:49.406111 32283 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.407923 27337 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:49.409441 32030 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:49.241698 32348 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.415640 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1941) took 1953 ms. Trace:
I20260709 13:10:49.486331 27416 rpcz_store.cc:276] 0709 13:10:47.462246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.462357 (+   111us) service_pool.cc:224] Handling call
0709 13:10:47.488178 (+ 25821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.495386 (+1007208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.415422 (+920036us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54000ada54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:49.415578 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053694720}
I20260709 13:10:49.416234 32205 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.416654 32330 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.417033 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.357318 27307 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.015s	sys 0.011s
W20260709 13:10:49.490867 27307 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.016s	sys 0.012s
I20260709 13:10:49.417615 27233 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:49.493646 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 76136.1us
I20260709 13:10:49.279002 31854 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:10:49.232754 32347 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.368027 27166 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 8 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 11 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:49.424419 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.428983 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.498733 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.499220 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.433600 27410 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:49.436143 27306 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:49.433122 27383 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:49.499964 27410 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 1948) took 1042 ms. Trace:
W20260709 13:10:49.500409 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 67399.2us
I20260709 13:10:49.500456 27410 rpcz_store.cc:276] 0709 13:10:48.457054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.654084 (+197030us) service_pool.cc:224] Handling call
0709 13:10:49.499885 (+845801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.438719 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:49.443993 27263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2652) took 1339 ms (client timeout 1502 ms). Trace:
I20260709 13:10:49.501849 27412 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:49.501785 27263 rpcz_store.cc:269] 0709 13:10:48.104498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.120938 (+ 16440us) service_pool.cc:224] Handling call
0709 13:10:49.443697 (+1322759us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003147d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:49.443907 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293213440}
I20260709 13:10:49.426807 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:49.456264 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.456452 27267 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:49.417124 32280 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.506669 32280 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.508949 32280 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.460830 27259 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:49.462507 27264 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:49.510357 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 74696.1us
I20260709 13:10:49.511180 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:49.397691 32206 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.513315 32140 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.513899 32140 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:49.431789 32209 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:49.514786 32140 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.515441 32209 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.517560 32209 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:49.465735 27265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2651) took 1622 ms (client timeout 1855 ms). Trace:
I20260709 13:10:49.479802 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.518400 31807 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.518944 31807 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:49.519833 31807 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.520817 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.522310 32234 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.522588 32286 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:49.522994 32234 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:49.518095 27265 rpcz_store.cc:269] 0709 13:10:47.843078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.843265 (+   187us) service_pool.cc:224] Handling call
0709 13:10:49.465564 (+1622299us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003034d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:49.465668 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652011904}
I20260709 13:10:49.527644 27262 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:10:49.528370 32206 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:49.529724 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2372) took 1944 ms. Trace:
I20260709 13:10:49.530117 27337 rpcz_store.cc:276] 0709 13:10:47.585659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.010743 (+1425084us) service_pool.cc:224] Handling call
0709 13:10:49.407542 (+396799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.478666 (+ 71124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.529558 (+ 50892us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54002db750. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:49.529670 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911844224}
I20260709 13:10:49.531219 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:49.533178 32206 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:49.533689 32186 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.479794 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 720) took 1659 ms. Trace:
W20260709 13:10:49.480464 27981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.035s
W20260709 13:10:49.535671 27981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.019s	sys 0.035s
W20260709 13:10:49.536121 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 581569us
I20260709 13:10:49.533701 32206 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:49.467083 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2367) took 1943 ms. Trace:
I20260709 13:10:49.539000 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.539345 27341 rpcz_store.cc:276] 0709 13:10:47.522289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.524521 (+  2232us) service_pool.cc:224] Handling call
0709 13:10:47.841077 (+316556us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ca22 00007fbd88a25c09 00007fbd87b7fee0 00007fbd87c490ab 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:10:47.841306 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.841497 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:48.931940 (+1090443us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.465070 (+533130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.465125 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:49.465176 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.465244 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.465369 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1284995,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":933,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12921,"spinlock_wait_cycles":10313984,"thread_start_us":1545133,"threads_started":2}
I20260709 13:10:49.486927 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:49.542218 27417 raft_consensus.cc:2368] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:49.542960 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:49.480857 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 503208us
I20260709 13:10:49.544587 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.539544 32206 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.546373 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:49.547971 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.547924 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.548748 32047 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:49.535475 27340 rpcz_store.cc:276] 0709 13:10:47.820132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.264293 (+1444161us) service_pool.cc:224] Handling call
0709 13:10:49.403601 (+139308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.479546 (+ 75945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.479733 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.548774 27342 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:49.557685 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.559109 27412 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
W20260709 13:10:49.566246 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64776.9us
I20260709 13:10:49.567215 27383 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:49.576261 27166 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 5 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 8 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:49.577487 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:49.593446 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.594303 27410 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:49.496688 32142 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.496863 32351 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.600171 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.600658 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.600806 27410 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
W20260709 13:10:49.600200 27380 connection.cc:256] RPC call timeout handler was delayed by -1.9916611789999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 13:10:49.459913 32204 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.457499 32089 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.606094 27233 leader_election.cc:400] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:49.609330 27233 leader_election.cc:403] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.610759 28012 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:10:49.602134 27380 connection.cc:256] RPC call timeout handler was delayed by -1.9211123740000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:10:49.595481 27166 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 4 to 5, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 5 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:49.602882 27337 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:49.576020 32283 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.463610 32137 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.478471 32161 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:10:49.606084 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.607579 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.618144 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.613978 28009 raft_consensus.cc:1275] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:49.614953 27166 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 6 to 9, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 9 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:49.489307 32249 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:10:49.497884 32205 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.563536 32330 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.621577 32351 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:49.496023 32104 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.489674 32219 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.496934 32030 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.622875 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.597851 32209 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:49.664036 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:49.621600 28014 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.007s	sys 0.026s
I20260709 13:10:49.620565 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:49.671459 27416 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.608331 32270 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:49.620873 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:49.644928 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:49.678169 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 57374.5us
I20260709 13:10:49.497076 32348 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.610368 32284 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.654394 27338 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:49.615834 32272 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.702355 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.704874 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.619225 32323 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:49.662569 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.673245 28014 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.026s
I20260709 13:10:49.674409 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:10:49.678646 27380 connection.cc:256] RPC call timeout handler was delayed by -1.5935287720000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2775s for a response
W20260709 13:10:49.679603 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.683175 28007 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:49.686113 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.627422 32311 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.699924 32104 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.609071 32142 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:49.650345 32283 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:49.708381 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:49.682402 31647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.017s	sys 0.017s
W20260709 13:10:49.712411 27380 connection.cc:256] RPC call timeout handler was delayed by -1.5140201929999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:10:49.738482 27380 connection.cc:256] RPC call timeout handler was delayed by -1.2818668780000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
W20260709 13:10:49.739075 27380 connection.cc:256] RPC call timeout handler was delayed by -1.1951128489999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3125s for a response
W20260709 13:10:49.739539 27380 connection.cc:256] RPC call timeout handler was delayed by -1.0943661510000311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:10:49.740252 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.740363 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:49.664299 32209 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:49.717823 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.718499 28011 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:49.718855 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.784283 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 500541us
I20260709 13:10:49.719602 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:49.649659 32286 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:10:49.725476 27416 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:49.687950 32351 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:49.729115 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.729483 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.787356 27264 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:49.732159 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.733297 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.686348 32328 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.735625 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:49.736563 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 62240.2us
I20260709 13:10:49.800832 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:49.729053 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.802467 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 248599us
I20260709 13:10:49.802809 27261 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:49.741103 27268 raft_consensus.cc:2410] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:49.748499 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:49.763074 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54772.4us
I20260709 13:10:49.804289 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.805073 28012 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:49.735862 32179 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.750895 32294 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:49.767267 32355 log.cc:927] Time spent T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:10:49.825052 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.765158 32209 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:49.780635 32089 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.729120 32331 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.781708 32030 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.750430 32369 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:49.710306 32365 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.742965 27978 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.783974 27341 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:49.785936 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.869637 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126795us
W20260709 13:10:49.793581 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.805779 28011 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:49.806255 28015 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:49.690724 27166 catalog_manager.cc:5697] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 2 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:10:49.751554 32155 consensus_meta.cc:287] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
I20260709 13:10:49.738585 32280 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:49.741679 32284 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:49.821842 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 81598.7us
W20260709 13:10:49.879272 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.880033 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:49.881547 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:49.822535 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:49.813330 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:10:49.883584 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 70341us
I20260709 13:10:49.827523 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:49.885505 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 58093.3us
I20260709 13:10:49.780265 32330 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:49.829010 28010 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:49.828727 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2370) took 2305 ms. Trace:
I20260709 13:10:49.833191 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:49.875929 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 355152us
I20260709 13:10:49.738914 32349 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:10:49.806318 32104 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:49.838864 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49416 (request call id 716) took 2155 ms. Trace:
I20260709 13:10:49.914999 27338 rpcz_store.cc:276] 0709 13:10:47.683459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.987341 (+1303882us) service_pool.cc:224] Handling call
0709 13:10:49.838588 (+851247us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b5400260054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:49.838770 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494881664}
I20260709 13:10:49.915503 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2354) took 1517 ms. Trace:
I20260709 13:10:49.917035 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.842537 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2353) took 1444 ms. Trace:
I20260709 13:10:49.837177 32137 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:49.918288 27413 rpcz_store.cc:276] 0709 13:10:48.398015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.399513 (+  1498us) service_pool.cc:224] Handling call
0709 13:10:48.431787 (+ 32274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.432047 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:49.177437 (+745390us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.842165 (+664728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.842235 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:49.842288 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.842357 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.842480 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4810,"prepare.queue_time_us":800946,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":19897,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11127,"thread_start_us":1370777,"threads_started":3,"wal-append.queue_time_us":552324}
I20260709 13:10:49.870954 32237 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:49.825870 32161 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:49.878456 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:49.892279 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:49.824522 32351 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:49.836330 32220 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.831605 32178 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:49.899917 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:49.901111 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:49.899191 27166 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:49.911689 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:49.898959 27335 rpcz_store.cc:276] 0709 13:10:47.578102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.010591 (+1432489us) service_pool.cc:224] Handling call
0709 13:10:49.010896 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.011069 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:49.456848 (+445779us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.828416 (+371568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.828462 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:49.828507 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.828561 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.828676 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":221858,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4502,"raft.queue_time_us":67410,"thread_start_us":773515,"threads_started":2}
I20260709 13:10:49.872197 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:49.997977 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 170002us
I20260709 13:10:49.923623 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:49.916046 27408 rpcz_store.cc:276] 0709 13:10:48.398320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.398436 (+   116us) service_pool.cc:224] Handling call
0709 13:10:48.430674 (+ 32238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.024139 (+593465us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:49.462785 (+438646us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.749665 (+286880us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.749745 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:49.749820 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.915216 (+165396us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54000f1c54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:49.915276 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.915434 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4174,"prepare.queue_time_us":322202,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":69419,"raft.queue_time_us":31484,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16934,"spinlock_wait_cycles":1364404480,"thread_start_us":699653,"threads_started":2}
I20260709 13:10:49.998714 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:49.874531 31854 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.926460 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:50.000138 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 73756.1us
I20260709 13:10:49.868759 32369 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:49.988281 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.986972 27262 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:49.985260 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:50.002192 27263 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:49.869899 32331 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.924906 32237 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:49.993538 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 171053us
I20260709 13:10:49.810626 32328 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:49.987303 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1944) took 1531 ms. Trace:
I20260709 13:10:49.908871 32357 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:50.002833 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 715) took 2327 ms. Trace:
I20260709 13:10:50.004720 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2371) took 2420 ms. Trace:
I20260709 13:10:50.025151 27343 rpcz_store.cc:276] 0709 13:10:47.584849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.007863 (+1423014us) service_pool.cc:224] Handling call
0709 13:10:49.008129 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.008353 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:49.469182 (+460829us) log.cc:844] Serialized 14 byte log entry
0709 13:10:50.004140 (+534958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:50.004245 (+   105us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:50.004324 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.004446 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.004628 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178666,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":897242,"threads_started":3}
W20260709 13:10:50.013644 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 141550us
I20260709 13:10:50.022511 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.010778 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:50.017594 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 117767us
I20260709 13:10:49.924147 32330 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:49.919093 32089 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:50.021266 27415 rpcz_store.cc:276] 0709 13:10:48.455972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.726611 (+270639us) service_pool.cc:224] Handling call
0709 13:10:48.840809 (+114198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.928047 (+ 87238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.928082 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:48.928741 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.202557 (+273816us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:49.202602 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.202675 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.987052 (+784377us) raft_consensus.cc:1685] finished
0709 13:10:49.987072 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.987239 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54222,"raft.queue_time_us":88266,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":39116,"thread_start_us":273450,"threads_started":1,"wal-append.queue_time_us":516018}
I20260709 13:10:49.946075 32151 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:49.894559 32155 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.025077 27336 rpcz_store.cc:276] 0709 13:10:47.675025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.016155 (+1341130us) service_pool.cc:224] Handling call
0709 13:10:49.017464 (+  1309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.094356 (+ 76892us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:49.431663 (+337307us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.786434 (+354771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.786500 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.804519 (+ 18019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.002584 (+198065us) spinlock_profiling.cc:243] Waited 76.4 ms on lock 0x7b540014b9d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:50.002637 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.002773 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269052,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":53194,"raft.queue_time_us":41922,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":5168,"spinlock_wait_cycles":175824128,"thread_start_us":671091,"threads_started":2}
I20260709 13:10:50.025245 27166 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 8, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:50.037201 28009 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 10: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:49.997820 32276 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:49.895902 32280 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:50.042222 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.899772 32359 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:10:50.034307 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:49.973271 32270 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:49.994490 31807 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.044613 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.014159 32064 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.051116 27408 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:50.011893 32358 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:49.926106 32284 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.018784 32205 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.004972 32369 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:49.877625 32365 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.084426 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.064167 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:50.086092 28008 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:50.086186 27265 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:50.069046 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.034323 32330 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:50.128643 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:50.129415 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.129618 27408 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:50.035749 32219 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:50.134974 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 106005us
I20260709 13:10:50.136207 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.140724 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:50.051640 32357 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:50.017305 31854 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.132236 27166 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:50.057823 31807 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:50.015681 32178 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.058976 32161 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:49.950412 32283 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.153884 27415 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:50.217386 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81355.5us
I20260709 13:10:50.047813 32350 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:10:50.033851 32354 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:10:50.142153 32330 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:50.156246 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 119812us
I20260709 13:10:50.133785 32206 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.155393 32349 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.230459 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.047942 32151 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:50.225119 32367 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
W20260709 13:10:50.224269 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.240604 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:50.156517 32377 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:10:50.207774 27166 catalog_manager.cc:5697] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:10:50.179263 32219 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.156169 32391 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.150010 32311 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:50.223392 32380 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:10:50.141779 32205 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.284389 32205 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:50.284876 32205 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:50.285257 32205 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:50.220257 31807 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.287451 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.289058 27414 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:50.290411 27414 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:10:50.291802 32372 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:10:50.293030 27411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36154 (request call id 771) took 1319 ms. Trace:
W20260709 13:10:50.293483 32385 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:50.293422 27411 rpcz_store.cc:276] 0709 13:10:48.973465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.203234 (+229769us) service_pool.cc:224] Handling call
0709 13:10:49.251287 (+ 48053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.274138 (+ 22851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.274172 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.274645 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.684289 (+409644us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.684330 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.684397 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.292776 (+608379us) raft_consensus.cc:1685] finished
0709 13:10:50.292800 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.292955 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62874,"raft.queue_time_us":146,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":26182,"thread_start_us":306470,"threads_started":1,"wal-append.queue_time_us":594955}
W20260709 13:10:50.295084 32387 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:10:50.296548 32178 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.298542 31854 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:50.217747 32161 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:50.299150 32161 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.299654 32331 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:50.300304 32362 log.cc:927] Time spent T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.466s	user 0.001s	sys 0.001s
I20260709 13:10:50.265957 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.303398 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.211957 32137 consensus_queue.cc:1048] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:10:50.305148 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:50.307152 32274 consensus_meta.cc:287] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.135s	user 0.010s	sys 0.002s
W20260709 13:10:50.260574 32390 log.cc:927] Time spent T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:10:50.274930 32064 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.226153 32142 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.291677 32284 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.337720 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.244802 32206 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.307706 32274 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:50.295115 32275 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 1.067s	user 0.004s	sys 0.004s
I20260709 13:10:50.331662 32219 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:50.349478 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 72001.9us
I20260709 13:10:50.364038 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:50.345714 27415 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:50.364852 27265 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:50.247834 32047 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:10:50.368269 27259 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:50.151080 32351 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.380965 27266 raft_consensus.cc:2368] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
I20260709 13:10:50.381732 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:50.382440 27265 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:50.357614 32370 log.cc:927] Time spent T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260709 13:10:50.344779 32186 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.389371 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.344533 32179 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.344938 32331 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.390134 27415 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:50.348978 32206 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:50.393874 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 482264us
I20260709 13:10:50.353057 32284 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:50.397264 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:50.306989 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.403712 27265 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:50.404312 27380 leader_election.cc:400] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11.
I20260709 13:10:50.405475 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:50.405791 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:50.406371 27268 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 13: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:50.412590 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:50.413306 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 106382us
I20260709 13:10:50.414531 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.252559 32270 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.380479 32275 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.384037 32396 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:50.442669 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78154.5us
I20260709 13:10:50.443648 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:50.451004 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.355659 31807 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.461817 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.273031 27166 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:10:50.463898 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49333.4us
I20260709 13:10:50.390712 32137 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:50.470625 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.455720 32179 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.447742 32331 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.480692 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.446866 32204 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.423902 32142 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:10:50.447062 32328 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.455925 32220 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.380784 32357 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.448395 32104 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:50.416401 32284 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.525957 27166 catalog_manager.cc:5697] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 5 to 7, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 7 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:50.532703 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81795.1us
W20260709 13:10:50.536100 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46192.4us
I20260709 13:10:50.447956 32275 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.483526 32178 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:50.575767 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.531682 32179 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:50.494762 32402 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.570639 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:50.612903 27415 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:50.494992 32186 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.610498 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:50.614368 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46295.9us
I20260709 13:10:50.615613 32407 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:50.617467 32407 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:50.617982 32407 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:50.618721 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.523856 32398 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:10:50.608512 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.543694 32365 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.539186 32328 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.623683 31807 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.543567 32220 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.623478 32179 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.625422 32104 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.613359 32047 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:50.639037 32373 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.692s	user 0.000s	sys 0.002s
W20260709 13:10:50.541360 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126893us
I20260709 13:10:50.628826 27409 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2347) took 2850 ms. Trace:
I20260709 13:10:50.712232 27409 rpcz_store.cc:276] 0709 13:10:47.778592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.835460 (+ 56868us) service_pool.cc:224] Handling call
0709 13:10:47.835913 (+   453us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:10:48.100590 (+264677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.100633 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:10:48.657271 (+556638us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b18004529e0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a
0709 13:10:49.410118 (+752847us) spinlock_profiling.cc:243] Waited 8.9 ms on lock 0x7b2c0009df68. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:10:49.410869 (+   751us) log.cc:844] Serialized 78 byte log entry
0709 13:10:49.735286 (+324417us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:49.735343 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.735438 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.628437 (+892999us) raft_consensus.cc:1685] finished
0709 13:10:50.628470 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.628738 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264173,"raft.queue_time_us":270728,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5083,"spinlock_wait_cycles":32426240,"thread_start_us":323910,"threads_started":1,"wal-append.queue_time_us":1213293}
I20260709 13:10:50.713215 27380 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:50.636772 32209 consensus_meta.cc:287] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
I20260709 13:10:50.637032 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:50.637738 32414 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:10:50.638339 32375 log.cc:927] Time spent T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
W20260709 13:10:50.639179 32384 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 13:10:50.641323 32395 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:10:50.632035 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.645370 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1797) took 1564 ms. Trace:
I20260709 13:10:50.617954 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.650123 27233 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.584513 32404 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:50.636745 32418 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.691454 32179 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.693871 32220 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:50.695813 32392 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:50.633328 32402 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:50.696789 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 86415.4us
I20260709 13:10:50.819314 32408 consensus_queue.cc:1048] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:10:50.819850 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.820885 32402 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:50.821231 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:50.821724 32393 log.cc:927] Time spent T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:10:50.699493 32381 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:10:50.699918 32347 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:50.709358 32348 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.823112 32179 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:50.701570 32205 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.703610 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 730) took 1154 ms. Trace:
I20260709 13:10:50.828303 27339 rpcz_store.cc:276] 0709 13:10:49.549509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.549634 (+   125us) service_pool.cc:224] Handling call
0709 13:10:49.549911 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.550269 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.550305 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.550891 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.927827 (+376936us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.927865 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.927938 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.703383 (+775445us) raft_consensus.cc:1685] finished
0709 13:10:50.703407 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.703548 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5108,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":376537,"threads_started":1,"wal-append.queue_time_us":1138401}
I20260709 13:10:50.716564 28013 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:50.716827 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:50.718649 27412 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:50.720264 32274 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:50.723130 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 273200us
I20260709 13:10:50.719471 32410 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:10:50.785849 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 135815us
I20260709 13:10:50.785358 27260 rpcz_store.cc:276] 0709 13:10:49.081021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.106831 (+ 25810us) service_pool.cc:224] Handling call
0709 13:10:49.107201 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.107476 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.107511 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.116865 (+  9354us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.625331 (+508466us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:49.824011 (+198680us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.827540 (+  3529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.827624 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:50.645150 (+817526us) raft_consensus.cc:1685] finished
0709 13:10:50.645171 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.645308 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22517,"prepare.queue_time_us":202932,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":7627,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":33041,"thread_start_us":437569,"threads_started":1,"wal-append.queue_time_us":686439}
I20260709 13:10:50.721755 32391 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.822505 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.699204 28008 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55770 (request call id 615) took 2620 ms. Trace:
I20260709 13:10:50.709403 32219 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:50.833127 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:50.840588 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 222718us
I20260709 13:10:50.841257 27978 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:50.838182 28008 rpcz_store.cc:276] 0709 13:10:48.078445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.079108 (+   663us) service_pool.cc:224] Handling call
0709 13:10:48.079504 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.086671 (+2007167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.698949 (+612278us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540012fcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:50.699122 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4614299008}
W20260709 13:10:50.750418 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 121275us
I20260709 13:10:50.836284 27233 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.721668 32284 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:50.839637 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 122878us
I20260709 13:10:50.844138 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.844980 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:50.778518 32323 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:50.717386 32137 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:10:50.824523 32186 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:50.851691 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.852227 27337 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:50.721863 32209 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.861285 27339 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:50.831355 32178 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:50.863361 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.832614 32404 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:50.864339 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:50.865523 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.867508 27415 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:50.860996 32186 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.869815 32186 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:50.852226 32348 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.871526 32205 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.873817 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.874305 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:50.847697 31807 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:50.876703 32378 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:50.880915 32397 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:50.807962 32161 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.884949 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.851845 32274 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:50.853412 32408 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.861240 32220 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:50.863025 32418 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:50.903260 31807 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.903594 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:50.904110 31807 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:50.904564 31807 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.904628 32161 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.905014 31807 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.695816 32407 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.907487 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:50.909569 32398 consensus_queue.cc:1048] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:50.911494 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:50.912043 32404 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:50.914266 32209 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.889151 32047 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:10:50.916007 32369 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.771s	user 0.009s	sys 0.000s
I20260709 13:10:50.861117 32323 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.895414 32220 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:50.899823 32418 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.918999 31807 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:50.921734 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 99281.7us
I20260709 13:10:50.955832 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:50.929793 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71740.8us
I20260709 13:10:50.894815 32137 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:50.931218 28013 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
W20260709 13:10:50.948884 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 316885us
I20260709 13:10:50.895926 32348 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:10:50.921140 28007 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:50.970496 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:50.953791 32179 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:50.949270 32369 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:50.954471 32418 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:50.966890 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.968237 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.951717 32407 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:50.982614 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.977545 27337 raft_consensus.cc:2393] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:50.952662 32220 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:50.955008 32330 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.004s
I20260709 13:10:50.991366 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:50.983150 27308 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:50.985124 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.953421 32275 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:50.986199 32047 consensus_queue.cc:1059] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 13:10:50.987807 32427 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:50.988263 32369 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:50.989503 28010 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:50.997622 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.999712 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 112386us
I20260709 13:10:51.001626 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:50.996212 32330 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.008558 32179 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.009572 32330 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:50.993664 32283 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.011355 32433 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:51.012058 32433 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:50.989476 32408 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:51.031661 27415 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:51.027995 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.033113 27410 raft_consensus.cc:2393] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:51.030859 27408 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:50.993108 32274 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:51.036607 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 51543us
I20260709 13:10:50.995803 32401 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.038967 27410 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:51.032070 32408 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.070935 27412 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:50.993197 32137 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:51.000481 32275 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.073195 27415 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:51.011662 32283 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:51.078262 32206 consensus_meta.cc:287] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.005s
I20260709 13:10:51.081369 32206 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.084646 28008 raft_consensus.cc:2368] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
W20260709 13:10:51.088644 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 50067.7us
I20260709 13:10:51.089968 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:51.070856 32427 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:51.091064 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:51.094427 27414 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:51.070076 32408 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.067996 32155 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.101747 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.102603 27336 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.061234 32209 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:51.099116 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.203246 32276 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.262298 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2664) took 1548 ms. Trace:
I20260709 13:10:51.259259 31807 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:51.257906 32280 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:51.046952 32401 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:51.203677 27265 raft_consensus.cc:1240] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:51.285672 32401 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.286410 32276 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.264003 32186 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.289383 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.290665 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.290537 32186 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.294060 32402 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:51.294620 32402 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:51.295477 32402 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.295922 32401 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.296795 32402 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.298457 32401 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.277297 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.227854 32179 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.299819 32280 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:51.300213 32280 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.300580 32280 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.301330 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 723) took 1585 ms. Trace:
I20260709 13:10:51.301693 27263 rpcz_store.cc:276] 0709 13:10:49.716070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.002910 (+286840us) service_pool.cc:224] Handling call
0709 13:10:50.003317 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.243218 (+239901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.243246 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:50.249312 (+  6066us) log.cc:844] Serialized 26 byte log entry
0709 13:10:50.627078 (+377766us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:50.627115 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.300966 (+673851us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54001d97d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:51.301012 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.301055 (+    43us) raft_consensus.cc:1685] finished
0709 13:10:51.301068 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.301277 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551045120,"thread_start_us":377453,"threads_started":1,"wal-append.queue_time_us":537978}
I20260709 13:10:51.303505 32276 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.306816 32276 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:51.120278 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.308391 27268 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.308234 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:51.309494 27336 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:51.036924 32234 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:10:51.228636 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.635s (SENT)
W20260709 13:10:51.268039 32368 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 1.282s	user 0.000s	sys 0.007s
I20260709 13:10:51.250926 32151 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.277455 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.320012 27260 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.320533 32323 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:51.320935 32440 log.cc:927] Time spent T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:10:51.321735 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 222668us
I20260709 13:10:51.279628 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:51.323592 32434 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:51.323698 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.324640 27264 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:51.092983 32283 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.254140 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:51.262737 32220 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.135948 32433 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.151744 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 640) took 3464 ms. Trace:
I20260709 13:10:51.283933 27259 rpcz_store.cc:276] 0709 13:10:49.714287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.718347 (+  4060us) service_pool.cc:224] Handling call
0709 13:10:51.262056 (+1543709us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54000b86d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.262224 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1335839232}
I20260709 13:10:51.266669 32408 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.303797 32274 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:51.207981 27266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1800) took 2076 ms (client timeout 1879 ms). Trace:
W20260709 13:10:51.340162 27266 rpcz_store.cc:269] 0709 13:10:49.131660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.203930 (+ 72270us) service_pool.cc:224] Handling call
0709 13:10:51.157213 (+1953283us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000b81d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.207863 (+ 50650us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703423232}
I20260709 13:10:51.229274 28009 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 654) took 1337 ms. Trace:
I20260709 13:10:51.308202 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.311419 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.341459 28009 rpcz_store.cc:276] 0709 13:10:49.891576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.891960 (+   384us) service_pool.cc:224] Handling call
0709 13:10:51.156903 (+1264943us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54004d49d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.229170 (+ 72267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199031168}
I20260709 13:10:51.315621 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.342446 27263 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.317132 32237 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.328001 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:51.352792 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 124206us
I20260709 13:10:51.331408 27260 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:51.335457 28014 rpcz_store.cc:276] 0709 13:10:47.687252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.687360 (+   108us) service_pool.cc:224] Handling call
0709 13:10:47.728645 (+ 41285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:49.712714 (+1984069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.712762 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.717991 (+  5229us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.973072 (+255081us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:49.973123 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.102142 (+1129019us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54006617d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:51.102191 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.102235 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:51.102248 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.151641 (+ 49393us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60775,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"spinlock_wait_cycles":2829507840,"thread_start_us":917332,"threads_started":2,"wal-append.queue_time_us":387472}
I20260709 13:10:51.313315 32291 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:51.343813 32206 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.344182 27268 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:51.333784 32186 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:51.346634 28011 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55770 (request call id 619) took 2095 ms (client timeout 2244 ms). Trace:
I20260709 13:10:51.308581 32209 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.347808 28015 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:51.348526 27231 connection.cc:256] RPC call timeout handler was delayed by -1.8791777709999451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:10:51.360322 27231 connection.cc:256] RPC call timeout handler was delayed by -1.839959318999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
W20260709 13:10:51.360805 27231 connection.cc:256] RPC call timeout handler was delayed by -1.7793224799999052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:10:51.360992 27380 leader_election.cc:336] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.650s (SENT)
W20260709 13:10:51.361263 27231 connection.cc:256] RPC call timeout handler was delayed by -1.4949642799999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:10:51.361440 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:51.349073 32346 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:51.324668 32354 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.318761 32418 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.355592 27263 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
W20260709 13:10:51.356287 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 48188.8us
W20260709 13:10:51.358850 28011 rpcz_store.cc:269] 0709 13:10:49.251153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.251431 (+   278us) service_pool.cc:224] Handling call
0709 13:10:51.346417 (+2094986us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002e45d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.346575 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065784192}
I20260709 13:10:51.365553 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:51.369395 27380 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.712s (SENT)
I20260709 13:10:51.369768 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:51.355612 32291 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:51.370781 32030 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.371133 32291 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.371618 32429 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:51.373201 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.714s (SENT)
I20260709 13:10:51.358989 32330 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.357780 32328 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:51.375552 27380 leader_election.cc:336] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.773s (SENT)
W20260709 13:10:51.365118 32441 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:10:51.377041 27383 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.378517 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:51.380210 32161 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.372454 32291 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.364763 32346 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:51.372473 31647 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:10:51.393121 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.369065 32237 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.380646 32161 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.377519 32330 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.382802 32397 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:51.376969 32030 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.383457 32410 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:51.392863 31647 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:51.400683 32397 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.422199 32397 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.425014 32280 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.399235 32161 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.434638 32418 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.436467 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.459867 27337 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:51.439489 27262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2669) took 1632 ms. Trace:
I20260709 13:10:51.431888 32220 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:51.406070 32330 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.443156 32397 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.464388 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 732) took 1053 ms. Trace:
I20260709 13:10:51.465446 27265 rpcz_store.cc:276] 0709 13:10:50.410851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.411061 (+   210us) service_pool.cc:224] Handling call
0709 13:10:51.203499 (+792438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.285950 (+ 82451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.464176 (+178226us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54000b81d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.464326 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1821647616}
I20260709 13:10:51.447081 32346 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:51.467783 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 88498.9us
I20260709 13:10:51.461015 27262 rpcz_store.cc:276] 0709 13:10:49.807460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.006710 (+199250us) service_pool.cc:224] Handling call
0709 13:10:50.007026 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:50.011216 (+  4190us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:10:50.035117 (+ 23901us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.011480 (+976363us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b1800348ee0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:51.260803 (+249323us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b1800348ee0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:10:51.366481 (+105678us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.367049 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.367244 (+   195us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:51.367291 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.367379 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.439259 (+ 71880us) raft_consensus.cc:1685] finished
0709 13:10:51.439283 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.439427 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6825,"prepare.queue_time_us":26868,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":9743,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":17715,"spinlock_wait_cycles":41739904,"thread_start_us":97988,"threads_started":1,"wal-append.queue_time_us":1399382}
I20260709 13:10:51.467320 32346 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.475708 27383 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.480474 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:51.481290 27383 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.481379 27416 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:51.482774 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.482232 27383 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.485952 32030 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:51.479285 32410 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:51.473886 32280 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:51.488147 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.488224 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.488610 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:51.488875 27414 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.488899 27409 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.489571 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.490154 27412 raft_consensus.cc:3060] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.490312 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:51.491665 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:51.497015 27231 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.694s (SENT)
I20260709 13:10:51.497078 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.497855 27411 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:51.498348 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:51.498549 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:51.499429 27409 raft_consensus.cc:2468] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:51.502604 32397 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:51.496842 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.508097 32449 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:51.508776 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:51.511688 32410 raft_consensus.cc:2804] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:51.488205 32444 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:10:51.512364 32348 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:51.512916 32348 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.513278 32348 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.517025 28010 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:51.510854 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.518122 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:51.522585 28015 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:51.521442 27412 raft_consensus.cc:2468] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:51.535606 27414 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:51.536862 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:51.541741 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:51.543335 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:51.545390 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:51.544970 32449 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:51.549194 32435 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:10:51.550165 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:51.549654 32449 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.553133 32161 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.550441 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:51.559501 28012 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 653) took 1668 ms (client timeout 1913 ms). Trace:
W20260709 13:10:51.559931 28012 rpcz_store.cc:269] 0709 13:10:49.891145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.900784 (+  9639us) service_pool.cc:224] Handling call
0709 13:10:51.559341 (+1658557us) spinlock_profiling.cc:243] Waited 1e+03 ms on lock 0x7b54006608d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.559443 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2299505536}
W20260709 13:10:51.571799 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73895us
I20260709 13:10:51.573047 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:51.573798 27231 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.168s (SENT)
I20260709 13:10:51.574667 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:51.566236 32408 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:51.580034 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69238us
I20260709 13:10:51.581030 27980 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.512382 32410 raft_consensus.cc:697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:51.523149 32331 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:51.594575 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 112423us
I20260709 13:10:51.507736 32283 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.576213 32418 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:51.604413 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:51.603461 27231 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.606604 27408 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:51.586457 32206 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:51.608692 27409 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.588176 32358 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.590500 32276 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.615430 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.590083 32369 raft_consensus.cc:2804] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:51.595886 32161 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:51.577456 32030 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:51.610271 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.626675 32283 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:51.637290 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 62729.9us
I20260709 13:10:51.669739 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:51.604586 32291 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:51.621126 32294 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.656971 32030 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.595381 32331 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.617129 32351 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:51.612877 32206 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.637014 32219 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.621681 32089 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:51.616921 32418 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.677191 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.677487 32350 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:51.683723 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.692083 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.684530 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 682898us
I20260709 13:10:51.636307 32369 raft_consensus.cc:697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:51.670976 32410 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.690094 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.693326 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.695363 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.697057 27414 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:51.683482 32155 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:51.701195 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.709110 27414 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:51.712673 27413 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:51.712968 27262 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:51.713306 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.713912 27265 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:51.688647 32206 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:51.716552 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.717300 32234 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:51.720018 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:51.721580 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 224814us
I20260709 13:10:51.722306 32437 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:51.688498 32089 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:51.733088 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.729591 27262 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:51.687741 32439 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.691409 32350 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:51.742357 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:51.694259 32323 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:51.783527 27413 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:51.796788 27265 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:51.807446 27415 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:10:51.804018 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 71344.1us
I20260709 13:10:51.810755 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.811371 27268 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:51.812282 27383 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Timed out: RequestConsensusVote RPC to 127.25.139.129:44339 timed out after 1.502s (SENT)
I20260709 13:10:51.812827 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.819237 27409 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:51.809682 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.822230 27383 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.823123 27268 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:51.739634 31807 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:51.730425 32234 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:51.824200 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:51.827695 27233 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.770385 32155 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:51.831808 27415 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:51.803890 32389 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:51.834990 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 102022us
I20260709 13:10:51.728945 32219 consensus_queue.cc:1059] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:10:51.796650 32346 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:10:51.846691 32451 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:10:51.847611 32359 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:51.851809 32347 raft_consensus.cc:3055] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:51.852929 31854 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:51.840777 32283 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:51.854060 32383 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.856359 27417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1965) took 1213 ms. Trace:
I20260709 13:10:51.887737 27417 rpcz_store.cc:276] 0709 13:10:50.642673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.696232 (+ 53559us) service_pool.cc:224] Handling call
0709 13:10:50.696574 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.347877 (+651303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.347910 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.347951 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.347990 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.856081 (+508091us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540036ae54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:51.856140 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:51.856293 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497414912}
I20260709 13:10:51.858460 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.861086 32209 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:51.861846 32249 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:51.862020 32237 consensus_queue.cc:1059] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:51.862828 32137 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:51.863303 32330 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.842660 32369 consensus_queue.cc:237] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.866099 32064 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:51.866307 32401 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:51.865554 32349 consensus_queue.cc:1059] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:10:51.867260 32411 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:51.785027 31647 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.826216 32294 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:51.862102 27306 leader_election.cc:400] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
W20260709 13:10:51.873284 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 291273us
I20260709 13:10:51.907747 32286 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:51.898823 27309 leader_election.cc:400] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
W20260709 13:10:51.900089 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 73952us
I20260709 13:10:51.830456 32030 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:10:51.907393 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.906268 31854 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:51.912767 32348 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.920058 32331 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.901454 32383 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.884757 32347 raft_consensus.cc:740] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:51.896705 32155 raft_consensus.cc:3055] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:51.929931 27408 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:51.933702 27306 leader_election.cc:403] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.934338 27980 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:51.825672 32328 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:10:51.869354 32389 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.936744 27309 leader_election.cc:403] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:51.969534 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:51.970291 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71751.9us
I20260709 13:10:51.971747 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:51.947516 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.931730 32359 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:51.937646 32294 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:51.992187 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 130268us
I20260709 13:10:51.954921 32348 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.955350 32349 consensus_queue.cc:1243] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:51.951901 32155 raft_consensus.cc:740] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:51.905326 32234 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.998677 28012 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:10:51.999130 32234 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:51.999058 32155 consensus_queue.cc:260] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.882855 32350 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.001108 32350 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:52.002388 28013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:51.944039 31647 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.003670 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:52.004491 28012 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:10:51.936472 32286 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.007421 32286 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.008930 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.991930 32359 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:51.996258 32137 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:51.959993 32330 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:51.945992 32186 consensus_queue.cc:1175] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 16 status { last_received { term: 15 index: 13 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:52.011080 32346 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:10:52.011390 32424 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:52.020572 32089 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.011760 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:51.926874 32064 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.011935 32396 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:52.023275 32348 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.965339 32437 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:51.967113 32283 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:52.023691 32064 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.972877 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.973274 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:52.042748 28010 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:51.973426 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.043467 27341 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:51.973870 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.044515 27338 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:51.974476 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.045620 27337 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:51.975312 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.046334 27335 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:51.975698 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:51.976176 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.973968 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:51.977309 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.047936 27336 raft_consensus.cc:2368] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16.
I20260709 13:10:51.977030 32347 consensus_queue.cc:260] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.978052 31854 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:51.978592 32383 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.944319 32140 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:51.979758 32280 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:51.981353 32206 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:51.983474 32389 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:51.946779 32351 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:51.939437 32436 raft_consensus.cc:3055] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:51.984802 28006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:51.985524 32418 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:51.968665 32151 raft_consensus.cc:2804] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:51.992627 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44522.6us
I20260709 13:10:51.953627 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:52.073521 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 119971us
I20260709 13:10:52.042325 32401 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:51.997658 32294 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.075029 32401 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.079807 32401 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:51.961213 27267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2667) took 2246 ms (client timeout 1502 ms). Trace:
I20260709 13:10:52.021027 32424 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.080868 32424 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:52.080770 27267 rpcz_store.cc:269] 0709 13:10:49.715154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.719332 (+  4178us) service_pool.cc:224] Handling call
0709 13:10:51.960972 (+2241640us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54003147d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:51.961109 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3668676480}
I20260709 13:10:52.081773 32424 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.082975 32424 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.085101 27411 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:52.086207 32348 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:51.963938 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:52.087620 28014 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:52.029811 28015 raft_consensus.cc:1240] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:52.030282 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58643.1us
I20260709 13:10:52.032403 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:52.089847 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 57615.9us
I20260709 13:10:52.036801 32137 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
I20260709 13:10:52.090332 32462 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:52.038756 28009 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:51.972476 27260 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.095427 32219 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:52.041141 27342 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:10:52.051072 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:52.099733 28008 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.100620 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:52.101225 27411 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.059754 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.103495 27338 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:52.104355 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.028937 32155 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:52.090937 32462 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:52.106352 32462 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.062991 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.070894 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.071643 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.107776 27334 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14. Re-sending same reply.
I20260709 13:10:52.108074 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.108728 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.109184 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.109714 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.110323 27334 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:52.109740 27335 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:52.112677 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.113682 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.114235 27335 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:52.111069 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.115023 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.119570 28008 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:52.120882 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.122145 27260 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:52.123059 27336 raft_consensus.cc:2368] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
W20260709 13:10:52.125219 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52508.6us
I20260709 13:10:52.058863 32140 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:52.228724 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 94974.6us
W20260709 13:10:52.230113 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.230652 27306 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:52.233167 27340 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:52.233650 27383 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:52.240049 32276 consensus_meta.cc:287] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:10:52.240510 32276 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.241860 32030 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.242468 32030 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:52.243608 32030 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.247268 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.247975 32294 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.249660 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.250630 32294 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:52.012216 32359 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.257310 32469 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:52.257805 32469 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:52.261852 32286 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.263309 27337 raft_consensus.cc:2368] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14.
I20260709 13:10:52.069276 32280 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:52.267999 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:52.124536 32347 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:52.268715 27410 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:52.273772 27231 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.757s (SENT)
W20260709 13:10:52.274209 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 142258us
W20260709 13:10:52.276373 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.248448 27336 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:52.270751 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.068537 32436 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:52.280319 27340 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:10:52.319685 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.324230 27263 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
W20260709 13:10:52.324319 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 183865us
W20260709 13:10:52.290133 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.327551 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:52.327759 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:52.229710 32396 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.336856 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:52.333527 27415 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:10:52.335865 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:52.372947 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.258699 32469 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.332340 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:52.423889 27410 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.425408 32469 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:52.428174 32450 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.712s	user 0.003s	sys 0.000s
I20260709 13:10:52.379930 31647 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:52.407051 27232 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.25.139.190:43657, user_credentials={real_user=slave}} blocked reactor thread for 65333.7us
W20260709 13:10:52.434574 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.410183 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.325392 32137 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.267359 32330 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:52.273479 32351 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:10:52.419385 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.444018 27336 raft_consensus.cc:2368] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16.
I20260709 13:10:52.270043 32437 consensus_queue.cc:1059] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.139s
I20260709 13:10:52.335603 32442 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:10:52.432009 27410 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:52.461804 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:52.429634 32435 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:10:52.445252 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.423486 32433 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:52.418339 32453 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:52.453215 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.482535 27337 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:52.455485 32460 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.529s	user 0.000s	sys 0.002s
I20260709 13:10:52.458913 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.269884 32151 raft_consensus.cc:697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:52.462404 27341 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:52.509023 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.510141 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:52.510144 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 188104us
I20260709 13:10:52.511731 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.464937 27340 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:52.468750 28010 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:52.325266 32283 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.479473 32206 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:52.433984 32280 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.381246 32396 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.506944 28007 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 733) took 1548 ms. Trace:
I20260709 13:10:52.521736 28007 rpcz_store.cc:276] 0709 13:10:50.958189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.970983 (+ 12794us) service_pool.cc:224] Handling call
0709 13:10:51.228109 (+257126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.494655 (+266546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.494687 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.495194 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.619028 (+123834us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.619069 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.619340 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:51.930088 (+310748us) raft_consensus.cc:1685] finished
0709 13:10:51.930118 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.475913 (+545795us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54004d49d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:52.506860 (+ 30947us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266076,"raft.queue_time_us":267294,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":589409152,"thread_start_us":123490,"threads_started":1,"wal-append.queue_time_us":175289}
I20260709 13:10:52.524256 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.524991 27341 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:52.515331 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.526793 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.527837 27336 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 11: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:52.531411 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:52.532001 27268 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.532126 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.533281 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.533969 27336 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:52.529222 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.535319 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.535805 27340 raft_consensus.cc:2376] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:52.534616 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:52.538108 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.544900 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.561354 27268 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:52.570101 27337 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:52.571331 27981 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:52.574201 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.574997 27336 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:52.579876 27411 raft_consensus.cc:2468] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:52.581674 27980 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:52.583745 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.507344 32137 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:52.587450 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 265407us
I20260709 13:10:52.583747 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:52.588454 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.521617 32249 raft_consensus.cc:3055] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:52.526867 32469 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.526230 32354 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.477644 32330 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.600754 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.603201 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.603890 27340 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:52.514158 32433 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.591718 32323 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:52.615190 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.612087 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2380) took 1014 ms. Trace:
W20260709 13:10:52.598063 32477 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:10:52.604395 32424 consensus_meta.cc:287] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:10:52.616148 27416 rpcz_store.cc:276] 0709 13:10:51.597233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.600672 (+  3439us) service_pool.cc:224] Handling call
0709 13:10:51.601056 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.601416 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.601440 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.601867 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.806657 (+204790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:51.806707 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.806788 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.454527 (+647739us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:52.607287 (+152760us) raft_consensus.cc:1685] finished
0709 13:10:52.607309 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.612011 (+  4702us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1632,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13652,"spinlock_wait_cycles":199446272,"thread_start_us":166220,"threads_started":1,"wal-append.queue_time_us":263683}
W20260709 13:10:52.626638 32475 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:10:52.594463 32249 raft_consensus.cc:740] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:52.631543 27338 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:52.607766 32469 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.641364 32469 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:52.648310 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.649195 27340 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:52.650241 27336 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:52.515980 32453 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.612493 32457 raft_consensus.cc:2804] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:52.655504 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.658286 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.661918 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.667987 27260 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:52.668632 32433 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:52.642165 32323 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:52.684497 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.685084 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.685535 27267 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [13.7-15.8]
I20260709 13:10:52.652220 32449 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:52.673944 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.690316 27260 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:52.605763 32354 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.671555 32483 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:52.693532 27260 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:52.694581 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.698498 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.699074 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.529170 32436 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.715575 27268 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:52.718261 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:52.696177 32350 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.003s
I20260709 13:10:52.725468 32488 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.726099 32488 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:52.726603 32488 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.700701 32469 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:52.731101 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.732790 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.734512 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:52.734892 32354 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:52.736080 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.699577 32249 consensus_queue.cc:260] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.736588 27261 raft_consensus.cc:1217] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-14.9]   Dedup: 12.8->[14.9-14.9]
I20260709 13:10:52.736857 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:52.737242 27261 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260709 13:10:52.685860 32404 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.014s	sys 0.041s
W20260709 13:10:52.737854 32404 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.014s	sys 0.042s
I20260709 13:10:52.739006 32404 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:52.739365 27259 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:10:52.739575 32404 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:52.725509 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.740908 27259 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:10:52.741645 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.741946 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:52.662824 32137 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.743500 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:52.744876 27264 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:52.746165 27264 raft_consensus.cc:1217] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[12.9-14.10]   Dedup: 12.9->[14.10-14.10]
I20260709 13:10:52.746778 27264 raft_consensus.cc:1240] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [12.9-14.10]
I20260709 13:10:52.696715 32449 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.749679 27262 raft_consensus.cc:1240] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:52.742842 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.751268 27340 raft_consensus.cc:2376] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11. Re-sending same reply.
I20260709 13:10:52.740253 32404 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:52.732477 32323 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.721904 27268 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:10:52.618685 32151 consensus_queue.cc:237] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.683212 32457 raft_consensus.cc:697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:52.700459 32424 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:52.737272 32249 raft_consensus.cc:3060] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:52.784901 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 188809us
I20260709 13:10:52.790737 27339 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:52.804293 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.805047 27340 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
W20260709 13:10:52.833796 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.805011 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:52.868454 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 170027us
I20260709 13:10:52.869472 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:52.870383 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.784330 32424 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:52.692167 32429 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:10:52.872128 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.877136 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:52.879122 27336 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:10:52.879631 27336 pending_rounds.cc:85] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:10:52.879956 27336 pending_rounds.cc:107] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:10:52.880368 27336 raft_consensus.cc:2889] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:52.880724 32464 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.934s	user 0.003s	sys 0.000s
I20260709 13:10:52.872678 27380 leader_election.cc:400] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16.
I20260709 13:10:52.882371 27380 leader_election.cc:403] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:52.883088 32209 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16.
I20260709 13:10:52.883666 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.884670 32209 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.887918 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.888844 27336 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:52.873530 32330 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:52.873003 32489 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:52.889806 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.874919 32429 consensus_queue.cc:1243] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:52.893060 27336 raft_consensus.cc:3055] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:52.896472 27336 raft_consensus.cc:740] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:52.897660 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.893846 27340 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:52.897487 27336 consensus_queue.cc:260] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.899829 27336 raft_consensus.cc:3060] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:52.900381 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.906150 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.890051 32209 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:52.909880 32449 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:52.899923 32030 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:52.905577 32330 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:10:52.919375 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.935940 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59104 (request call id 2686) took 1219 ms. Trace:
I20260709 13:10:52.914040 27336 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:10:52.926801 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.936503 27263 rpcz_store.cc:276] 0709 13:10:51.716182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.719688 (+  3506us) service_pool.cc:224] Handling call
0709 13:10:52.935714 (+1216026us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54001f77d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:52.935865 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1361297792}
I20260709 13:10:52.933332 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:52.921620 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.886754 32457 consensus_queue.cc:237] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:52.938709 27335 raft_consensus.cc:2376] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15. Re-sending same reply.
I20260709 13:10:52.939673 28015 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:52.934384 32493 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.940760 32442 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:52.911695 32489 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:52.955298 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:52.912832 32453 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:52.975528 28015 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:52.953081 32330 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:52.955615 32489 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:52.967460 32449 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:52.971482 32209 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:52.974027 32453 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:52.981611 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:52.995760 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:52.985852 32489 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:52.998243 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.000658 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:52.981647 32433 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:10:52.982393 32291 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:10:53.001855 27411 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:53.003795 27416 raft_consensus.cc:1240] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:53.004338 28009 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:53.006680 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:53.000696 32234 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 1.001s	user 0.008s	sys 0.005s
W20260709 13:10:53.007447 32498 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:52.999022 32209 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:53.011358 32330 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.011757 32206 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:52.991799 32453 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.016546 28011 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:53.007580 32497 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:10:53.024204 28015 raft_consensus.cc:1240] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:53.028604 27334 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:52.990967 32449 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:52.998253 32424 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.044183 32350 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.044884 32350 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.046015 32291 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:10:53.046169 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.046595 32291 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:53.047578 32291 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.049669 32449 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.049355 32291 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.065016 32404 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.028240 32402 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:10:53.054780 32430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.000s	sys 0.015s
W20260709 13:10:53.067883 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 62347us
I20260709 13:10:53.032516 32030 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:53.066382 32470 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.741s	user 0.000s	sys 0.003s
I20260709 13:10:53.028622 32488 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:53.085285 32430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.000s	sys 0.015s
I20260709 13:10:53.059638 32350 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.038110 32234 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:53.090993 28014 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.105392 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2697) took 1079 ms. Trace:
I20260709 13:10:53.094501 32504 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:53.106292 32504 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.105844 27265 rpcz_store.cc:276] 0709 13:10:52.026042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.026210 (+   168us) service_pool.cc:224] Handling call
0709 13:10:52.026608 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.027009 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.027053 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.027646 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.925416 (+897770us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b180037ebe0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1 00007fbd82beca0f
0709 13:10:53.025642 (+100226us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:53.025712 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.025895 (+   183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.105075 (+ 79180us) raft_consensus.cc:1685] finished
0709 13:10:53.105133 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.105332 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12403,"spinlock_wait_cycles":2837376,"thread_start_us":99988,"threads_started":1,"wal-append.queue_time_us":1039777}
I20260709 13:10:53.108906 32504 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:53.109483 27231 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.783s (SENT)
I20260709 13:10:53.110023 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:53.094529 32494 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
I20260709 13:10:53.095973 32404 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.097086 32488 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:53.103780 32501 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:53.112676 28011 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.092006 32402 consensus_queue.cc:1243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:10:53.119151 32429 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.118723 32351 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.119532 32209 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:53.137372 32402 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.153360 32047 raft_consensus.cc:3055] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:53.173002 32047 raft_consensus.cc:740] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.173997 32047 consensus_queue.cc:260] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.175372 32396 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.176429 32402 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.177217 31647 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:53.177654 31647 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:53.153460 32493 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:53.157788 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.179796 32186 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:53.180253 32186 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:53.180338 32047 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.161865 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.182596 27337 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:53.132560 32455 consensus_queue.cc:1059] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:10:53.162720 28012 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:53.132733 32350 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:10:53.167764 32453 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.185503 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:53.188262 28011 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:53.188359 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2646) took 1215 ms. Trace:
I20260709 13:10:53.188087 32209 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.188831 27339 rpcz_store.cc:276] 0709 13:10:51.972541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.972667 (+   126us) service_pool.cc:224] Handling call
0709 13:10:53.188170 (+1215503us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54002887d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:53.188293 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622644096}
I20260709 13:10:53.193920 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2660) took 1208 ms. Trace:
I20260709 13:10:53.194423 27338 rpcz_store.cc:276] 0709 13:10:51.985403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.104117 (+118714us) service_pool.cc:224] Handling call
0709 13:10:53.193755 (+1089638us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54000514d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:53.193864 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210859392}
I20260709 13:10:53.190029 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:53.157969 32089 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.145526 32351 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.196322 32142 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:53.196774 32142 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.197158 32142 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.197939 32351 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:53.198866 32465 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.277s	user 0.005s	sys 0.000s
I20260709 13:10:53.191187 32064 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.203303 32064 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.203685 32489 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.205662 32064 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:53.206048 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.206379 32489 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:53.206918 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.221014 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.221765 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.178934 32402 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.209435 32286 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.210225 27411 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.211136 27410 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.211540 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2666) took 1084 ms. Trace:
I20260709 13:10:53.234730 27334 rpcz_store.cc:276] 0709 13:10:52.127117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.234043 (+106926us) service_pool.cc:224] Handling call
0709 13:10:53.211340 (+977297us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54000e1d54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:53.211464 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795157376}
I20260709 13:10:53.213390 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.213732 27417 raft_consensus.cc:1240] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:53.214089 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.237202 27409 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:53.178558 31647 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.236065 27416 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:53.221017 32408 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:53.253095 27337 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:53.232698 31807 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:10:53.262151 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:53.262845 32234 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:53.265183 32436 raft_consensus.cc:3060] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.265558 32286 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:53.266350 27233 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:53.269485 27265 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:53.283519 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:53.270746 27259 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:53.271539 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.276456 27978 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:53.277034 27268 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.278277 27264 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:53.275888 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.291653 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.293458 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:53.273079 31647 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.296049 27308 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:53.241217 32346 consensus_queue.cc:1059] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:53.297977 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:53.300595 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.301183 27416 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:53.296130 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.241456 32398 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:10:53.308007 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.306819 27416 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:53.310385 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:10:53.310552 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 161174us
I20260709 13:10:53.311033 27411 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:53.297245 32354 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:53.313022 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.275789 32408 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.299809 32401 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:53.297387 32357 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:53.303128 32137 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:53.305305 32347 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:53.304162 32286 consensus_queue.cc:1243] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:53.305526 32449 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:53.340433 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.341135 27339 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.342108 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.349385 27413 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:53.350832 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.315974 32209 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:53.329850 27415 raft_consensus.cc:1240] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:53.329926 32347 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:53.317868 32249 raft_consensus.cc:3055] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:53.330993 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.449298 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.332077 32349 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:53.332312 27411 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:53.332733 32357 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:53.334847 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.336663 32354 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
W20260709 13:10:53.337325 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.337598 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.457863 27336 raft_consensus.cc:2368] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:53.458461 27411 raft_consensus.cc:1275] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:53.458808 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.459491 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:53.460281 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.332862 32142 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.461024 27336 raft_consensus.cc:2410] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:10:53.338361 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.337318 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.338934 27412 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:53.461822 27335 raft_consensus.cc:2410] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:53.339562 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.355310 27263 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:53.463340 27337 raft_consensus.cc:2393] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:53.463414 27412 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:53.359428 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:53.362527 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:53.390537 32186 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:53.466663 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.446704 32275 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:53.409770 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:10:53.396956 32515 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:53.411679 32457 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.326503 31807 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:53.475660 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.391100 27383 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:53.357856 32449 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.389024 32408 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.397754 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.376047 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.395684 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.479496 27334 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:53.479558 27264 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:10:53.389572 27231 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.915s (SENT)
W20260709 13:10:53.473595 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 63915.7us
W20260709 13:10:53.480667 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 91126.4us
W20260709 13:10:53.481287 27231 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.915s (SENT)
I20260709 13:10:53.481801 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:53.481803 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.399407 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:53.483249 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 92225.9us
I20260709 13:10:53.483530 27259 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:53.391952 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:53.406982 27268 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:53.417107 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.485438 27340 raft_consensus.cc:2410] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:10:53.489090 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.318539 32401 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:53.443907 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 75795.4us
I20260709 13:10:53.445398 27339 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:53.495687 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.496822 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.497244 32064 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.497843 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.498081 32430 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.498546 32430 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.326135 32137 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.500237 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.454522 32047 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:10:53.461954 27411 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:53.472707 32286 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:53.464689 27416 raft_consensus.cc:2410] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:53.510237 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.510813 27334 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.447772 32209 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.448376 32347 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.470889 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:53.518072 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.471779 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.455785 32234 consensus_queue.cc:1243] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:53.448585 32249 raft_consensus.cc:740] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.499873 32481 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.476382 27337 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:10:53.454618 32349 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.484550 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:53.503427 32524 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:53.501632 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.540131 27340 raft_consensus.cc:2410] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:10:53.541167 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.455470 27414 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:53.503855 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:53.498940 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:53.412842 32486 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.542s	user 0.004s	sys 0.000s
I20260709 13:10:53.476058 31807 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.519359 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.500700 32328 raft_consensus.cc:2764] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:10:53.518173 27335 raft_consensus.cc:2376] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12. Re-sending same reply.
I20260709 13:10:53.499385 32137 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.472774 32276 consensus_queue.cc:1048] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:10:53.470757 32206 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:10:53.475591 27342 raft_consensus.cc:2368] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:53.473315 32275 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:53.399528 32512 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:10:53.534642 27334 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:53.543136 27339 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:53.544831 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.482482 32457 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.511885 32030 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:10:53.523738 32047 consensus_queue.cc:1243] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:10:53.598762 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 94971.1us
I20260709 13:10:53.604902 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.600299 27337 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.606629 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.512301 32280 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:53.609783 32468 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:53.610458 32468 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.601454 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.612564 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.613059 32468 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:53.616928 32526 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:10:53.607344 27336 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:53.613328 27339 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.619661 32349 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.621268 32349 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:53.623687 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.624361 32209 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.624774 27336 raft_consensus.cc:2393] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:53.625020 32249 consensus_queue.cc:260] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.625962 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.626263 32249 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.627084 32449 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.628960 32142 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.539640 32481 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.641970 32481 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.540050 32286 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:53.634665 27337 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:53.643376 32286 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.540405 32369 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:53.643843 32286 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.643981 32369 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.644228 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.645869 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.646256 32369 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.647356 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.648305 27337 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.653378 32402 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:53.653841 32402 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.660435 27337 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:53.661079 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:53.661876 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.663002 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:53.603652 32330 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:53.524559 32354 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.541352 32401 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.525645 32357 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.599486 32524 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.684015 32430 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.654665 32402 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.674925 32455 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:10:53.696820 32396 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:53.697288 32396 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:53.698114 32396 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.700932 32396 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:53.744872 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.787762 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.745035 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.745344 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.746986 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 262315us
I20260709 13:10:53.701489 32402 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:53.702353 32524 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.755996 31807 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:53.791472 32433 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:53.765632 32275 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.682145 32511 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:10:53.792821 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.792670 32433 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.799849 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.782125 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:53.760445 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:53.805661 27335 raft_consensus.cc:2368] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15.
I20260709 13:10:53.806322 32457 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:53.701799 32401 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:53.806882 27267 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:53.811857 28015 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:53.814245 32436 consensus_meta.cc:287] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 13:10:53.815649 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:53.816751 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.819490 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 305450us
W20260709 13:10:53.822275 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.822933 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.840830 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.842155 27342 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
W20260709 13:10:53.847325 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.847579 27267 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:10:53.848649 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.849535 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 50684.3us
I20260709 13:10:53.851774 32532 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:53.856786 32219 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.857594 32219 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.850761 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:53.838407 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48531.4us
I20260709 13:10:53.870610 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:53.871788 32398 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.871963 32506 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:53.872586 32506 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:53.872886 32398 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.874024 32506 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.902065 32455 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:53.902940 32455 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:53.907408 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 57740.8us
I20260709 13:10:53.907711 32398 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.911810 27341 raft_consensus.cc:2468] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:53.913069 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.892617 32457 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:53.914434 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.918926 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:53.919987 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.923394 32531 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:53.925604 32433 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.926930 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:53.927584 32219 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.927834 28015 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.930318 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:53.930593 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 148953us
I20260709 13:10:53.931036 32328 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:53.931228 27263 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:10:53.931728 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:53.932103 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:53.932590 32455 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:53.933125 27268 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:53.933295 32455 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:53.933714 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:53.934422 32511 consensus_queue.cc:1243] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:53.936664 32354 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:53.926868 27411 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:53.920008 27259 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:53.938279 32354 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:10:53.962019 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:53.916497 32457 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:53.905429 32140 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:53.956956 32506 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:53.974807 32457 raft_consensus.cc:3060] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:53.975688 31647 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:53.995008 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:53.997414 27231 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.707s (SENT)
I20260709 13:10:54.009701 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:54.010866 32530 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:54.011270 32104 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.017223 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:54.019773 32469 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:54.021474 32469 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:54.021981 32469 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:54.024164 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.025157 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1821) took 1297 ms. Trace:
I20260709 13:10:54.025626 27261 rpcz_store.cc:276] 0709 13:10:52.727735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.728159 (+   424us) service_pool.cc:224] Handling call
0709 13:10:52.736399 (+  8240us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:52.737683 (+  1284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.024683 (+1287000us) spinlock_profiling.cc:243] Waited 7.87 ms on lock 0x7b54000d6950. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.024959 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18112384}
I20260709 13:10:54.031013 32104 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:54.031600 32104 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:54.032099 32104 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.032688 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.034053 31807 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:54.039069 27981 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:54.040464 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 661) took 2016 ms. Trace:
I20260709 13:10:54.005654 32442 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:54.040835 32219 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:54.041531 32219 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.042089 32219 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.042825 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56236 (request call id 1984) took 1046 ms. Trace:
I20260709 13:10:54.043277 27415 rpcz_store.cc:276] 0709 13:10:52.995879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.996016 (+   137us) service_pool.cc:224] Handling call
0709 13:10:53.005321 (+  9305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.443607 (+438286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.042328 (+598721us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003c1254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:54.042623 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":741333760}
I20260709 13:10:54.002434 31647 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:54.046689 31647 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.040518 27260 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:54.048527 32178 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:54.049291 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:54.050367 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.050905 32178 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:54.040995 28012 rpcz_store.cc:276] 0709 13:10:52.024386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.025270 (+   884us) service_pool.cc:224] Handling call
0709 13:10:52.029911 (+  4641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.184939 (+1155028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.039987 (+855048us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540043bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:54.040279 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604735872}
I20260709 13:10:54.048581 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.053241 27408 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:54.053709 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.053750 27341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2684) took 1782 ms (client timeout 1952 ms). Trace:
I20260709 13:10:54.054821 32511 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.055451 32511 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:10:54.055339 27341 rpcz_store.cc:269] 0709 13:10:52.271743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.544654 (+272911us) service_pool.cc:224] Handling call
0709 13:10:54.053483 (+1508829us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540013f454. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.053637 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919512832}
I20260709 13:10:54.056689 32442 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.056890 32511 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.057497 27341 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:10:54.053180 32275 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:54.059430 32275 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:54.059998 32359 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.060952 32089 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.060833 32275 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.061836 32089 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.065686 27334 raft_consensus.cc:2410] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:10:54.071506 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:54.088081 28015 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
W20260709 13:10:54.096168 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 120807us
I20260709 13:10:54.053153 32286 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:54.101608 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52583.6us
I20260709 13:10:54.092911 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.102854 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:54.109747 27408 raft_consensus.cc:2410] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:10:54.111443 32206 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.112221 32206 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.114447 32328 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:54.114790 32206 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.119628 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:54.127854 32275 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.129650 27341 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:54.132134 27334 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:54.132038 32449 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:54.138065 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.105708 31647 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:54.143759 27339 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.009s
I20260709 13:10:54.128216 32330 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.144356 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:54.150405 32418 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.150739 32433 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:54.151271 27259 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:54.151201 32418 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.153540 27342 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:54.155252 32520 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:54.155514 27342 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:54.155874 32520 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:54.157250 32540 consensus_queue.cc:1059] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:54.157425 32520 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.158308 32540 consensus_queue.cc:1243] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:54.162556 32357 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:10:54.173256 32140 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.173996 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:54.151286 32433 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.178289 32433 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.173400 32439 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:54.185539 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.159623 27339 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:54.186077 27341 raft_consensus.cc:1275] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:54.184845 32186 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.159062 32520 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:54.200937 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 350444us
W20260709 13:10:54.201858 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.212615 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 134321us
I20260709 13:10:54.186616 32439 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:54.220975 32504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.047s
W20260709 13:10:54.221462 32504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.013s	sys 0.048s
I20260709 13:10:54.221557 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:54.222110 32504 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.222384 27410 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.223059 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.191576 32286 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:53.732259 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:54.250259 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.251384 32402 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:54.257838 32532 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:54.258409 32532 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.258857 32532 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.259832 32186 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.260396 32430 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:54.260411 32186 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.261643 32430 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.222700 32504 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.250713 27339 raft_consensus.cc:1217] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[9.5-13.7]   Dedup: 9.5->[11.6-13.7]
I20260709 13:10:54.268301 27339 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [9.5-13.7]
W20260709 13:10:54.275123 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 256047us
W20260709 13:10:54.282882 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.282956 32186 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.283452 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:54.284754 32347 consensus_meta.cc:287] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.757s	user 0.015s	sys 0.005s
I20260709 13:10:54.285317 32347 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.286527 27342 raft_consensus.cc:1240] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:54.287953 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.291972 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60614.5us
I20260709 13:10:54.097754 32469 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.289285 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.295612 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.291113 32511 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:54.322304 32286 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.322937 27268 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:54.370110 32286 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.373273 32286 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:54.326154 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.374274 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.376585 32137 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.007s
I20260709 13:10:54.377059 32137 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.378413 27337 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:54.340976 32402 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.379107 32402 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.381260 32402 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:54.345019 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.351531 27341 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:54.383352 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.384029 27341 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:54.356807 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.291435 32219 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:54.363385 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.366258 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.366866 32439 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.367735 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.389003 27410 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:10:54.391088 27343 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:54.391287 27260 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:10:54.392956 32430 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.412020 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.412135 27260 pending_rounds.cc:85] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:10:54.405136 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.415083 27339 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:10:54.421168 28015 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 19: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:54.293542 32442 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.414505 27260 pending_rounds.cc:107] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 12.8
W20260709 13:10:54.427937 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.415660 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.404186 32418 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.428403 27260 raft_consensus.cc:2889] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:54.439515 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.440320 27231 leader_election.cc:336] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.830s (SENT)
I20260709 13:10:54.440376 32524 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.441358 27263 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:54.441793 27231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.892s (SENT) [suppressed 49 similar messages]
I20260709 13:10:54.441598 32524 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:54.443123 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.437460 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:54.455574 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.459257 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.471403 27231 leader_election.cc:336] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.913s (SENT)
W20260709 13:10:54.474284 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.415349 32286 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:10:54.477661 32396 consensus_meta.cc:287] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.690s	user 0.014s	sys 0.000s
I20260709 13:10:54.477913 32219 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:54.478972 32359 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.479622 32439 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:54.483016 32504 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:54.454319 32449 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.494352 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:54.498004 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45344.8us
I20260709 13:10:54.491377 32469 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:54.503400 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 188197us
W20260709 13:10:54.526765 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 136811us
W20260709 13:10:54.533986 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.523276 32506 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.531s	user 0.004s	sys 0.008s
W20260709 13:10:54.541563 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.547525 32137 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:54.547783 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 131256us
I20260709 13:10:54.548282 32219 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.548746 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.548923 32275 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.549212 32219 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.549623 32275 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.549793 32219 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.551959 32275 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.552583 32396 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:54.548554 32349 consensus_meta.cc:287] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.927s	user 0.018s	sys 0.006s
I20260709 13:10:54.465739 32524 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.560846 32142 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:54.555881 32535 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:10:54.563274 32220 consensus_queue.cc:1048] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:54.567768 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:54.572259 32551 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:54.605945 27159 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 13, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:54.588500 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2460) took 1198 ms. Trace:
I20260709 13:10:54.539677 32347 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.590504 32186 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:54.591032 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2462) took 1200 ms. Trace:
W20260709 13:10:54.598357 32249 consensus_meta.cc:287] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.011s
I20260709 13:10:54.598644 27336 raft_consensus.cc:2410] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:10:54.600029 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2465) took 1207 ms. Trace:
W20260709 13:10:54.600919 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.562709 27338 raft_consensus.cc:2410] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:10:54.604214 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53098us
I20260709 13:10:54.607376 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.602313 31807 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:54.608392 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.609319 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.611230 32219 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:54.613551 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.617187 32524 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.617475 32142 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:54.574052 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.524396 32104 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:54.589512 27231 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.063s (SENT)
W20260709 13:10:54.621906 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54236.4us
I20260709 13:10:54.622556 32369 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:54.560235 32089 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.626405 32283 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:54.620934 27337 rpcz_store.cc:276] 0709 13:10:53.390064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.661576 (+271512us) service_pool.cc:224] Handling call
0709 13:10:54.588198 (+926622us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54002d9e54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.588416 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645153664}
I20260709 13:10:54.631145 27341 rpcz_store.cc:276] 0709 13:10:53.392619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.433083 (+1040464us) service_pool.cc:224] Handling call
0709 13:10:54.485604 (+ 52521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.558523 (+ 72919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.558559 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.599658 (+ 41099us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.599726 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.599814 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.599962 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6553,"raft.queue_time_us":7938,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131}
I20260709 13:10:54.629890 27339 rpcz_store.cc:276] 0709 13:10:53.391650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.438879 (+1047229us) service_pool.cc:224] Handling call
0709 13:10:54.524204 (+ 85325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.590620 (+ 66416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.590660 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.590711 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:54.590752 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.590828 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.590966 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:54.639259 27343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52492 (request call id 2645) took 2667 ms (client timeout 1908 ms). Trace:
I20260709 13:10:54.639649 32449 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:54.639846 32186 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.633216 28014 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:54.641004 32506 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:54.643960 28009 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
W20260709 13:10:54.647296 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.660104 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.661321 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2422) took 1327 ms. Trace:
W20260709 13:10:54.654220 27343 rpcz_store.cc:269] 0709 13:10:51.972130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.973740 (+  1610us) service_pool.cc:224] Handling call
0709 13:10:54.638999 (+2665259us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b54001680d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.639150 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5323802496}
I20260709 13:10:54.652215 27335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2454) took 1284 ms. Trace:
I20260709 13:10:54.668550 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52486 (request call id 2456) took 1304 ms. Trace:
I20260709 13:10:54.665771 27338 rpcz_store.cc:276] 0709 13:10:53.334173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.337093 (+  2920us) service_pool.cc:224] Handling call
0709 13:10:54.652374 (+1315281us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540025c6d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.661267 (+  8893us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529871744}
I20260709 13:10:54.651639 32369 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.679704 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:54.680568 27343 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.677757 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:54.682870 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.669015 27342 rpcz_store.cc:276] 0709 13:10:53.364194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.156605 (+792411us) service_pool.cc:224] Handling call
0709 13:10:54.157074 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.287031 (+129957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.668328 (+381297us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540025b7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:54.668494 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297174912}
I20260709 13:10:54.681993 32369 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:54.685385 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 95939.6us
W20260709 13:10:54.686163 27231 leader_election.cc:336] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.203s (SENT)
I20260709 13:10:54.686535 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.687657 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.688616 32104 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:54.689218 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:54.689637 27337 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:54.690305 27337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2713) took 1291 ms. Trace:
I20260709 13:10:54.690619 27337 rpcz_store.cc:276] 0709 13:10:53.407756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.688748 (+1280992us) service_pool.cc:224] Handling call
0709 13:10:54.689218 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.690049 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.690253 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.691262 32401 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.691727 32401 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.693169 32560 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.693320 27159 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 12, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 12 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:10:54.694289 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.695255 27338 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:54.697046 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 762) took 1187 ms. Trace:
I20260709 13:10:54.697444 27338 rpcz_store.cc:276] 0709 13:10:53.509751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.695981 (+1186230us) service_pool.cc:224] Handling call
0709 13:10:54.696373 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.696674 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.696708 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:54.696770 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:54.696829 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.696884 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.696996 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.699257 32089 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:54.699990 32089 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.675124 32347 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:54.702649 32249 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.702893 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:54.703317 32249 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:54.687764 27231 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 2.244s (SENT)
I20260709 13:10:54.693336 27339 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:54.705719 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2709) took 1307 ms. Trace:
I20260709 13:10:54.706102 27339 rpcz_store.cc:276] 0709 13:10:53.398195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.659537 (+1261342us) service_pool.cc:224] Handling call
0709 13:10:54.693005 (+ 33468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.705422 (+ 12417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.705657 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.711895 27338 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:54.711943 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.717423 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.667769 27335 rpcz_store.cc:276] 0709 13:10:53.362782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.155845 (+793063us) service_pool.cc:224] Handling call
0709 13:10:54.156342 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.159726 (+  3384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.159884 (+   158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.184485 (+ 24601us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.427970 (+243485us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:54.646392 (+218422us) log.cc:844] Serialized 14 byte log entry
0709 13:10:54.646944 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.647019 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:54.647063 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:54.647078 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.647226 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":616,"raft.queue_time_us":1357,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":1472,"thread_start_us":400755,"threads_started":2,"wal-append.queue_time_us":265502}
I20260709 13:10:54.722939 27338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 763) took 1151 ms. Trace:
I20260709 13:10:54.723388 27338 rpcz_store.cc:276] 0709 13:10:53.564804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.698491 (+1133687us) service_pool.cc:224] Handling call
0709 13:10:54.698916 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.712362 (+ 13446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.716425 (+  4063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.730376 32560 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.731066 32560 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.731448 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:54.732124 27411 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.733419 32560 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.733698 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.736886 27338 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:54.737534 32346 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.738022 32346 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.736824 32401 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.740103 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2445) took 1385 ms. Trace:
I20260709 13:10:54.740216 32346 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.740506 27336 rpcz_store.cc:276] 0709 13:10:53.354811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.625640 (+270829us) service_pool.cc:224] Handling call
0709 13:10:54.739861 (+1114221us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b540020ab54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.740049 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234064768}
W20260709 13:10:54.742014 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.695092 27159 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.722440 27337 raft_consensus.cc:1275] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:10:54.746439 27337 pending_rounds.cc:85] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 12
I20260709 13:10:54.746798 27337 pending_rounds.cc:107] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:10:54.747107 27337 raft_consensus.cc:2889] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:54.756222 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 98605.5us
W20260709 13:10:54.756750 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.704523 32089 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.722136 32524 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:54.768906 27334 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:54.662091 31807 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.774137 27416 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:54.776230 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:54.776559 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 333527us
I20260709 13:10:54.776923 27413 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:54.777431 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:54.747949 31647 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:54.782446 27342 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:54.788345 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 100614us
I20260709 13:10:54.789898 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:54.792840 27342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2712) took 1393 ms. Trace:
I20260709 13:10:54.793262 27342 rpcz_store.cc:276] 0709 13:10:53.398979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.684536 (+1285557us) service_pool.cc:224] Handling call
0709 13:10:54.781968 (+ 97432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.792562 (+ 10594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.792782 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:54.794528 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.795023 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:54.795610 27263 raft_consensus.cc:3060] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:54.791932 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:54.777907 32142 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.798496 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.799199 27417 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:54.799857 27340 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:54.800303 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:54.800416 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.797726 27336 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:10:54.803330 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:54.804266 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.804217 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:54.816504 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.780546 32524 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:54.816151 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:54.821391 32323 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:54.825748 32506 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:54.827389 32511 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:54.831779 32555 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:54.831600 27159 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.832504 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 761) took 1472 ms. Trace:
I20260709 13:10:54.833279 32555 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:54.833792 32555 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.834151 32555 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.833536 27159 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 15 to 18, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 18 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:54.834767 27340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2451) took 1472 ms. Trace:
I20260709 13:10:54.835280 27340 rpcz_store.cc:276] 0709 13:10:53.361907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.540872 (+178965us) service_pool.cc:224] Handling call
0709 13:10:54.834485 (+1293613us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000e2754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.834698 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533128576}
W20260709 13:10:54.840863 32457 consensus_meta.cc:287] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.007s
I20260709 13:10:54.833055 27334 rpcz_store.cc:276] 0709 13:10:53.360030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.133356 (+773326us) service_pool.cc:224] Handling call
0709 13:10:54.742184 (+608828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.769484 (+ 27300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.832212 (+ 62728us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540020ab50. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:54.832406 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110249216}
I20260709 13:10:54.841367 32457 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.844048 31807 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:54.806941 32548 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:54.848096 32548 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.848464 32548 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:54.853554 32457 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:54.854802 32186 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:54.857964 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48546.3us
I20260709 13:10:54.856364 32249 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:54.861379 27343 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
I20260709 13:10:54.806453 31854 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:10:54.808909 32520 consensus_meta.cc:287] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.589s	user 0.013s	sys 0.000s
W20260709 13:10:54.871647 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:54.869284 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.808249 32347 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:10:54.813241 32433 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.000s
W20260709 13:10:54.857391 32532 consensus_meta.cc:287] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.003s
I20260709 13:10:54.873433 32347 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.877978 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.802556 32283 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:10:54.884994 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:54.885063 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:54.891105 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.891112 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.894903 27380 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.868335 31854 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:54.897558 27231 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.511s (SENT)
I20260709 13:10:54.902309 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:54.906353 27411 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:54.884709 32347 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:54.878983 32506 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:54.889021 32249 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.893848 32286 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.893848 31807 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:54.902323 31854 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:54.921233 32358 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:54.924571 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:54.925177 31647 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:54.925653 32520 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.925824 32442 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.926422 32504 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:54.881503 32433 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.887109 32532 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.940222 27263 raft_consensus.cc:2468] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
W20260709 13:10:54.951666 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54144.7us
W20260709 13:10:54.964949 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 94568.4us
I20260709 13:10:54.929376 32206 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:54.936852 32186 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:54.917303 32506 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.918478 32249 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.985864 28012 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 14. Ops: []
I20260709 13:10:54.982250 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.931806 32369 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:54.987556 27231 leader_election.cc:336] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Timed out: RequestConsensusVote RPC to 127.25.139.130:35457 timed out after 1.542s (SENT)
I20260709 13:10:54.990913 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:54.940328 32520 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.951156 32442 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.949987 32358 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.978392 31647 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.995795 32504 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:55.014568 32562 log.cc:927] Time spent T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:55.019266 32563 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:10:55.021749 32442 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.022426 32547 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:55.032445 32552 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.264s	user 0.005s	sys 0.000s
I20260709 13:10:55.032171 32548 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:54.980347 32206 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:55.057277 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.973132 32524 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:54.990409 32412 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.194s
I20260709 13:10:55.086985 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:55.072118 32504 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:10:55.091917 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 202510us
I20260709 13:10:55.097056 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:55.098695 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 120029us
I20260709 13:10:55.105824 27978 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:55.138118 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.097663 32504 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:55.220746 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 247741us
I20260709 13:10:55.107753 32449 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:55.228740 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.231820 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.232488 27335 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:55.112902 32556 consensus_queue.cc:1048] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 13:10:55.237884 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.123329 32347 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.241935 31647 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.109827 32555 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:55.240367 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151768us
I20260709 13:10:55.199417 32249 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.221778 32433 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:55.235270 32543 log.cc:927] Time spent T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.130s	user 0.003s	sys 0.004s
I20260709 13:10:55.228183 32220 raft_consensus.cc:2804] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:55.250344 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:55.254379 28007 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:10:55.262701 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.263370 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.260910 32506 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:55.267720 28015 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:55.268838 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.269487 27340 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.276639 32347 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.272671 27335 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:55.282492 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:55.283489 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:55.284006 27340 raft_consensus.cc:2410] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:10:55.248966 32369 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.236979 32283 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:10:55.321849 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.293764 32433 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:55.300352 32555 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.305473 32220 raft_consensus.cc:697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:55.306002 32532 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:10:55.306854 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 81872.8us
W20260709 13:10:55.330792 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 87437.7us
I20260709 13:10:55.310755 32346 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.310881 32412 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:55.311689 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.312512 27339 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:55.312565 32347 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.319077 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.337782 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.338364 27268 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.338585 31647 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.321822 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.335208 27338 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:55.337065 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.339099 31647 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.343058 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:55.343964 27411 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.343853 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:55.424913 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.380750 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.347818 32347 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.363684 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.399135 31647 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.376071 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.380887 32206 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.333911 32520 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:55.365327 32405 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.382696 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:55.361977 32569 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:55.380033 32511 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:55.373293 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 111506us
I20260709 13:10:55.393707 27336 raft_consensus.cc:2468] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:55.347512 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.337272 32506 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:55.335187 32439 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.448446 27978 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:55.457297 27411 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:55.364205 32401 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.328112 32433 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:55.363608 32140 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.345531 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.473155 27335 raft_consensus.cc:2410] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:10:55.372383 32548 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:55.376856 32358 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.361774 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.345602 27259 raft_consensus.cc:2393] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 19: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:55.347314 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.508471 27260 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:55.365803 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.507728 32580 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.383796 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.362267 32346 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.383831 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.348333 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.361212 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.516342 27339 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:55.377447 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.441548 27265 raft_consensus.cc:2410] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:55.442385 27264 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:10:55.446509 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 99083.8us
I20260709 13:10:55.426755 32560 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.448541 32249 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.474406 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:55.474912 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.363065 32412 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:55.471350 32206 raft_consensus.cc:2804] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:55.522308 27338 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:55.473781 32433 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:55.470052 27159 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 10, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 10 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:10:55.514322 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 130654us
I20260709 13:10:55.464697 32511 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:55.520259 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 183476us
I20260709 13:10:55.510378 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.471376 32439 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.530872 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:55.531813 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:55.530761 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 184870us
I20260709 13:10:55.532636 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.470350 32220 consensus_queue.cc:237] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.446408 32405 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.534083 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.534181 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.534195 27335 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:55.538455 27338 raft_consensus.cc:2376] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15. Re-sending same reply.
I20260709 13:10:55.535610 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:55.516515 32219 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.512614 32520 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:55.545555 27340 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:55.539549 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.534708 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:55.471736 32401 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.540720 27411 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.500510 32140 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.472630 32569 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.544669 27308 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:55.549962 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.547684 27413 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:55.548717 32286 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:55.552637 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.530350 31807 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.558794 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.533988 32206 raft_consensus.cc:697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:55.555363 27341 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:55.555521 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.562752 27259 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:55.559792 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:55.549535 31854 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:10:55.563735 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.564029 27336 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
W20260709 13:10:55.565917 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 98795.2us
I20260709 13:10:55.564378 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.548553 32504 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:55.530618 32560 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.572234 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.576947 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.528527 32580 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:55.615628 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80596.6us
W20260709 13:10:55.567909 32568 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:10:55.614296 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:55.565857 32563 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.611371 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:55.618573 27338 raft_consensus.cc:2376] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14. Re-sending same reply.
I20260709 13:10:55.622102 27337 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:55.607961 27340 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:55.623354 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.624214 27338 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:55.567754 32583 raft_consensus.cc:2804] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:55.607208 32402 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.569778 32520 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.622141 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:55.628669 27262 raft_consensus.cc:2393] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:55.562809 31807 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.615568 32142 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.619359 32286 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:10:55.636826 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 85257.6us
W20260709 13:10:55.639570 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.642302 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.571357 31854 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.648296 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.653689 27411 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:55.658159 27339 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:55.632138 32585 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:55.662050 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:55.668988 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.670907 27415 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
I20260709 13:10:55.643978 32583 raft_consensus.cc:697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:55.635200 32402 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.678345 27267 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:55.654922 32347 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.628398 32563 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:55.715611 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.626194 32412 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.716647 27340 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:10:55.664103 32582 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.724794 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:55.727654 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68519.2us
I20260709 13:10:55.728704 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:55.729125 32592 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:55.729645 31647 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:55.730310 31647 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:55.719713 32347 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:55.731519 32347 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.729022 32563 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.647466 32142 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.680586 32548 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.748898 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:55.673858 32206 consensus_queue.cc:237] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:55.753988 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:55.833539 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 216505us
W20260709 13:10:55.754268 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.853039 27260 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
W20260709 13:10:55.832803 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64226.7us
I20260709 13:10:55.847510 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:55.834196 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:55.755276 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 121241us
I20260709 13:10:55.904184 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:55.823093 27334 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:55.904906 27342 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:55.876271 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.826360 27268 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
W20260709 13:10:55.834483 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.784042 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.758522 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.907655 27259 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
W20260709 13:10:55.751741 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96704.3us
I20260709 13:10:55.724584 32469 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:55.914861 31647 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:55.916780 31647 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.780241 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.720711 32140 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.680915 32585 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:55.803308 32405 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.784394 32346 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:55.834249 31854 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:55.926980 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:55.914922 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 181790us
I20260709 13:10:55.927867 27266 raft_consensus.cc:2410] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:55.764017 32555 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:55.803527 32401 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:55.910532 27264 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:10:55.764099 32582 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.924041 27262 raft_consensus.cc:2393] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:10:55.794341 32586 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
I20260709 13:10:55.924131 27261 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:10:55.802783 32583 consensus_queue.cc:237] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.937245 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:55.786942 32579 log.cc:927] Time spent T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260709 13:10:55.802230 32588 log.cc:927] Time spent T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:10:55.939181 27338 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:10:55.872989 32581 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:10:55.945650 27336 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:10:55.749729 32584 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:55.948750 27413 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:10:55.940920 27980 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:55.955760 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.953310 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.752467 32511 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:55.992599 31647 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:55.997771 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60832.3us
I20260709 13:10:55.795301 32569 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:56.005396 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 71499us
I20260709 13:10:55.923764 32560 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:56.007948 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 56880.6us
I20260709 13:10:55.926578 32323 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.026758 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:55.960048 32580 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:55.819818 32286 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:55.922678 32548 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.034937 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 116200us
I20260709 13:10:56.004628 32506 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.041796 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.064822 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.065738 27415 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:56.065883 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:56.064946 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.035703 32219 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:56.037122 32569 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:56.005725 32469 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.079409 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:10:56.070936 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 149371us
I20260709 13:10:56.069356 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:55.800190 27159 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:56.089556 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 65256us
I20260709 13:10:56.090575 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.092140 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.074038 32219 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:56.094880 27415 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:56.098137 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.087889 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:56.100970 27264 raft_consensus.cc:2410] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:10:56.104113 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.096916 32219 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:56.110394 32462 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:56.097148 32346 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:56.112156 32582 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.112964 32600 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:56.115389 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.117134 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.118712 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.052913 32506 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.120188 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.002871 32585 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.128719 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 122195us
W20260709 13:10:56.131510 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 69488.8us
I20260709 13:10:56.133309 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:10:56.133478 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 404850us
I20260709 13:10:56.134173 27412 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:56.134703 31807 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.135072 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:56.136058 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.138613 27409 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.135448 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.090160 32569 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:56.137444 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.142853 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.155934 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.141513 27262 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:56.119181 32401 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.160547 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.123514 32402 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.264451 32142 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.264844 32594 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.265252 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:56.215152 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:56.231742 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.281186 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.286182 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:56.170094 27415 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:56.239377 27408 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:56.242872 31647 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:10:56.245954 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 109976us
I20260709 13:10:56.142287 32511 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.160025 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.157696 32560 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:56.244686 32323 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:56.301445 31647 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.264096 32548 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:56.309118 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 150187us
I20260709 13:10:56.279008 32606 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:56.294785 32462 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:56.322849 31647 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.324200 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.326207 27259 raft_consensus.cc:2410] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:10:56.306564 32323 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.309674 31807 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:56.317977 32606 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.322748 32402 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:56.356648 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 111652us
I20260709 13:10:56.356729 32606 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.307443 32511 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.367093 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 453642us
I20260709 13:10:56.367991 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.327252 32401 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.347996 32323 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.369308 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.347424 32504 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:56.373646 27412 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:56.374584 31647 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:56.375252 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:56.372786 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 236816us
I20260709 13:10:56.383510 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.386626 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.387961 27259 raft_consensus.cc:2410] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:10:56.385594 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.389266 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.370379 32469 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.395051 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.397461 32605 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:56.397821 32610 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:10:56.382865 32401 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.401117 32439 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:56.403723 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:10:56.406173 27166 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 212) took 43506 ms (client timeout 15000 ms). Trace:
I20260709 13:10:56.407449 27159 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 13, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 13 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.409312 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.409643 27409 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:10:56.411532 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:56.414788 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.418433 32347 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.421082 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.434525 27259 raft_consensus.cc:2410] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:10:56.428673 27342 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:10:56.330940 32569 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.421872 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.435582 27412 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:56.435729 27342 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:10:56.440907 32607 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:10:56.394164 32504 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:56.442462 27261 raft_consensus.cc:2410] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:10:56.441913 32206 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:56.450575 32206 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.452332 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.395200 32449 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:10:56.457482 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 63499.5us
I20260709 13:10:56.437242 32622 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.438156 32506 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:56.466301 27159 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.468225 32511 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:56.468503 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.468961 27259 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:56.469213 27261 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:56.479750 32606 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.480418 32401 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:56.430536 27166 rpcz_store.cc:269] 0709 13:10:12.899976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.960492 (+ 60516us) service_pool.cc:224] Handling call
0709 13:10:56.405925 (+43445433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:50.903546 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:50.904238 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:50.904287 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:10:50.904306 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:50.919520 (+ 15214us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:50.919648 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:50.919679 (+    31us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:10:51.244222 (+324543us) tablet.cc:701] Row locks acquired
0709 13:10:51.244266 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:10:51.244436 (+   170us) write_op.cc:270] Start()
0709 13:10:51.244602 (+   166us) write_op.cc:276] Timestamp: P: 1783602651244369 usec, L: 0
0709 13:10:51.244636 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.245446 (+   810us) log.cc:844] Serialized 7568 byte log entry
0709 13:10:51.370607 (+125161us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd7fb270ac 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b
0709 13:10:51.623417 (+252810us) op_driver.cc:464] REPLICATION: finished
0709 13:10:51.894579 (+271162us) write_op.cc:301] APPLY: starting
0709 13:10:51.894720 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.017528 (+122808us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2e32a 00007fbd82bb3f14 00007fbd82bb3ec3 00007fbd82bb3e38 00007fbd82bb3df3 00007fbd82bb30dc 00007fbd82bdce16 00007fbd82bc4cbb 00007fbd82baf39d 00007fbd82bb2d75
0709 13:10:52.460378 (+442850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.460425 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:53.019491 (+559066us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:53.019946 (+   455us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:10:53.020009 (+    63us) write_op.cc:312] APPLY: finished
0709 13:10:53.020586 (+   577us) log.cc:844] Serialized 172 byte log entry
0709 13:10:53.149649 (+129063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.211607 (+ 61958us) write_op.cc:454] Released schema lock
0709 13:10:53.214100 (+  2493us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:53.217838 (+  3738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:53.217875 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64241,"reported_tablets":51,"spinlock_wait_cycles":253312,"child_traces":[["op",{"apply.queue_time_us":216545,"apply.run_cpu_time_us":43439,"apply.run_wall_time_us":1330289,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83433,"num_ops":19,"prepare.queue_time_us":150346,"prepare.run_cpu_time_us":67299,"prepare.run_wall_time_us":541748,"raft.queue_time_us":71300,"raft.run_cpu_time_us":46905,"raft.run_wall_time_us":396668,"replication_time_us":378583,"spinlock_wait_cycles":30759936,"thread_start_us":509726,"threads_started":5,"wal-append.queue_time_us":368091,"wal-append.run_cpu_time_us":11273,"wal-append.run_wall_time_us":2111207}]]}
I20260709 13:10:56.478947 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.483690 32606 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:56.484135 27261 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 13:10:56.484752 32433 consensus_meta.cc:287] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.946s	user 0.010s	sys 0.001s
W20260709 13:10:56.484829 32520 consensus_meta.cc:287] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.851s	user 0.010s	sys 0.001s
I20260709 13:10:56.485459 32520 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.485376 32433 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.468243 27159 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 5 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 8 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.486552 27265 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 17. Current term is 18. Ops: []
W20260709 13:10:56.487279 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.486984 27159 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.489450 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.491621 32219 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.492580 32504 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.502718 32219 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.507609 32520 consensus_queue.cc:1059] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:56.508811 32520 raft_consensus.cc:3055] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:56.509182 32520 raft_consensus.cc:740] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:56.437475 32462 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.510066 32520 consensus_queue.cc:260] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.512219 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:56.519615 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.518894 27159 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 10, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.520912 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.521672 32548 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:56.522058 32548 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:56.522404 32548 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:56.522655 32206 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.522694 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.524055 27159 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.525772 31647 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:56.529116 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.528393 27159 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.530676 27159 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.539361 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.557427 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:56.567554 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.568001 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52486 (request call id 2472) took 1241 ms. Trace:
I20260709 13:10:56.568460 27341 rpcz_store.cc:276] 0709 13:10:55.326416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.346802 (+ 20386us) service_pool.cc:224] Handling call
0709 13:10:56.567794 (+1220992us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000e2754. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:56.567938 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263662464}
I20260709 13:10:56.569038 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:56.569763 32548 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.532418 27159 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index -1 to 7, term changed from 8 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132), VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added, no longer has a pending config: VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129), VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130), VOTER d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131), NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:56.571321 32286 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:56.571904 32286 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.518277 32606 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.471369 32622 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.578635 31647 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.582523 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:56.583132 27268 raft_consensus.cc:3060] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:56.578367 32520 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:56.574121 32286 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.589766 32548 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.575045 32433 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:56.578310 32449 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:56.596938 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71423.3us
I20260709 13:10:56.598249 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.591892 32511 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:10:56.615358 27268 raft_consensus.cc:2468] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:10:56.587110 32584 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:56.586534 32323 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.621959 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.609930 32433 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.633872 32548 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:10:56.632368 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46860.2us
I20260709 13:10:56.662078 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:56.639549 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.628335 32433 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:56.681548 27338 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:10:56.658228 32555 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.018s	sys 0.024s
I20260709 13:10:56.685528 31647 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:56.674804 32104 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:56.685209 27380 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:56.689497 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.690435 27336 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:56.691542 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.691570 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:56.692401 27341 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:10:56.692459 27343 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.676208 32433 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:56.693879 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:56.694490 28011 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 19.
I20260709 13:10:56.675801 32548 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:56.695520 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:56.686494 32555 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.019s	sys 0.025s
I20260709 13:10:56.697782 27342 raft_consensus.cc:2393] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:56.699960 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.700433 32323 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.700543 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.701694 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.707882 27340 raft_consensus.cc:2410] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:56.706912 32603 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:10:56.709017 32634 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:10:56.710780 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.679586 32449 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:56.711095 27337 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:56.711794 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:56.712626 27260 raft_consensus.cc:2410] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:56.702852 32584 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.723608 32622 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:56.724009 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2723) took 1090 ms. Trace:
I20260709 13:10:56.724390 27339 rpcz_store.cc:276] 0709 13:10:55.633197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.633305 (+   108us) service_pool.cc:224] Handling call
0709 13:10:55.637061 (+  3756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.658546 (+ 21485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.723748 (+1065202us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b54002db254. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:56.723927 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47798656}
I20260709 13:10:56.713052 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:56.704797 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65376.8us
I20260709 13:10:56.727645 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.733506 31647 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:56.703207 32104 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:56.742054 28011 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:10:56.737146 32286 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:56.743942 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.751662 27415 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:56.743566 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.758118 27343 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:10:56.760349 32603 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:56.760946 32603 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:56.761392 32603 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:56.762166 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.702687 32555 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:56.779613 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.779832 32555 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.780896 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:56.743206 32599 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:56.784916 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 58097.2us
I20260709 13:10:56.786907 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.787985 31647 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:56.788353 31647 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:56.788681 31647 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:56.788829 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53735.8us
I20260709 13:10:56.791658 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.796527 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:56.767925 32439 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:56.798389 32560 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:56.805657 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.765684 32595 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:56.765684 32286 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.814693 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:56.741675 32548 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.841585 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48715.3us
I20260709 13:10:56.805629 32620 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.805123 32644 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:10:56.850399 27343 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:56.814307 32560 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:56.791015 32599 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.863025 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:56.806388 32439 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.868799 32642 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:10:56.885998 32599 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:56.888453 32369 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:56.867468 32449 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:10:56.890650 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 48344.2us
I20260709 13:10:56.905131 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.906263 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:56.891505 27417 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:56.856216 32620 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.898536 31647 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.868296 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:56.909726 27260 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:56.912070 27263 raft_consensus.cc:1240] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:56.871917 32560 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:56.916499 31647 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:56.917243 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 49071.3us
I20260709 13:10:56.917659 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 769) took 2132 ms. Trace:
I20260709 13:10:56.920397 27267 rpcz_store.cc:276] 0709 13:10:54.779401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.779538 (+   137us) service_pool.cc:224] Handling call
0709 13:10:56.911507 (+2131969us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b540031f1d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:56.911699 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974931840}
I20260709 13:10:56.918910 32560 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:56.925297 32560 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.926649 32560 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:56.842705 32104 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:56.942906 31647 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:56.953648 31647 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:56.955084 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:56.895134 32433 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:56.959182 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 45725us
I20260709 13:10:56.933435 32469 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:56.989024 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:56.953730 32286 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.014607 28011 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:10:57.003894 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:57.052954 28015 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:56.933947 32644 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:57.003429 27266 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:57.064255 32560 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.064832 32560 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.065097 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:57.066941 32560 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:56.940354 32652 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:56.939481 32563 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:10:57.009326 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:57.196372 31647 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:56.998260 32433 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.081212 32560 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.081549 32449 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:57.207293 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.084120 32652 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.217358 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.198447 31807 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.206489 32511 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:57.223502 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.225275 31647 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.226323 32511 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.227947 32651 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.228477 32511 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:57.229025 32641 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:57.229564 32641 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:57.230136 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.230858 27416 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:57.230531 32641 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.231815 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.232818 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.237075 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.237877 28012 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:57.204169 32600 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.247323 32600 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.248525 32651 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:57.249076 32651 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.249948 32600 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:57.252648 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.251140 32651 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:57.256690 32648 log.cc:927] Time spent T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:57.271373 27268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2749) took 1024 ms. Trace:
I20260709 13:10:57.203896 32644 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:57.221911 32560 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.217120 32652 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.232132 32641 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.277056 32560 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.222244 32449 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.305774 31647 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.262511 31807 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.274720 32620 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.313274 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2418) took 1286 ms. Trace:
I20260709 13:10:57.283730 32439 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.294363 32506 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:57.340094 27413 rpcz_store.cc:276] 0709 13:10:56.023404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.023537 (+   133us) service_pool.cc:224] Handling call
0709 13:10:56.037535 (+ 13998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.042409 (+  4874us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:10:56.079312 (+ 36903us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.006435 (+927123us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b180049a320. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:10:57.309380 (+302945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.309445 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:57.309505 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.309596 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.309755 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11920,"prepare.queue_time_us":18988,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":24092,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":16906,"spinlock_wait_cycles":7131392,"thread_start_us":278654,"threads_started":1}
I20260709 13:10:57.323763 27408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2426) took 1252 ms. Trace:
I20260709 13:10:57.312573 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:57.348217 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:10:57.350055 27408 rpcz_store.cc:276] 0709 13:10:56.071861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.072159 (+   298us) service_pool.cc:224] Handling call
0709 13:10:56.089042 (+ 16883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.292941 (+203899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.323493 (+1030552us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54000acb54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:57.323700 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157823872}
I20260709 13:10:57.354110 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.355352 27259 raft_consensus.cc:2410] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 13:10:57.356221 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 43735us
I20260709 13:10:57.363371 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.362960 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:57.355332 32603 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:10:57.351639 32433 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:57.366078 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.368475 31807 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.362982 32439 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.364967 27267 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:10:57.366714 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.353004 32506 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.372069 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 775) took 1842 ms. Trace:
I20260709 13:10:57.375720 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2726) took 1698 ms. Trace:
I20260709 13:10:57.385674 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.386927 27264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59118 (request call id 1860) took 1438 ms. Trace:
W20260709 13:10:57.388967 32609 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 1.148s	user 0.005s	sys 0.000s
I20260709 13:10:57.367570 32620 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.409479 27265 rpcz_store.cc:276] 0709 13:10:55.529395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.529531 (+   136us) service_pool.cc:224] Handling call
0709 13:10:55.542464 (+ 12933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.486947 (+944483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.371825 (+884878us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54003093d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:57.372001 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170798848}
I20260709 13:10:57.398267 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.404033 32469 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:10:57.405822 32638 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.729s	user 0.003s	sys 0.000s
I20260709 13:10:57.406963 32662 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:57.410337 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:57.410364 27334 rpcz_store.cc:276] 0709 13:10:55.677534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.760881 (+ 83347us) service_pool.cc:224] Handling call
0709 13:10:55.807411 (+ 46530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.905579 (+ 98168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.375538 (+1469959us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5400289bd0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:57.375662 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6823808}
I20260709 13:10:57.410943 27264 rpcz_store.cc:276] 0709 13:10:55.948268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.004199 (+ 55931us) service_pool.cc:224] Handling call
0709 13:10:57.386723 (+1382524us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b54001b8ad4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:57.386850 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167721728}
I20260709 13:10:57.410614 27262 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:10:57.423461 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:57.424538 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.423484 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.399492 32346 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:57.413656 31807 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.429189 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.430068 27259 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:10:57.403288 32439 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.431594 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.431830 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.433782 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.427832 32347 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.433748 27409 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:57.435154 28012 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:57.430729 32249 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.434798 32347 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.436539 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:57.440714 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:57.440984 27259 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:57.437989 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.439779 27262 raft_consensus.cc:1275] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:57.441836 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.432471 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:57.420204 32620 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.446826 32506 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:57.432842 32346 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.445045 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.432555 31807 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.446980 32347 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.430910 32617 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.462738 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.448655 32595 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.450114 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.451897 27263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 1854) took 1542 ms. Trace:
I20260709 13:10:57.433760 32662 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.442413 27267 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:57.444172 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.458122 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.459136 27412 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:57.399777 32652 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.443287 32142 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.400555 32603 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.469884 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.437317 32439 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.473620 32662 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.271885 27268 rpcz_store.cc:276] 0709 13:10:56.247297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.917458 (+670161us) service_pool.cc:224] Handling call
0709 13:10:56.936874 (+ 19416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.937123 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:56.959519 (+ 22396us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.271007 (+311488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.271056 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:57.271103 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.271199 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.271314 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56944,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":80,"thread_start_us":311068,"threads_started":1}
I20260709 13:10:57.474366 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.432984 32469 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.402767 32433 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.481629 31807 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.483204 32433 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.483738 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.474467 32142 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.485044 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2736) took 1461 ms. Trace:
I20260709 13:10:57.485146 32142 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.485745 32346 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.486954 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.473639 32603 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.465914 27263 rpcz_store.cc:276] 0709 13:10:55.909824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.934919 (+ 25095us) service_pool.cc:224] Handling call
0709 13:10:56.911817 (+976898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.912642 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.451719 (+539077us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540031f1d0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c308ad 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:57.451840 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244773632}
I20260709 13:10:57.476537 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:10:57.478719 32578 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.908s	user 0.006s	sys 0.000s
I20260709 13:10:57.502894 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.481310 32469 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.465762 32595 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.487011 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.503506 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.468779 32286 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.524664 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.507951 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:57.485509 27261 rpcz_store.cc:276] 0709 13:10:56.023479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.487456 (+463977us) service_pool.cc:224] Handling call
0709 13:10:56.487757 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.488082 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.488121 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.488603 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.597828 (+109225us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.597873 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.597949 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.405242 (+807293us) spinlock_profiling.cc:243] Waited 5.49 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:57.476297 (+ 71055us) raft_consensus.cc:1685] finished
0709 13:10:57.476317 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.484977 (+  8660us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1015,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":12631936,"thread_start_us":108837,"threads_started":1,"wal-append.queue_time_us":169047}
I20260709 13:10:57.507508 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:57.524566 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.530539 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.470945 27309 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.534116 27259 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
W20260709 13:10:57.536170 32608 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 1.293s	user 0.003s	sys 0.003s
I20260709 13:10:57.537267 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:57.539624 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:57.540903 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.542025 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.544814 27260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2748) took 1406 ms. Trace:
I20260709 13:10:57.545233 27260 rpcz_store.cc:276] 0709 13:10:56.138797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.897394 (+758597us) service_pool.cc:224] Handling call
0709 13:10:56.897677 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.910316 (+ 12639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.544503 (+634187us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54000d6954. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:57.544754 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27135872}
I20260709 13:10:57.543089 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:57.546448 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 75581.6us
I20260709 13:10:57.461867 32249 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:10:57.547905 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:57.552243 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.420835 32644 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.547155 27265 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:57.554724 27383 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:57.556624 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:57.546437 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.550302 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.560382 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:57.523905 32595 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.562857 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:57.563261 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:57.520849 32433 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:57.545921 32641 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.562252 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:57.555300 32555 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:57.566728 32662 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.553705 32346 raft_consensus.cc:2764] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:10:57.553825 32347 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.553458 32219 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.568462 32206 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.570487 32357 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:57.564683 32506 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:57.567092 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.562458 32504 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:57.575477 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.582139 27341 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:57.577050 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.562753 31807 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.607214 32439 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.567097 32641 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.609169 32641 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.609503 27268 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:10:57.611382 32439 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.612505 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:57.613207 32449 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:57.613260 27415 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.615489 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2741) took 1562 ms. Trace:
I20260709 13:10:57.615900 27266 rpcz_store.cc:276] 0709 13:10:56.053154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.712466 (+659312us) service_pool.cc:224] Handling call
0709 13:10:56.738083 (+ 25617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.085903 (+347820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.615271 (+529368us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54003034d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:57.615431 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609643776}
I20260709 13:10:57.617206 27266 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:57.617959 27264 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:57.618253 27266 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:57.611882 27268 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:57.623095 27266 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:57.574976 32142 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.564585 32600 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.569965 32555 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.583277 27339 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:57.586014 32603 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:57.586016 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.586933 27334 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:57.587579 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.588006 32663 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:57.588593 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.591311 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:57.591773 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.592789 32504 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:57.593811 27267 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:57.576145 32599 consensus_queue.cc:1059] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:10:57.582679 32506 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:57.568847 32433 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.596659 27263 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:57.596659 27265 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:57.586277 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.648914 27342 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:10:57.600492 32652 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.564862 32620 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:57.560626 32580 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:10:57.605695 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.582445 32358 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:10:57.577601 32662 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.622797 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:57.629614 32439 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.631920 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.633369 27415 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:10:57.636720 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.661263 27343 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:57.643690 32555 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.643560 27336 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
W20260709 13:10:57.645422 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 54205.9us
I20260709 13:10:57.646085 27266 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:57.656723 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.658167 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.662330 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.637773 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:57.667739 27339 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.662763 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.668955 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.650629 32506 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.673768 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.647118 32449 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:57.668802 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.687816 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:57.688020 27340 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:57.687599 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.681454 28012 raft_consensus.cc:1240] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:57.659528 32599 consensus_queue.cc:1243] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:10:57.651525 32662 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.683387 27337 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:57.688618 27341 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 14: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:57.687532 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:57.696437 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.699038 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.684674 27308 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.689991 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.661142 32347 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.692881 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.702477 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.703555 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.706342 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.683336 32286 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.713488 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.718035 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.719276 27260 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:10:57.725955 31647 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.726086 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.726706 31647 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.727865 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:57.729998 27339 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:57.730948 31647 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:57.736338 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.738210 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.664103 32439 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.742153 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.744021 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.746017 27266 raft_consensus.cc:1240] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:57.743363 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.689050 32140 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:10:57.703998 32599 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:57.760119 27336 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:57.761552 27340 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:10:57.760932 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.756510 27343 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:57.765623 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:57.724092 32604 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:57.752043 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:57.766644 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.770736 32600 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.723728 32651 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.734462 32548 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.734670 32652 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:57.757546 32439 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.753602 32654 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.756317 32433 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.788017 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.771901 32347 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.751048 32677 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:57.759227 32142 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.789762 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:57.774863 32620 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.792233 31647 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.781327 32651 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.749583 32504 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.794811 27335 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:57.776983 32617 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:57.811122 32506 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:57.813922 27267 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
W20260709 13:10:57.815073 27411 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56236 (request call id 2035) took 1399 ms (client timeout 1851 ms). Trace:
I20260709 13:10:57.774168 32604 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.786204 27343 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:10:57.748410 32283 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:57.822118 27341 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:10:57.822755 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:57.830363 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 86399.6us
I20260709 13:10:57.918932 31647 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:57.920430 27411 rpcz_store.cc:269] 0709 13:10:56.391357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.403354 (+ 11997us) service_pool.cc:224] Handling call
0709 13:10:57.788879 (+1385525us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54000ac654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:10:57.790964 (+  2085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002576128}
I20260709 13:10:57.823678 32433 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:57.929369 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:57.930514 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 107865us
I20260709 13:10:57.939503 27308 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:57.940014 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 212246us
I20260709 13:10:57.941133 31647 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.941306 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.941727 31647 consensus_queue.cc:1243] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:57.934538 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:57.947629 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.929818 32604 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:57.947871 31647 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.940325 32346 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.822052 32347 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:57.939445 32433 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.955394 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.960400 31647 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:57.960994 31647 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:57.961887 31647 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:57.964318 27231 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.951458 32584 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:57.976698 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.961331 32652 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:57.952937 32611 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:10:57.984105 32651 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:57.984119 32611 consensus_queue.cc:1243] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:57.946353 32677 consensus_queue.cc:1048] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:10:57.988065 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:57.992344 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:57.994411 27261 raft_consensus.cc:2393] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:57.996626 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:58.000530 31647 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:58.008659 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 78335.2us
I20260709 13:10:57.977792 32584 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.012971 27266 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:57.957864 32569 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:57.982249 32469 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:57.958163 32617 consensus_queue.cc:1059] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:10:58.017077 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:57.958308 32462 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:10:57.978333 32590 consensus_queue.cc:1059] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:10:57.992239 32651 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:57.987403 32104 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:10:58.019505 32584 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.019693 32641 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.019800 27259 raft_consensus.cc:1217] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[12.9-15.11]   Dedup: 12.9->[14.10-15.11]
I20260709 13:10:58.029043 32555 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.034299 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.036621 31647 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:57.982455 32603 consensus_queue.cc:1059] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:10:58.040591 27259 pending_rounds.cc:85] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 9
W20260709 13:10:58.020526 32680 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:58.023810 32679 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:10:58.044205 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.050034 27266 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.045778 27259 pending_rounds.cc:107] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:10:58.050956 27259 raft_consensus.cc:2889] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:58.042495 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.032294 32654 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:58.018054 32683 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:58.037348 32652 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.059533 31647 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.061152 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 121760us
I20260709 13:10:58.063599 31647 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.062263 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.064098 27308 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.043458 32511 raft_consensus.cc:3055] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.048861 32469 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:10:58.065177 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 86652.9us
I20260709 13:10:58.024469 32358 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:10:58.039817 32681 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.070156 27231 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.026191 32662 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.074966 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.067528 32511 raft_consensus.cc:740] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.064055 32683 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:58.043702 32651 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.098706 32651 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.063180 32548 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.079478 31647 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.082054 32641 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.084128 32683 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:58.099558 32652 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:58.100016 32652 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:58.100409 32652 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:58.078056 32560 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:10:58.090989 32662 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.091352 32555 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.069566 32469 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.103878 32347 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:58.104079 32469 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.091661 27338 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:10:58.073630 32603 consensus_queue.cc:1059] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:10:58.073091 32590 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:10:58.108397 32683 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.078305 32506 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.071210 32358 consensus_queue.cc:1243] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:58.072947 32654 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.110440 32654 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.110582 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:58.111352 32654 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.113121 27261 raft_consensus.cc:1217] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-14.11]   Dedup: 10.9->[12.10-14.11]
I20260709 13:10:58.113605 27261 pending_rounds.cc:85] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 9
I20260709 13:10:58.113848 27261 pending_rounds.cc:107] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:10:58.114080 27261 raft_consensus.cc:2889] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:58.093583 27343 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.115389 32683 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.116586 27343 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:58.117713 27343 raft_consensus.cc:1240] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:58.078218 32433 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:58.121003 32433 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.068086 32595 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.096345 32511 consensus_queue.cc:260] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.123524 27343 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:10:58.126928 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:58.128931 27412 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:58.127663 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51857.8us
I20260709 13:10:58.121974 32433 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.143198 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.140705 32560 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:58.150269 32560 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.151369 27415 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.148658 32548 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.152642 32560 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.154069 32595 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.142449 32580 raft_consensus.cc:3055] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.141638 32644 consensus_queue.cc:1059] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:58.156335 32580 raft_consensus.cc:740] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.157990 32569 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:58.170544 27335 raft_consensus.cc:1275] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:58.170967 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.173032 27262 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:58.176614 27266 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:10:58.177700 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.178268 27266 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.181499 32603 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.182147 32603 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.143967 32632 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:58.184712 32632 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.185111 32632 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:58.185937 32632 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.186602 32603 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.189241 32580 consensus_queue.cc:260] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.193840 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.204164 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:58.208057 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.215116 27266 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:58.215076 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.207690 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:58.208952 27414 raft_consensus.cc:1240] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:58.214397 27416 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:10:58.222028 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:58.136607 32584 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.223047 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.191402 32632 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.228724 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:58.230697 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:58.214756 32604 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.231359 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.231894 27337 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:58.233595 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:58.233098 27262 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:58.227677 32580 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.229547 32595 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.266840 27263 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:58.232537 32569 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.281173 32612 raft_consensus.cc:3055] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:58.281639 32612 raft_consensus.cc:740] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:58.281716 32595 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.242641 32600 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.241169 32401 raft_consensus.cc:3055] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:58.245404 32104 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.279915 32605 raft_consensus.cc:3055] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:58.296885 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:58.284673 27411 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:58.301427 27338 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:58.286818 27336 raft_consensus.cc:1275] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:58.305806 27412 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:58.308777 27336 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:58.289037 27260 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:10:58.291383 27262 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:58.310649 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.312698 27262 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:58.282642 32612 consensus_queue.cc:260] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.301148 32605 raft_consensus.cc:740] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.295644 32401 raft_consensus.cc:740] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:58.340353 27260 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:58.316718 32683 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.305510 32657 consensus_queue.cc:1059] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:10:58.363967 32683 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.385680 32612 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:58.398478 32595 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:58.401335 32469 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.385922 32652 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.403476 27268 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:10:58.405730 32694 log.cc:927] Time spent T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:10:58.407334 32652 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:58.423626 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.427393 32584 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.427911 32603 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.428491 32603 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:58.430914 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.432920 28012 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:58.433238 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:58.433923 28015 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:10:58.435276 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:58.435618 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:58.436038 28011 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:58.433400 32654 raft_consensus.cc:3055] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:58.436708 32654 raft_consensus.cc:740] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.436939 32603 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:58.438033 32654 consensus_queue.cc:260] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.387954 32683 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.440627 32560 raft_consensus.cc:3055] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:58.441025 32560 raft_consensus.cc:740] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.441892 32560 consensus_queue.cc:260] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.442960 32600 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:10:58.444162 32697 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:58.448509 32604 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.449523 32599 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:58.450261 32662 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:58.451543 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 387539us
I20260709 13:10:58.451797 32462 consensus_queue.cc:1048] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:58.452314 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.452883 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.453503 32249 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:58.453824 27308 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.454232 32462 consensus_queue.cc:1048] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:58.452912 27265 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.454679 27308 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.455433 32358 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:58.444204 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:58.456797 32681 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:58.458030 32695 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:58.458811 32346 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.450776 32662 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.459299 32140 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.469201 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.463824 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:58.455727 31807 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:58.474505 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.477674 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:58.486513 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.487190 27260 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:58.476910 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:58.517819 27262 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:58.463150 32511 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.519351 32630 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.516652 32605 consensus_queue.cc:260] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.519812 32630 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.521513 32630 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.530900 32580 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:58.532505 32580 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:58.532998 32580 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.475641 32603 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.540460 32654 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:58.540581 32603 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.545284 32590 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:58.545778 32590 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:58.545563 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 67939.2us
I20260709 13:10:58.546263 32590 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.546837 27308 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.548094 32686 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.485792 32560 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:58.548759 32686 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:58.549852 32686 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:58.552948 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89197.2us
I20260709 13:10:58.553246 32688 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:58.553748 32688 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.554118 32688 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:58.554430 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:58.555938 32630 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.556392 32599 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:58.557267 32600 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.557670 32600 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.558027 32600 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.558691 32605 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:58.508158 32283 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:58.563786 32283 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.564669 32283 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:58.566706 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 43719.7us
I20260709 13:10:58.567081 32585 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:58.568619 32569 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:58.568984 32569 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.569957 32605 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:58.571344 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.569834 32569 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.573155 31647 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:58.534152 32580 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.579677 31647 consensus_queue.cc:1243] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:58.485857 32439 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:58.582195 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.580865 31647 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:58.581876 27265 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:58.583199 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:58.583931 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.589254 31647 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.432924 32657 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:10:58.590164 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.594717 27413 raft_consensus.cc:2410] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:10:58.591321 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.591683 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:58.473881 32520 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.112s
I20260709 13:10:58.615551 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:58.617161 28014 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:10:58.618548 27413 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:58.619719 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.615880 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:58.616820 31647 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.629001 31647 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.635211 32347 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:58.635059 32605 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:58.636140 32347 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.636656 32585 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:58.637087 32585 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:58.638661 32347 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.613965 32569 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.619844 32644 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:58.653074 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.617071 32439 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.640822 32580 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:58.515880 32401 consensus_queue.cc:260] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.596135 32683 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.641155 32433 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:10:58.663345 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 215428us
W20260709 13:10:58.696826 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.715365 27410 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:10:58.654146 32469 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.642071 32604 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:10:58.728119 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.656152 32644 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:58.657330 32603 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.743716 32620 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:58.747757 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.665364 32439 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.741281 32617 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.795534 32600 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:58.798456 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.807101 32617 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:58.811962 32439 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:58.818360 32590 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.825942 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.825973 32585 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.828469 27231 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.833487 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:58.835184 27416 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:58.830567 32683 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:58.837757 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:58.838332 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:58.841781 27260 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.845081 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.857645 27415 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:58.858479 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:58.860699 27267 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:10:58.738360 32681 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:10:58.865700 27411 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:58.867800 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:10:58.868422 27411 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.871551 27264 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:58.786628 32705 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:58.880864 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.855815 32604 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:58.859741 32657 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:58.846917 32664 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:58.886626 27340 raft_consensus.cc:1240] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:10:58.878966 32683 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:10:58.875765 32560 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.906824 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.907709 27342 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:58.908953 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:58.883845 32600 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:58.906759 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 285223us
I20260709 13:10:58.918416 27411 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:58.912425 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.922448 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.922801 27338 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:58.890853 32657 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:58.928982 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.896998 32585 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:58.930073 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 312274us
I20260709 13:10:58.849255 32644 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.885926 32688 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.876525 32617 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:58.932555 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:10:58.945057 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.896399 32651 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:58.950569 27265 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:58.945448 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 76337.3us
W20260709 13:10:58.951303 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.951751 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:58.941916 28014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:58.972033 27336 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.972139 28014 raft_consensus.cc:606] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:58.944697 27260 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:58.959944 32590 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:58.894480 32664 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:58.979856 27336 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:58.933240 32657 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:58.985595 27233 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:59.002344 31647 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.002938 31647 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:59.001709 27342 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:10:59.003849 31647 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.004384 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.005620 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.009207 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.010393 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.011345 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.012281 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.007146 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.027022 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:59.027580 27336 raft_consensus.cc:2376] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15. Re-sending same reply.
I20260709 13:10:59.027827 27268 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:59.015684 27412 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:10:59.029053 27342 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.039774 28011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:59.040567 28011 raft_consensus.cc:606] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:59.041875 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.043327 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:10:59.045194 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111077us
W20260709 13:10:59.049724 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 113155us
I20260709 13:10:59.037217 32611 raft_consensus.cc:993] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:10:59.062500 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.049396 32604 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:59.073551 27336 raft_consensus.cc:1240] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:59.077112 27268 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:59.079111 27342 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:10:59.099059 27335 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:59.099979 27336 pending_rounds.cc:85] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 7
I20260709 13:10:59.100370 27336 pending_rounds.cc:107] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:10:59.100641 27336 raft_consensus.cc:2889] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.107513 32720 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:10:59.108392 32720 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:10:59.117412 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.119998 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 73825.1us
I20260709 13:10:59.121462 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:59.123878 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.126335 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.134620 32725 raft_consensus.cc:1081] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:10:59.131456 32142 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:59.136021 32142 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:59.136466 32142 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:59.137418 32142 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.139856 32688 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.141348 32142 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:59.127936 32709 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:10:59.160950 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.118314 32548 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:10:59.178637 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 112908us
I20260709 13:10:59.177585 27338 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:10:59.130827 32704 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:59.182965 27342 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: [12.7-15.9]
I20260709 13:10:59.184613 27338 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:59.187393 32548 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:59.197921 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.206480 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:10:59.215476 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:59.217352 32595 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:59.217887 32595 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.218811 32595 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.219939 32595 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:59.185221 27268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:48160
I20260709 13:10:59.226248 27268 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:59.226773 27268 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:59.231312 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:10:59.232782 27415 raft_consensus.cc:606] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:59.222815 32657 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.207211 32720 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:59.229298 32580 consensus_meta.cc:287] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.000s
I20260709 13:10:59.205132 32688 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:59.256881 31647 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:59.271915 31647 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.280471 31647 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.198005 32604 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:59.275409 32654 consensus_meta.cc:287] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.734s	user 0.004s	sys 0.010s
I20260709 13:10:59.274436 32664 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:59.275632 32688 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.302263 32688 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:59.305663 28011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:10:59.306339 28011 raft_consensus.cc:606] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:59.306651 28011 raft_consensus.cc:614] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:59.308193 32401 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:59.309659 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:10:59.310382 27415 raft_consensus.cc:606] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:10:59.310766 27415 raft_consensus.cc:614] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:59.312316 32560 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.312355 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:59.322479 32662 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.328910 32548 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.342532 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:59.345561 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.342622 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:59.348527 28011 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.348899 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:59.350229 32286 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.350749 32286 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.353200 32286 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.353395 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:59.354280 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:10:59.360463 28011 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:10:59.374756 27259 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:10:59.380224 32644 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:59.384963 32657 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:59.386174 32712 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:10:59.388135 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2749) took 1717 ms. Trace:
I20260709 13:10:59.389766 27341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2746) took 1719 ms. Trace:
I20260709 13:10:59.406178 32725 raft_consensus.cc:993] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:10:59.388506 27334 rpcz_store.cc:276] 0709 13:10:57.670703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.089120 (+418417us) service_pool.cc:224] Handling call
0709 13:10:58.089412 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:58.600891 (+511479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.600938 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.622910 (+ 21972us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.909114 (+286204us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.026715 (+117601us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.027065 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.027189 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.385550 (+358361us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:59.387845 (+  2295us) raft_consensus.cc:1685] finished
0709 13:10:59.387943 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.388076 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":358537,"prepare.queue_time_us":177167,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":364119,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":11381,"spinlock_wait_cycles":139056000,"thread_start_us":512935,"threads_started":3,"wal-append.queue_time_us":401112}
W20260709 13:10:59.416692 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.430915 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.435559 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 96388.4us
I20260709 13:10:59.437827 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.448282 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:59.449203 27260 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:10:59.454102 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.455619 27262 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:59.455957 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.458580 27383 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:10:59.462257 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.390153 27341 rpcz_store.cc:276] 0709 13:10:57.670102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.924910 (+254808us) service_pool.cc:224] Handling call
0709 13:10:57.932889 (+  7979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.545581 (+612692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.545614 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.546069 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.784759 (+238690us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:58.984885 (+200126us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.987093 (+  2208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.389022 (+401929us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b1800193a80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb122a6 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419
0709 13:10:59.389494 (+   472us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54001fcf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:59.389538 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.389577 (+    39us) raft_consensus.cc:1685] finished
0709 13:10:59.389589 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.389712 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286463,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":12473,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":9322,"spinlock_wait_cycles":1420783232,"thread_start_us":414985,"threads_started":2,"wal-append.queue_time_us":380157}
I20260709 13:10:59.467864 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.470551 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:59.407706 32725 raft_consensus.cc:1081] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:10:59.476035 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.477303 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.463740 27268 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.478250 31647 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.478657 27259 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:59.481307 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.485080 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:59.454141 32286 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:59.476758 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:10:59.489563 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:59.454356 32469 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.491478 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 242427us
I20260709 13:10:59.455410 32599 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:59.494062 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:59.472294 32683 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:59.469540 32580 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.480881 32604 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.499953 32632 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.500438 32632 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.501475 32469 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.502535 32632 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.503577 32469 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:10:59.505026 32715 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
I20260709 13:10:59.507103 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.509826 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:10:59.476056 32560 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:59.476629 32662 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:10:59.512660 27339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 815) took 1048 ms. Trace:
I20260709 13:10:59.484143 32644 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:59.513983 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:10:59.481607 32657 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:59.488117 32630 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.516767 27339 rpcz_store.cc:276] 0709 13:10:58.464264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.464376 (+   112us) service_pool.cc:224] Handling call
0709 13:10:58.464627 (+   251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.475781 (+ 11154us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:10:58.520250 (+ 44469us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.788121 (+267871us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b1800353da0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d123a 00007fbd82c3ba2a
0709 13:10:58.934628 (+146507us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.938599 (+  3971us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.948338 (+  9739us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.948479 (+   141us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:58.948513 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.948576 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.404117 (+455541us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b1800353da0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:59.504431 (+100314us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:10:59.512431 (+  8000us) raft_consensus.cc:1685] finished
0709 13:10:59.512454 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.512602 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22886,"prepare.queue_time_us":532785,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":15642,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":35159,"spinlock_wait_cycles":351140864,"thread_start_us":129972,"threads_started":1,"wal-append.queue_time_us":473293}
I20260709 13:10:59.541774 27268 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.466197 32600 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:10:59.492594 32720 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:59.469875 32688 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:10:59.516114 32744 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:10:59.494403 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:10:59.588414 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82243.4us
I20260709 13:10:59.497102 32731 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.664244 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.664469 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 150558us
I20260709 13:10:59.484575 32584 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:10:59.480602 32548 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:10:59.512231 32722 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.519448 32249 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:59.540417 32580 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.493671 32286 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.545259 32662 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:59.701748 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 191979us
W20260709 13:10:59.724771 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 230430us
I20260709 13:10:59.512053 32705 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 13:10:59.684150 32560 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.697613 32704 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:59.549880 32657 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.512777 32599 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.494439 32684 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:10:59.756182 32741 log.cc:927] Time spent T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:10:59.756084 32548 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:59.766455 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:59.767859 27383 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:10:59.511466 32664 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 13:10:59.722478 32569 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:59.748106 32560 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.752276 32705 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:59.752758 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:10:59.753400 32740 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:59.753738 32657 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.730208 32683 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.776551 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.782745 28011 raft_consensus.cc:2410] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:59.747431 32720 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:59.781003 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:59.784858 28015 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:59.785226 28015 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:10:59.749956 32748 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.731647 32731 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.777127 32346 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.775682 32357 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:59.807871 32584 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:59.808667 32657 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.809765 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 267486us
I20260709 13:10:59.778255 32705 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:10:59.824887 32657 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.830530 32657 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.833964 32560 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.823642 32357 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.836225 32580 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.837332 32357 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.839299 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.839869 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.840534 28011 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:10:59.784690 32720 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:59.844324 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:59.818509 28015 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.855479 28015 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:59.791579 32683 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:10:59.782820 32585 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:10:59.860028 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 135171us
I20260709 13:10:59.864810 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:59.822991 32748 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.865495 27411 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
W20260709 13:10:59.873610 32745 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:59.873955 32763 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:59.875041 32722 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:10:59.911309 32617 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.911267 32722 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.912263 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:59.912032 32617 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.912904 27265 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 10.
I20260709 13:10:59.819479 32346 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.913559 32722 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.914265 32617 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:10:59.875288 32752 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:59.875990 32688 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:59.914930 32752 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.915056 32688 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.857703 32560 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:59.877581 32590 raft_consensus.cc:993] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:10:59.883760 32720 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.915683 32560 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.887112 32731 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.916114 32560 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.916054 32688 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.917966 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:59.918608 27409 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
I20260709 13:10:59.920270 32346 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.922369 32705 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.924119 32705 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:59.924909 32560 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:10:59.927328 32560 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:10:59.928452 32748 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:10:59.936087 32401 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.002s
I20260709 13:10:59.894344 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:10:59.950891 27268 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:10:59.895889 27262 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:59.892844 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:10:59.898959 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:10:59.907748 28015 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:59.909271 32286 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.909672 32662 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:10:59.914640 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.952616 27411 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 9.
W20260709 13:10:59.957175 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64404us
I20260709 13:10:59.866118 32584 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.966869 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.972718 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:10:59.972911 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 72894.3us
I20260709 13:10:59.972400 27335 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:59.972328 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74373.5us
I20260709 13:10:59.974448 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:10:59.967294 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 199489us
I20260709 13:10:59.979184 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.980573 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.962987 32560 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.958829 32763 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:10:59.986918 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.965200 32401 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:59.986307 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.988909 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:10:59.992125 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.989288 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.990155 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:10:59.993142 27339 raft_consensus.cc:2410] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:10:59.993371 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:10:59.994362 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:10:59.995039 28015 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:59.995592 27339 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:59.999002 32599 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:10:59.984962 32683 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:10:59.976547 32751 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:00.009799 32763 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.020000 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.021524 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:00.022132 27338 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:00.020879 27334 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:10:59.976112 32580 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:10:59.982708 32590 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.022771 27383 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.030126 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.014428 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:00.032056 27335 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:00.033861 28015 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
W20260709 13:11:00.029031 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 232002us
I20260709 13:11:00.029707 31647 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:59.973798 32286 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:10:59.983356 32630 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:00.041769 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.031862 27262 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:11:00.042416 31647 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:00.046290 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.046736 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:10:59.991370 32401 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.042827 27231 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:00.015796 32600 raft_consensus.cc:1081] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:00.046995 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:00.056087 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:00.056672 27411 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.057544 31647 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.045735 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.059268 27262 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:00.052759 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:00.049549 32686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.006s	sys 0.005s
I20260709 13:11:00.061210 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.062095 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.058133 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:00.041625 32617 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:00.067144 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.066732 32357 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.041625 32755 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:11:00.074054 27341 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:00.066432 32644 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:59.991501 32560 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.066952 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.049100 32206 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:00.055423 32401 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:00.081108 27338 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:00.043490 32580 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.094477 27231 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:00.065413 32686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.007s	sys 0.006s
I20260709 13:11:00.059686 32711 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.129016 27413 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:00.133780 27410 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:11:00.134131 27414 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:00.101588 32569 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:00.110714 27411 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:00.113804 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.064112 32722 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:00.062161 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:00.048332 32590 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.092116 32357 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:00.064802 32611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.007s	sys 0.000s
I20260709 13:11:00.092783 32469 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.138888 27412 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 20.
I20260709 13:11:00.138113 32569 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:00.159659 32569 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:00.142271 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80168.8us
I20260709 13:11:00.159812 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.161124 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.161828 27412 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:00.162528 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.165009 27410 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:00.142527 27415 raft_consensus.cc:2468] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:11:00.145378 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.125551 32764 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.148527 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.149209 27262 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:00.059836 32584 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:00.152089 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.123327 32600 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.122452 32604 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:00.156476 32611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.008s	sys 0.001s
I20260709 13:11:00.131068 32548 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.147845 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.093956 32617 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.111924 32652 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.197413 27380 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:00.177954 32346 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.133613 32711 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.176666 27263 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:00.178004 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.179673 27261 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:00.214264 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:00.167349 32357 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.154714 32662 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:00.122212 32206 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:00.175199 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 128241us
I20260709 13:11:00.181087 32704 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.184852 32286 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.214768 27265 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 20.
I20260709 13:11:00.185237 32140 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.222469 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:00.140899 32630 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.181298 32766 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:11:00.235690 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 141317us
I20260709 13:11:00.193459 32617 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.212592 32758 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:00.249650 28015 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 19.
W20260709 13:11:00.245563 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 94745.6us
W20260709 13:11:00.246958 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 55637.6us
I20260709 13:11:00.218544 32711 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.247689 27338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52492
I20260709 13:11:00.187544 32600 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:00.250380 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.255267 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:00.255853 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.256820 27334 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:00.193661 32142 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:11:00.180096 32764 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.228037 32662 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:00.267249 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.231354 32748 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.189419 32604 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.252736 32600 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.261736 32206 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.280953 27409 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 20: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:00.210263 32652 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.284104 27233 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.284138 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:00.240746 32585 consensus_queue.cc:1059] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:11:00.276005 32722 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:00.291546 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.236653 32704 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.239876 32140 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.228569 32346 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.280189 32662 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:00.235029 32286 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.264773 32469 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:11:00.266594 32763 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:11:00.296895 32644 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.310273 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.312819 27339 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:00.294329 27383 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:00.334239 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44482.9us
I20260709 13:11:00.339229 27338 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:00.296331 32760 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.339713 27338 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.380482 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.381860 32560 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.341132 32722 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.384137 32704 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.341769 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.386835 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:00.343820   304 log.cc:927] Time spent T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:00.346113 32346 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.349442 32706 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.388430 32706 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.350418   310 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.338702 32580 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.359511 32590 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.365370 32657 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:00.369990   309 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:00.408902 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 117433us
I20260709 13:11:00.411365 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.412138 27260 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:11:00.371085   307 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:11:00.371809 32765 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:11:00.372709   306 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:00.372561 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.373135 32644 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.374830 32140 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.376358 32286 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.376492 32662 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.405236 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.442773 27339 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:00.404291 27338 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.426198 32548 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:00.444543 32754 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:00.445017 32754 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.445379 32754 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:00.445442 32662 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.447952 32706 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:00.451771 32743 log.cc:927] Time spent T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.745s	user 0.005s	sys 0.000s
I20260709 13:11:00.452458   311 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:00.470283 32569 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.391431   310 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.473184   310 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.474213 32652 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:00.422569 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 167616us
I20260709 13:11:00.429272 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:00.517266 27308 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.433981 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:00.438520 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.440320 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.518715 27261 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
I20260709 13:11:00.475253 32401 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.478492 32688 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.413443 27383 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:00.520659 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 107282us
I20260709 13:11:00.481922 32569 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.485299 27416 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2481) took 1499 ms. Trace:
I20260709 13:11:00.488539 32599 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:00.491587 32711 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.478579 32357 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.491881 32617 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.409222 32683 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.506868 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.405354 32705 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.509275 27338 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.509891 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:00.584455 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:11:00.509698   320 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:00.338244 32766 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:11:00.503619 32644 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.511229   327 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:00.433640 32560 consensus_queue.cc:1059] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.078s
W20260709 13:11:00.512746 32757 log.cc:927] Time spent T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
I20260709 13:11:00.523669 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:00.527452 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.528648 27981 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:00.610508 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81992.5us
W20260709 13:11:00.535955 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 106750us
I20260709 13:11:00.571197 27261 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:00.572417 27335 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:00.525182 27416 rpcz_store.cc:276] 0709 13:10:58.986122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.986253 (+   131us) service_pool.cc:224] Handling call
0709 13:10:58.986568 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.112590 (+126022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.112623 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.113069 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.484427 (+1371358us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b180040dc80. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd827d94bc 00007fbd7fb2748b 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b 00007fbd827d0d23 00007fbd827d10d1
0709 13:11:00.484657 (+   230us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:00.484710 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.484809 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.484871 (+    62us) raft_consensus.cc:1685] finished
0709 13:11:00.484889 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.485202 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126605,"raft.queue_time_us":114434,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7187,"spinlock_wait_cycles":13687680,"thread_start_us":13275,"threads_started":1,"wal-append.queue_time_us":79625,"wal-append.run_cpu_time_us":1522,"wal-append.run_wall_time_us":1013458}
I20260709 13:11:00.583511   309 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:11:00.605660   328 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:11:00.531098 32584 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.531620 32140 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:00.635432 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.534073 32599 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:00.535184   310 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.637861 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 114270us
I20260709 13:11:00.654182 27268 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:00.654433 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.535043 32654 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.665386 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.633626 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.638865 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.668735 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.679893 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.630973   309 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.630481   316 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:00.634078 32584 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.683784 32752 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.705502 32711 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.686587 32249 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:00.707366 32749 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:00.681762 32140 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:00.707813 32749 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:00.708626 32749 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.709637 32749 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.714149 32357 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.718950 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:00.721369 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.722911 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.725421 27260 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:00.726612 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.688238 32683 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.688792   319 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.749333   319 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.750003 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:00.750860 32652 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.753739 32569 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:00.754290 32569 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.754700 32569 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.689618 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.776511 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:00.777266 27417 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:00.777623 27417 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:00.690410 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.781168 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:00.781880 27411 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.691112 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:00.602161 32705 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.696197 32730 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:00.697896 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.699416 32599 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.700335 32617 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.666452   310 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.701205 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.796931 27261 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.701591 32401 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.702659   305 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:11:00.631261 32760 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:00.733927 27260 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.735020 27264 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:00.786300 32683 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.737612 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:00.671257 32684 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:00.746609   332 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.741366 32439 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.747960 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.793792 32752 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.787448 27412 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 13: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:00.790580 27409 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:00.789422   319 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.748560 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:00.766155 32754 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.728098 32584 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.802295 32249 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.821213   310 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.809013 32580 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:00.821352 32249 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.822054 32754 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 21 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.823215 32684 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.704757   309 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:00.823594 32249 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.801085 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.778604 27417 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.800371 32644 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.827646 27417 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.630767   327 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.723559 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.823629 32684 raft_consensus.cc:493] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.828797 32684 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.829659   327 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:00.804672 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 67185us
I20260709 13:11:00.802735 32760 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.831983 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.835409 27414 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:00.838130   309 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.790218 32730 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:00.838192 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:11:00.792368 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.818670 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 70234.2us
I20260709 13:11:00.819974 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.798038 32140 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.815476   332 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.678638 32654 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.833631 32760 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.834466 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.854174 27409 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:00.855386 27409 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:00.855849 32654 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.839690 32730 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:00.856616 27259 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:00.857800 32249 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.857964 32753 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.840808 32764 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.858381 32249 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.860548 27409 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:00.790120 32548 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.805378 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.846722 27414 raft_consensus.cc:3060] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:00.887341 32548 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.816285 27411 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:11:00.889521 27411 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [11.10-14.11]
I20260709 13:11:00.819375 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.852398 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:00.847433   319 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:00.893769   323 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:00.894181   319 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.851904 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:00.897639 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.853312   332 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.898384 27267 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:00.899209 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:00.899696 27267 raft_consensus.cc:3060] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:00.858572 32753 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.901997 32753 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.861302 32249 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.850967 27261 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:11:00.889503 32548 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.905850 27981 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:11:00.905859 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73962.1us
I20260709 13:11:00.845157 27260 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:00.862008 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:00.892169 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 72869.9us
I20260709 13:11:00.896334   319 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.840811 27417 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:00.911425 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.912074 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.912467 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.913096 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.894202   323 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.913992   323 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:00.915309 32705 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.735833   316 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.919523 27265 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 17: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:00.920477 27980 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.921442 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:00.918421 27267 raft_consensus.cc:2468] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:11:00.892328 32140 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.925695 32140 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:00.925717 32569 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.928494   316 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.929060 32358 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:00.929589 32358 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:00.930817   323 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:00.931190 32358 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.933027   323 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:00.929361 32569 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:00.917313 32755 raft_consensus.cc:2804] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:00.940047 32755 raft_consensus.cc:697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:00.941316 32755 consensus_queue.cc:237] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.919414 32760 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:00.948166 32760 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.948630 32760 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:00.949469   325 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:11:00.949306 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:00.950178 27417 raft_consensus.cc:2393] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 18: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:11:00.951908 27233 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.131:34895 timed out after 1.607s (SENT) [suppressed 1 similar messages]
I20260709 13:11:00.952911 27981 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:00.954612 32728 raft_consensus.cc:2804] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:00.955346 32728 raft_consensus.cc:697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:00.956506 32728 consensus_queue.cc:237] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:00.964576 32617 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:00.965219 32617 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
W20260709 13:11:00.968840   333 log.cc:927] Time spent T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:11:00.972355 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 112738us
I20260709 13:11:00.972571 28014 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:00.973156 27309 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:00.917457   302 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.636s	user 0.002s	sys 0.000s
I20260709 13:11:00.973977 27264 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:00.982110 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.983954 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.985509 32599 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:00.985636 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.986512 28011 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:11:00.988761 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.989112 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.990679 32705 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:00.991133 32705 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:00.991559 32705 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:00.991876 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.990870 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:00.996397 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:01.011368 32720 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:01.026271 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.030573 32604 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.036947 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.838904 32683 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.050122 32730 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.054473 32730 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:01.057607   326 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.633s	user 0.003s	sys 0.000s
I20260709 13:11:01.059487 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:01.060509 27412 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 20. Current term is 21.
W20260709 13:11:01.061872   321 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.638s	user 0.004s	sys 0.000s
I20260709 13:11:01.063406 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 2483) took 1010 ms. Trace:
I20260709 13:11:01.063786 27415 rpcz_store.cc:276] 0709 13:11:00.053368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.054350 (+   982us) service_pool.cc:224] Handling call
0709 13:11:01.063244 (+1008894us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b540013c4d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:11:01.063351 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124284672}
I20260709 13:11:01.068274 28015 raft_consensus.cc:3060] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:01.073158 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 153456us
I20260709 13:11:01.077657 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:01.078470 27263 raft_consensus.cc:2368] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 20. Current term is 21.
I20260709 13:11:01.078926 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:00.842792 32584 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.080925 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:01.096060 27261 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:01.084834 27263 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:01.086014 27268 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:01.094055 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:00.893142   305 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:01.095207 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:01.098876 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 125810us
I20260709 13:11:01.116523 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.116669 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:00.966339 32617 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.099581 32686 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.092885 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:01.128062 27980 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 20. Current term is 21.
I20260709 13:11:01.128551 27980 leader_election.cc:403] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:11:01.128793 27262 raft_consensus.cc:2393] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 21: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:01.096302 28007 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:11:01.107849 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:01.099439 32764 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:01.137099 32764 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.139326 32764 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:01.117877 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.140450 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.142586 31647 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:01.087977 32140 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:11:01.125475 28009 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:01.100479   332 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:01.147897   332 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.148301   332 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.149441 31807 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:01.149937 31807 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:01.122802 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46060.1us
I20260709 13:11:01.151407 32686 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.151904 32686 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.152379 27981 leader_election.cc:400] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 20. Current term is 21.
I20260709 13:11:01.153849 32686 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.132720 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:01.157156 27340 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.157639 27340 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.136303 32548 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:01.136387   319 raft_consensus.cc:493] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:01.121737 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:01.163381 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 74601.8us
W20260709 13:11:01.164485 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 48088.7us
I20260709 13:11:01.165068 28015 raft_consensus.cc:2468] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 21.
W20260709 13:11:01.165131 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48520.2us
I20260709 13:11:01.167356 32401 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:01.180524 31807 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:01.150625 27159 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 131) took 25500 ms (client timeout 15000 ms). Trace:
I20260709 13:11:01.189816 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.190444 27337 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:11:01.194022 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.169950 32686 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:01.169744 32548 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.199345 31647 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.168848 27414 raft_consensus.cc:2468] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 11.
I20260709 13:11:01.203473 27380 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:01.216166 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.205569 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.214488 31647 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.218166 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.176517 32725 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 20. Current term is 21.
I20260709 13:11:01.130045   323 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:11:01.235993 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:01.235155 27338 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:11:01.240604 27338 pending_rounds.cc:85] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 11
I20260709 13:11:01.240914 27338 pending_rounds.cc:107] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:11:01.241197 27338 raft_consensus.cc:2889] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.241580 27338 pending_rounds.cc:107] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:11:01.241848 27338 raft_consensus.cc:2889] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.239210 28015 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:11:01.246497 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.247773 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.181782   319 raft_consensus.cc:515] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.204912 32590 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:01.219393 32548 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:01.267495 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:01.181988 32764 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:01.235509 32686 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:01.200001   305 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.275077 31647 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.238968 32286 raft_consensus.cc:2764] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:11:01.283489 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.330520 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 378611us
I20260709 13:11:01.236634 32749 raft_consensus.cc:2804] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:11:01.331283 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82804.9us
I20260709 13:11:01.349139 27415 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:01.357527 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:01.363582 27233 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.364246 31647 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:01.349306 27340 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.269474 32140 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:11:01.368423 32756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.047s	sys 0.094s
I20260709 13:11:01.372870 31647 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.370718 27335 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:01.321353   335 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.502s	user 0.000s	sys 0.001s
I20260709 13:11:01.373457 31647 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.312075 32580 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.237206 32705 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.380157 27340 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.343276 32605 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.384337 27415 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:01.384730 27414 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:11:01.374577 32756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.048s	sys 0.095s
I20260709 13:11:01.386814 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.252552 32469 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
I20260709 13:11:01.387312 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.388916 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.310663 32590 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.390512 27161 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.389513 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.373314 32140 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:01.377677 32749 raft_consensus.cc:697] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:01.404306 31647 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.408191 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:01.401880 32684 consensus_meta.cc:287] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.002s
I20260709 13:11:01.410791 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.408942 27411 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:11:01.416000 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.416625 27414 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:01.410389 27161 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 6 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.417443 27978 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:01.412559 27259 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:01.419083 27161 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 7, leader changed from <none> to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:01.420814 32750 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:01.421239 32750 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:01.421620 32750 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.419093 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.422011 32760 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.423331 32220 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:01.423892   323 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:01.425187 27306 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:01.426759 32704 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:01.427141 32704 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:01.427511 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:01.427940 27306 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.428660   323 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:01.425282 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:01.425678 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:01.429842 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.430227 28012 raft_consensus.cc:3055] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:01.430545   323 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:01.430606 28012 raft_consensus.cc:740] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:01.431598 28012 consensus_queue.cc:260] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.432075 27306 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.432650 28012 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.425807 32720 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.434983   323 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:01.422535 27161 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 9, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 9 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.435472 32720 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.437038 27161 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 8, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.416649   319 leader_election.cc:290] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.438153 32750 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.440284   305 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.440514 32590 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.441020 32654 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.441499 32654 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.441967 32749 consensus_queue.cc:237] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.443331 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.447680 32140 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.445581 32683 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.448073 27414 raft_consensus.cc:2410] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:01.449136 32140 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.377231 32688 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:01.448029 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:01.442950 27161 catalog_manager.cc:5697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 10, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 10 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.466385 27410 raft_consensus.cc:2393] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
W20260709 13:11:01.457553 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 267587us
I20260709 13:11:01.473887 27161 catalog_manager.cc:5697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.476852 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:01.382637 32580 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.473065 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.408599 32584 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.489114 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:01.479509 27161 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 4 to 8, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 8 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:01.397583 32605 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.427521 32704 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:01.523248 27161 catalog_manager.cc:5697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 6, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 6 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:01.524863 27338 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:01.525861 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.526549 27339 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:01.526839 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.527428 27340 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:11:01.527894 27339 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:01.528205 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.528728 27340 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:01.529423 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.528760 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:01.529711 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.530176 27339 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:01.530272 27340 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:01.531148 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:01.487344 32358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.013s
I20260709 13:11:01.475229 32469 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:11:01.474846 32683 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:11:01.457379 32684 raft_consensus.cc:515] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:01.572824 32358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.004s	sys 0.014s
I20260709 13:11:01.553530   323 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:01.553835   319 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:01.465579 32686 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.554768   332 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.559674 32569 consensus_queue.cc:1059] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:01.591210 32469 consensus_queue.cc:1243] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:01.620589   319 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:01.632611   342 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:01.633236   342 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.633280   319 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.634205   332 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.635128 32580 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.635571   342 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.635689 32760 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.636906 32684 leader_election.cc:290] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.610896   323 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.649279 32705 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.659010 32683 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:01.670317 32750 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.675352 32683 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:01.692811 32704 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:01.676429 32683 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.716063 32683 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:01.719622   340 log.cc:927] Time spent T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:11:01.704176 32605 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.763310 32548 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.765620 32548 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.769394   323 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:01.757597 32704 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.836537 32720 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:01.862757   346 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.091s	user 0.003s	sys 0.000s
I20260709 13:11:01.913978 32688 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:01.914538 32688 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:01.915410 32688 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.916810 32688 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:01.918454 27409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.001s	sys 0.039s
W20260709 13:11:01.918740 27409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.001s	sys 0.039s
I20260709 13:11:01.931082 32654 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.956456   309 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:01.964313 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.965691 32749 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:01.966212 32749 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.968303 32749 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:01.973764 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.975476 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:01.976133 27342 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:01.978451 32753 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:01.978914 32753 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:01.979703 32753 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.981582 32753 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:01.981756 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.001s	sys 0.021s
W20260709 13:11:01.982124 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.001s	sys 0.021s
W20260709 13:11:01.982363 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 504447us
I20260709 13:11:01.983104 27233 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:01.983829 32469 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:01.984174 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:01.984831 32469 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:01.984874 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:01.985319 32469 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.985620   309 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:01.985792 32469 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:01.986052   309 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.986497   309 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:01.993276 32469 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:01.994555   337 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 13:11:01.995844 32469 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:01.995674   309 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:01.997998   309 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:02.002894   352 log.cc:927] Time spent T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
W20260709 13:11:02.004166 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.004453   351 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.232s	user 0.001s	sys 0.002s
W20260709 13:11:02.005017 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.005620 27306 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.008059 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.009220 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.010257 27233 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.010511 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.011586 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.012642 32654 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:02.011200 27409 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.020269 27409 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:02.021358 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.021684 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:11:02.022022 27409 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:02.022907 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.023537 27233 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.023568 27409 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.024587 32654 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:02.025193 32654 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:02.026095 32654 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:01.188334 27159 rpcz_store.cc:269] 0709 13:10:35.650536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.651390 (+   854us) service_pool.cc:224] Handling call
0709 13:10:35.837232 (+185842us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:01.150521 (+25313289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:57.409255 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:57.416165 (+  6910us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:57.416213 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:57.416231 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:57.477983 (+ 61752us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:57.543288 (+ 65305us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:57.543342 (+    54us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:10:57.544688 (+  1346us) tablet.cc:701] Row locks acquired
0709 13:10:57.544749 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:10:57.544926 (+   177us) write_op.cc:270] Start()
0709 13:10:57.545082 (+   156us) write_op.cc:276] Timestamp: P: 1783602657544856 usec, L: 0
0709 13:10:57.545119 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:10:57.592278 (+ 47159us) log.cc:844] Serialized 6394 byte log entry
0709 13:10:57.664425 (+ 72147us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd7fb270ac 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb43c02 00007fbd827cb20b
0709 13:10:58.281680 (+617255us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003250c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:10:58.281998 (+   318us) op_driver.cc:464] REPLICATION: finished
0709 13:10:58.400205 (+118207us) write_op.cc:301] APPLY: starting
0709 13:10:58.400296 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:58.416712 (+ 16416us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:58.416783 (+    71us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:59.217362 (+800579us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:59.217749 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:10:59.217810 (+    61us) write_op.cc:312] APPLY: finished
0709 13:10:59.218747 (+   937us) log.cc:844] Serialized 148 byte log entry
0709 13:10:59.219762 (+  1015us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:59.219939 (+   177us) write_op.cc:454] Released schema lock
0709 13:10:59.220018 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:59.286501 (+ 66483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:59.289355 (+  2854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2160793,"reported_tablets":26,"spinlock_wait_cycles":21360512,"child_traces":[["op",{"apply.queue_time_us":113086,"apply.run_cpu_time_us":29366,"apply.run_wall_time_us":836862,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":509133,"prepare.run_cpu_time_us":17798,"prepare.run_wall_time_us":334214,"raft.queue_time_us":179747,"raft.run_cpu_time_us":46609,"raft.run_wall_time_us":79370,"replication_time_us":736727,"spinlock_wait_cycles":36091008,"thread_start_us":765853,"threads_started":4,"wal-append.queue_time_us":227082,"wal-append.run_cpu_time_us":34225,"wal-append.run_wall_time_us":2398466}]]}
I20260709 13:11:02.029932 27409 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:02.030051 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.031404 32654 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:02.031584   309 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.031831 32654 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.032162   309 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.032363 32654 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.034060 32469 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.034335   309 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.034662 32469 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.040103 32469 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.040477 32654 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.042464 32439 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.042846 32654 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.043018 32439 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.045042 32439 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.045346   303 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.045943   303 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:02.047540 27308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.009s	sys 0.020s
W20260709 13:11:02.047860 27308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.009s	sys 0.020s
I20260709 13:11:02.050741   303 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.051232 32704 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.052083 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.052235 32704 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.052850 32439 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.054528 32704 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:02.057165 27339 consensus_meta.cc:287] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:11:02.057492 27339 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:02.060590 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.061259 27409 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 11.
I20260709 13:11:02.061367 31647 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.061944 31647 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.062209 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.062813 27409 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.063951 31647 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.069537 27409 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:02.070570 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.071261 27409 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
W20260709 13:11:02.075955 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.076581 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.076489 27233 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.077837 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.078588 32469 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:02.079190 32469 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:02.079692 32720 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:02.080235 32720 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.080137 32469 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.080708 32720 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:02.087438 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.087826 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.088500 27411 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14.
I20260709 13:11:02.088625 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.089178 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.089596 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.090185 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.090852 27411 raft_consensus.cc:2368] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:11:02.091084 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f872873b55df4f2ab953481b0bbe5229" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.091954 28009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.092536 27411 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:02.093613 28015 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:02.095562   303 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:02.095834 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.096459 27409 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.097839 27340 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:02.100121 27337 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 15: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:02.101832 27417 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:02.102264 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.102773 27409 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:02.104854 28014 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.106184 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55768 (request call id 693) took 1124 ms. Trace:
I20260709 13:11:02.106509 28014 rpcz_store.cc:276] 0709 13:11:00.981372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.055145 (+ 73773us) service_pool.cc:224] Handling call
0709 13:11:01.055526 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.105251 (+1049725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.105971 (+   720us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540043bcd4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:02.106127 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412813568}
I20260709 13:11:02.103072 27341 raft_consensus.cc:2410] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:11:02.108263 27161 catalog_manager.cc:5697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 7, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.108548 32720 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.109596 27161 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:02.110260 32720 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.111398 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.111677 27161 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:02.115449 27232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.007s	sys 0.014s
W20260709 13:11:02.115790 27232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.007s	sys 0.014s
I20260709 13:11:02.117949 27341 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:02.118695 27337 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.120087 27339 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:02.121793 27341 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:11:02.122133 27341 pending_rounds.cc:85] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:11:02.122350 27341 pending_rounds.cc:107] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:11:02.122560 27341 raft_consensus.cc:2889] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.123518 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.123930 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.124614 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.124027 27341 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:02.125229 28012 consensus_meta.cc:287] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.005s
I20260709 13:11:02.125182 27334 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:02.126111 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.127084 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.127714 27262 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:11:02.128271 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.127117 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.128912 27334 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:02.129313 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.129633 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.129829 27337 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.131640 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.132048 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.132246 27262 raft_consensus.cc:2468] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:11:02.132617 27409 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:02.133565 27267 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:11:02.133814 27233 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.134729 32654 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:02.135336 32654 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:02.136041 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.134938 27334 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.137329 27338 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:11:02.138980 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.136240 32654 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.142275 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.142979 27267 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 17: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:02.143784 27341 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:02.144086 27262 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 13:11:02.144558 27412 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.052s	sys 0.078s
W20260709 13:11:02.144862 27412 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.053s	sys 0.078s
I20260709 13:11:02.145038 27341 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:11:02.145344 27341 pending_rounds.cc:85] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 6
I20260709 13:11:02.145403 27268 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:02.145685 27341 pending_rounds.cc:107] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:11:02.146016 27341 raft_consensus.cc:2889] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.150224 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.153151   303 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:02.153716   303 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.125231 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.165418 28012 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:02.171656 27259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48160 (request call id 836) took 1191 ms. Trace:
I20260709 13:11:02.172113 27259 rpcz_store.cc:276] 0709 13:11:00.980462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.036583 (+ 56121us) service_pool.cc:224] Handling call
0709 13:11:02.171497 (+1134914us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54001f77d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:11:02.171599 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861850880}
I20260709 13:11:02.176687 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.177350 27259 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.147032 27337 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:02.182930 27340 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:02.184875 27308 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.189276 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.190514 27308 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14.
I20260709 13:11:02.190858 27308 leader_election.cc:403] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.191741 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.192520 27264 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:11:02.192663 27308 leader_election.cc:400] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:11:02.193168 27308 leader_election.cc:403] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.197145 27259 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
W20260709 13:11:02.197779 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.198520 27306 leader_election.cc:304] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.200055 27336 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:11:02.200421 27336 pending_rounds.cc:85] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 9
I20260709 13:11:02.200641 27336 pending_rounds.cc:107] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:11:02.200887 27336 raft_consensus.cc:2889] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.201185 27336 pending_rounds.cc:107] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:11:02.201417 27336 raft_consensus.cc:2889] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.204231 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.198896 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.204684 27306 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:02.207816 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.208788 28008 raft_consensus.cc:2393] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 12: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:11:02.208767 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.216694 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:02.217908 27268 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:02.228574 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.229192 27334 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:02.233088 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.233870 27268 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
W20260709 13:11:02.234637 27231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.014s	sys 0.018s
W20260709 13:11:02.235116 27231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.014s	sys 0.018s
W20260709 13:11:02.236152 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 721511us
I20260709 13:11:02.236984 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.238029 27268 raft_consensus.cc:3060] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.239413 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.239946 27340 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:02.242690 28007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.006s	sys 0.016s
W20260709 13:11:02.243041 28007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.006s	sys 0.016s
I20260709 13:11:02.243458 28008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.244567 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.244810 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.245625 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.245970 28012 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:02.246075 28007 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:02.244863 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.249675 32617 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.254084 28007 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:02.255877 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.245168 32604 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.257143 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.257285 32604 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.258193 32286 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:02.258692 32286 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:02.259965 32286 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.245347 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.245445 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.261442 27340 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:02.258213 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.260489   342 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14.
I20260709 13:11:02.264271 28010 raft_consensus.cc:2376] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19. Re-sending same reply.
I20260709 13:11:02.268155 27341 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 18: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:02.264837 28012 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:02.264932 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.265741 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.269371 27337 raft_consensus.cc:2393] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 18: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:02.269289 27264 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:02.263285 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.272336 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.274834 27264 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.238513   323 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:02.288893 27264 raft_consensus.cc:1275] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:02.289927 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.292388 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.293905 27268 raft_consensus.cc:2468] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:02.294899 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.296860 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.301321   323 raft_consensus.cc:2749] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.310993   353 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:02.301877   342 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:11:02.308861 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.312602   353 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.313076   342 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:02.313597   342 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:02.312927 32763 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:02.317875 32763 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:02.319550 27264 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:11:02.319450 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.320242 27416 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:02.320133 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.323325 27261 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:11:02.323688 27261 pending_rounds.cc:85] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 10
I20260709 13:11:02.323421 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.323937 27261 pending_rounds.cc:107] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:11:02.324263 27261 raft_consensus.cc:2889] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.325287 27265 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:02.326179 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.327121 27309 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.328900 27981 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:02.336495 27308 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.339577 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.340266 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.340497 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.341199 27267 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14.
I20260709 13:11:02.314491   342 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.342842 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf4fb4f20e74427f86180930e86a7afc" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.343629 27261 raft_consensus.cc:2393] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:11:02.344637 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.345450 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.346067 27264 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:02.346496 27263 raft_consensus.cc:2368] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
I20260709 13:11:02.351068 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:02.356426 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 139763us
I20260709 13:11:02.358606 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.315009   353 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.341025 32140 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.312616   323 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:11:02.366065 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71254.3us
I20260709 13:11:02.362864 27309 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14.
I20260709 13:11:02.355533 32725 raft_consensus.cc:2764] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:11:02.346331 32604 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.356863 32704 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.360459 32717 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:11:02.374063 32717 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:02.374502   353 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.375461 32604 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:11:02.379663   323 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:02.380740   323 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.382294 32763 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.382735 32763 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:02.367473 32140 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.385743 32140 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.387792 32654 raft_consensus.cc:2764] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:11:02.388538 32654 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.388936 32654 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.389338 32654 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.367101 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:02.375381 28011 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:02.395210 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.370431 27309 leader_election.cc:304] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:02.420943 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53932.8us
I20260709 13:11:02.423050 27231 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:02.434468 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.383121 32763 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.396881 32704 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.445310 32704 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:02.413163 32249 raft_consensus.cc:2749] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:02.462599   303 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:02.419251 32604 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:11:02.468811 32604 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:02.469229 32604 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.469359 27414 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:02.469646 32604 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.464591 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.471843 27260 raft_consensus.cc:2368] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13.
I20260709 13:11:02.473438 27981 leader_election.cc:400] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13.
I20260709 13:11:02.473798 27981 leader_election.cc:403] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.474385 32462 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13.
I20260709 13:11:02.475945   303 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:02.482512   375 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:02.489776   375 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.490353   375 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.491641   374 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.492242   374 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.494650   374 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.495136   374 raft_consensus.cc:493] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.501979   374 raft_consensus.cc:515] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.499141 32763 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.502319 32604 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.504136   374 leader_election.cc:290] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.504412 32763 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:02.504725 32548 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:02.501426   375 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.505368 32548 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.459080 32654 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.509105 32654 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.510613 32654 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:02.476506 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.487076   377 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:02.512526 27413 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 2517) took 1024 ms. Trace:
I20260709 13:11:02.512882 27413 rpcz_store.cc:276] 0709 13:11:01.488307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.489393 (+  1086us) service_pool.cc:224] Handling call
0709 13:11:02.512461 (+1023068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:02.487308 31647 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:02.515237 31647 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.515775 31647 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.518558   345 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.518882 31647 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.500591 32683 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.523039 32683 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.523571 32683 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.523236   345 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.524668 28011 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 697) took 1537 ms. Trace:
I20260709 13:11:02.525038 28011 rpcz_store.cc:276] 0709 13:11:00.987648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.990563 (+  2915us) service_pool.cc:224] Handling call
0709 13:11:02.524488 (+1533925us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400601654. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:11:02.524591 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3175340928}
I20260709 13:11:02.525480   345 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.527791 32548 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.374976   353 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.530565 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56234 (request call id 2518) took 1041 ms. Trace:
I20260709 13:11:02.531107 27414 rpcz_store.cc:276] 0709 13:11:01.488667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.488781 (+   114us) service_pool.cc:224] Handling call
0709 13:11:02.530417 (+1041636us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54003c2b54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:11:02.530506 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200324992}
I20260709 13:11:02.526161 32704 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:02.536115 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 101770us
I20260709 13:11:02.536594 27266 raft_consensus.cc:1240] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:11:02.536991 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.538319 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:02.540066 32249 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:02.540781 32249 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:02.541110 32249 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.541440 32249 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.544349 31807 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:02.544770 31807 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.545084 31807 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:02.527791 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.545791 27339 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.553439 32249 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.555840 27336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 846) took 1101 ms. Trace:
I20260709 13:11:02.620253 27336 rpcz_store.cc:276] 0709 13:11:01.454285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.458985 (+  4700us) service_pool.cc:224] Handling call
0709 13:11:01.471826 (+ 12841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:02.201861 (+730035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.555586 (+353725us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54001fc054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:02.555786 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673988352}
I20260709 13:11:02.556036 27413 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.557070 27414 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:11:02.580518 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 222025us
I20260709 13:11:02.538656 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:02.622013 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 83436.6us
I20260709 13:11:02.589821 31807 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.622808 27309 leader_election.cc:400] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 12. Current term is 13.
W20260709 13:11:02.591292 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.592724 27338 raft_consensus.cc:1275] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:02.595220 27266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2832) took 1445 ms. Trace:
I20260709 13:11:02.511068 32654 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:02.597909 27416 raft_consensus.cc:1240] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:02.530735   353 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.601935 27410 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:02.617414 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.625684 27266 rpcz_store.cc:276] 0709 13:11:01.093886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.094018 (+   132us) service_pool.cc:224] Handling call
0709 13:11:01.100141 (+  6123us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.537042 (+1436901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.538936 (+  1894us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540024c7d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:02.539114 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303001856}
I20260709 13:11:02.635484 27416 raft_consensus.cc:1275] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:11:02.622339 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.641463 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:02.643246 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 220271us
I20260709 13:11:02.644330 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.598531 32683 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.663501 32683 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.639055 32401 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:02.651249   353 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.650755 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.652653 32705 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.665056   353 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.664985 32705 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.666546 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.653136 32654 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.654219 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.655006 32704 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.649708 32286 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:02.653182 32630 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:11:02.619661   327 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:02.658381   383 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:02.658931   387 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:02.698035   383 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:02.698132   327 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.660588 32249 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.668299 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:02.671447 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 339902us
I20260709 13:11:02.700444   327 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.698035 32755 consensus_queue.cc:1048] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
W20260709 13:11:02.685644 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 46631.6us
I20260709 13:11:02.695755 32286 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.704226 31807 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.705233 32286 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.706331 27980 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.707108 32761 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:02.690207 32750 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:02.708043 32750 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.709031 32688 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:02.709410 32688 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:02.710085 32750 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:02.711978 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.712862 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44624.8us
I20260709 13:11:02.713543 32469 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:02.710390 32761 consensus_queue.cc:1048] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:11:02.686834 27411 raft_consensus.cc:2368] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13.
I20260709 13:11:02.718189 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.718426 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.719832 32704 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:02.658951 27380 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.687391   353 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:02.699041   383 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.710171 32688 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.720006 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.721379 31807 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:02.680020 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:02.504413 32604 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.722304 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:02.667214 32764 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:02.755558 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.725189 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 66294.9us
I20260709 13:11:02.736954 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.756752 27414 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:02.756752 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:02.739081 27415 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.739988 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:02.741742 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.758682 27417 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.759253 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.745407 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.762766 27339 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: [12.7-16.9]
I20260709 13:11:02.766629 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.768033 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.769191 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.771127 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b64b3a0d3c44ff1893b67152ebe2c50" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.772042 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.772605 27334 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:02.774271 27417 raft_consensus.cc:2410] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:11:02.776654 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.722328 32469 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:02.784031 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.788147 27339 raft_consensus.cc:1240] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
W20260709 13:11:02.789415 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 49492.9us
I20260709 13:11:02.791654 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.792502 27337 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 12: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:02.793426 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.794586 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.797374 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.774120 28012 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:02.748942 32749 raft_consensus.cc:2804] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:02.744946 32705 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:02.801930 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:02.758338 32764 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.712558 32358 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:11:02.804886 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.805510 27408 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:02.806244 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.806710 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.797765 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.824524 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:02.798559 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.782600   387 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:02.844530 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:02.831072 31807 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:02.847223 27408 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:02.788699 32630 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:02.849586 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.849764 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.850562 31807 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:02.848088 27380 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.851101 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.852131 27383 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:02.855916 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.800010 32688 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:02.858139 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:02.858786 27342 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.860302 31807 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.841485 32764 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:02.839962   374 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.840072   323 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:02.844208 32749 raft_consensus.cc:697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:02.829084   395 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:02.877696 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.862167 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:02.880542   389 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:11:02.880223 32469 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:02.877169 32140 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:02.892491 27334 raft_consensus.cc:2468] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:02.893270 27339 raft_consensus.cc:1240] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:02.894968 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.895838 27259 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:02.896297 27342 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:11:02.901783 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.903861 27268 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.904315 27260 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:02.906054 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:02.907805 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:02.908167 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.909565 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.862159 32763 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:02.896863 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:02.868525 32755 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:02.887190   323 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.927734   323 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:02.883452   374 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.930528   374 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:02.931365 32749 consensus_queue.cc:237] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:02.893788   394 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:02.895269 32605 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:02.899739   376 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:02.954618   376 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:02.968863   376 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:02.974124 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 126098us
I20260709 13:11:02.975816 27380 leader_election.cc:304] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:02.977617 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:02.980726 27417 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:02.982798 27414 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:02.992676 27343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49416 (request call id 845) took 1551 ms. Trace:
I20260709 13:11:02.993466 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:02.994115 28007 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:02.996877 27380 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:02.993171 27343 rpcz_store.cc:276] 0709 13:11:01.441380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.453220 (+ 11840us) service_pool.cc:224] Handling call
0709 13:11:01.474203 (+ 20983us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.474601 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:11:02.557405 (+1082804us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18004c75c0. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb26e07 00007fbd88981ab9 00007fbd7fb4369b 00007fbd7fb4193f 00007fbd7fb41455 00007fbd866293c7 00007fbd82c3b9a7 00007fbd82c4b0bf 00007fbd82c4b038
0709 13:11:02.750279 (+192874us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.848489 (+ 98210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.851839 (+  3350us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.852057 (+   218us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:11:02.852351 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.866243 (+ 13892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.871732 (+  5489us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.992360 (+120628us) raft_consensus.cc:1685] finished
0709 13:11:02.992393 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.992597 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18312,"prepare.queue_time_us":563601,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":6737,"raft.queue_time_us":20830,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":44447,"spinlock_wait_cycles":20855936,"thread_start_us":285172,"threads_started":2,"wal-append.queue_time_us":163578}
W20260709 13:11:03.000741 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 148689us
I20260709 13:11:03.004369 27338 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.002154 32688 consensus_queue.cc:1059] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:11:03.006152 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:03.006822 28007 raft_consensus.cc:606] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:03.009418 27414 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:03.011029 32705 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:02.953902   394 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.012087 27414 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:03.012732 27414 raft_consensus.cc:606] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:03.013060 27414 raft_consensus.cc:614] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:03.013684   394 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.019150 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.041848 27309 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.048254 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.051126 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.002221   377 raft_consensus.cc:2749] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.055153 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.055593 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:03.059422 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.002660 32249 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:11:03.061766 27260 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:03.062722 31807 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.053236 32763 raft_consensus.cc:2804] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:03.018529   343 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:11:03.056042   319 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.057276   379 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.075794 27266 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:11:03.063225 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:03.068559 32630 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.091914 27309 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.094630 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:03.098836 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d14940356a45ada8e16731853b8769"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:03.100859 28007 raft_consensus.cc:606] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:03.060007 32286 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:03.060263   342 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:03.073527   377 raft_consensus.cc:3055] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:03.104272 27980 leader_election.cc:400] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 12 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13.
I20260709 13:11:03.104631 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.114841 32763 raft_consensus.cc:697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.108855 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.116021   343 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.116866 32763 consensus_queue.cc:237] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.119593 32630 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:03.109624 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53791.1us
I20260709 13:11:03.140642   407 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.140745 32749 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:03.142645 32749 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:03.143023 32749 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.096906 32249 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:03.145416 31807 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:03.145452 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:03.157971 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 131258us
I20260709 13:11:03.162585 28010 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:03.120873   379 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.121899   377 raft_consensus.cc:740] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.186391 27383 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:03.203850 27383 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:03.210387 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800061360 after lost signal to thread 26161
W20260709 13:11:03.211678 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7740 after lost signal to thread 27200
W20260709 13:11:03.213066 28036 debug-util.cc:398] Leaking SignalData structure 0x7b080010cec0 after lost signal to thread 27292
W20260709 13:11:03.213372 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed680 after lost signal to thread 27293
W20260709 13:11:03.214696 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800240b40 after lost signal to thread 27367
W20260709 13:11:03.214983 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1c80 after lost signal to thread 27368
W20260709 13:11:03.222494 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800387d80 after lost signal to thread 27441
W20260709 13:11:03.222891 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08003389c0 after lost signal to thread 27442
W20260709 13:11:03.224346 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800228a20 after lost signal to thread 28039
W20260709 13:11:03.224720 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08003885a0 after lost signal to thread 28040
I20260709 13:11:03.227882 32749 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:03.267854 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 116941us
W20260709 13:11:03.242070   405 log.cc:927] Time spent T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.135s	user 0.000s	sys 0.004s
I20260709 13:11:03.232638   418 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:03.220361   303 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:11:03.205047   425 consensus_queue.cc:1048] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:11:03.255446 32617 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:03.292433 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 147032us
I20260709 13:11:03.285532 32401 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:03.292805   411 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.255721   377 consensus_queue.cc:260] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.327409   377 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.118340   343 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:03.141569   407 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:03.340147 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 136401us
I20260709 13:11:03.295073   376 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.333760 32401 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.339066   379 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.353996   379 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.354615 32401 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:03.343113   343 consensus_queue.cc:1243] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:03.345940   407 consensus_queue.cc:1243] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:03.344909 32749 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:03.366201 27383 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:03.336098   429 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:11:03.375253 27417 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.374354 32749 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.378545 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.388270   376 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:03.397547 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:03.381683   424 log.cc:927] Time spent T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:11:03.398569 27266 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:03.402179 32401 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.404505   417 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:11:03.404866 32401 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:03.406392   421 log.cc:927] Time spent T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:11:03.407460 32401 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:03.407594   423 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:11:03.373495   425 consensus_queue.cc:1059] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:03.412395 27383 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:03.413048 27416 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:11:03.404506 32764 consensus_meta.cc:287] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.002s
I20260709 13:11:03.383855   342 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:03.426163 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.427198 27417 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:03.431810   427 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:03.432363   427 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.432754   427 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.427217 32630 raft_consensus.cc:3055] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:03.435367   332 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:03.422777 32764 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.449051 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:03.437913   379 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.438199 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.454881 27413 raft_consensus.cc:2410] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:11:03.440107 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:03.453539   332 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.472919   332 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:03.451663   342 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:03.474632   342 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:03.475632   342 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.476979   342 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:03.484458   414 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.344s	user 0.006s	sys 0.008s
W20260709 13:11:03.491863 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 98871us
I20260709 13:11:03.492302   374 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.492691   374 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.493539   374 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.494303 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:03.444278 27411 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:03.449914 32630 raft_consensus.cc:740] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.502177 32630 consensus_queue.cc:260] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:03.503662   388 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.616s	user 0.000s	sys 0.003s
I20260709 13:11:03.505486 27408 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:03.506675 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.506879 32720 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:03.469637 27415 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 16: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:03.508819 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:03.509923 27266 raft_consensus.cc:1240] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:03.509569 27413 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:03.510717 27264 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:03.511536 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:03.512300 27259 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:03.494885   374 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.516656 28010 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:03.529978 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:03.470799 32764 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:03.462517 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:03.534047 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:03.534117 27267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48160 (request call id 851) took 1121 ms. Trace:
W20260709 13:11:03.534390 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 72013.3us
I20260709 13:11:03.501179   440 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:03.530944 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.534729 27267 rpcz_store.cc:276] 0709 13:11:02.412916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.413057 (+   141us) service_pool.cc:224] Handling call
0709 13:11:02.413456 (+   399us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:02.420726 (+  7270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.420771 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:02.421495 (+   724us) log.cc:844] Serialized 52 byte log entry
0709 13:11:02.639376 (+217881us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:02.688295 (+ 48919us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.697215 (+  8920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.697279 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.503049 (+805770us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:11:03.507444 (+  4395us) raft_consensus.cc:1685] finished
0709 13:11:03.533839 (+ 26395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.534027 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6727,"prepare.queue_time_us":48750,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":103128,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":177,"spinlock_wait_cycles":10376960,"thread_start_us":190948,"threads_started":1,"wal-append.queue_time_us":343023}
I20260709 13:11:03.544817 27267 raft_consensus.cc:1217] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Deduplicated request from leader. Original: 12.7->[13.8-14.9]   Dedup: 13.8->[14.9-14.9]
I20260709 13:11:03.546028 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.547467 27268 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:11:03.548674 31807 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:03.549463 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 109457us
I20260709 13:11:03.504132 32630 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.550496 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.551889 27413 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:03.551971 27231 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.553736 27267 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 13:11:03.556448 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.529467 32720 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.562986 32401 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:03.507055   392 consensus_queue.cc:1059] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:11:03.539388   323 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:03.574678 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63226.9us
I20260709 13:11:03.583460 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.558107 32683 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:03.561138   353 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:03.560097   309 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.570585 32720 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.546439   390 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:11:03.538552   408 consensus_queue.cc:1059] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:03.549074   377 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:11:03.610702 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.547207   440 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.580479   323 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.588994 32683 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.613507   349 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:03.627841 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.614758   345 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.616631   353 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:03.629539   394 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.614930   392 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:11:03.656795 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 100613us
I20260709 13:11:03.656013 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.636442 32683 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.632792   323 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:03.682931   425 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.683625   425 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.679759   431 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:03.687835   431 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.690471   431 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.691740   425 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.699119   382 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.699827   382 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.696905 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:03.700987 28010 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:11:03.700657   427 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.700264 32753 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:03.701817 32753 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:03.702734 32753 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.662413   381 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:03.709600 27382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.730711 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.730971 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:03.737242 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:11:03.737876 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:03.738904 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:03.739077 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.739796 27336 raft_consensus.cc:2393] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:11:03.740340   445 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:11:03.742750 31807 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:03.724480 32688 raft_consensus.cc:3055] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:03.743558 32688 raft_consensus.cc:740] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:03.743299 31807 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.744407 32688 consensus_queue.cc:260] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.745464 31807 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.745669 32688 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:03.746040 31807 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:03.746765 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:03.747625   409 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.657s	user 0.001s	sys 0.001s
I20260709 13:11:03.709373   377 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.748651   342 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:11:03.723817 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 214760us
I20260709 13:11:03.750329 32654 raft_consensus.cc:3055] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:03.750667 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:03.730484 32140 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:03.753727   408 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:11:03.703994   386 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.821s	user 0.004s	sys 0.001s
I20260709 13:11:03.754166   408 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.754552   408 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.726920 32401 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:03.748549   377 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.704541   353 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.758096   377 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:03.731491 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.759755 27334 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:03.759814 32286 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:03.752213   379 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:03.760701   379 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:03.705753   440 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:03.750794 32654 raft_consensus.cc:740] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:03.761561   379 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:03.722028   412 log.cc:927] Time spent T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.609s	user 0.000s	sys 0.003s
I20260709 13:11:03.762030 32654 consensus_queue.cc:260] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.763372 32654 raft_consensus.cc:3060] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:03.763595 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:03.765091 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:03.729712 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:03.704924   382 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:03.755417 32401 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.787119 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.753582 32140 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.790397 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.791567 27306 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.792743 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:03.793006 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 137076us
I20260709 13:11:03.760444 32286 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:03.725585 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:03.794852 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:03.795495 27263 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.726646 32753 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:03.767197 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:03.737455 27342 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 18
I20260709 13:11:03.782447 32705 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:11:03.787971 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51090us
I20260709 13:11:03.788493 27268 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:11:03.827837 27268 pending_rounds.cc:85] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:11:03.827698 32705 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.790032   379 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:03.793816 27231 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:03.789403 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.829641   320 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:03.830130   320 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:03.830282 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:03.830940   320 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.828344 27268 pending_rounds.cc:107] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:11:03.832587 27268 raft_consensus.cc:2889] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:03.857282 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 65779.3us
I20260709 13:11:03.790480   319 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:03.703121   427 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:03.862681 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 95583.4us
I20260709 13:11:03.868322 31807 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:03.862170 27342 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
W20260709 13:11:03.796799   383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.016s	sys 0.027s
W20260709 13:11:03.876430 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 77573.1us
I20260709 13:11:03.883836 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:03.886143 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.888108 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.889263 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:03.889487 27343 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:03.892308 27336 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:03.892803 27338 raft_consensus.cc:1275] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:03.893959 27343 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:03.832617   395 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:03.796690   381 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:03.858879 32249 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:03.939548 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:03.940793 27335 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:03.928820 28011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
W20260709 13:11:03.898591   383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.016s	sys 0.027s
I20260709 13:11:03.945590 28011 raft_consensus.cc:606] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:03.945963 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 356966us
I20260709 13:11:03.953094 28011 raft_consensus.cc:614] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:03.874497   394 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:03.956197 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 72486.7us
I20260709 13:11:03.956957 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:03.957403 27263 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:03.891088   343 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.940356   386 log.cc:927] Time spent T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:11:03.959942 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65230.1us
I20260709 13:11:03.960964 28010 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:11:03.960683   398 log.cc:927] Time spent T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:03.980358 32401 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.981837 28007 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:03.988417 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:03.981212 32718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.006s	sys 0.015s
I20260709 13:11:03.972788   418 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:03.994438 32630 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:11:04.003906 32718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.006s	sys 0.015s
I20260709 13:11:03.976289   343 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:03.974488   381 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.004973 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:03.995468   451 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:04.010982   381 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.012362   343 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:03.997689 32763 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:04.006563 32630 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.021773 32630 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:04.022352 32683 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.039420 32683 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:03.975906   394 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.033289   430 raft_consensus.cc:993] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:04.047926   430 raft_consensus.cc:1081] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:04.048575   383 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:04.037549 27264 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:04.037211 32654 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:04.049338   383 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:04.026403 32720 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.050242   383 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.052490 32720 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.060370   394 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.060612 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:04.060876 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:04.060609 32630 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.063030 27337 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:11:04.063400 27337 pending_rounds.cc:85] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 8
I20260709 13:11:04.063628 27337 pending_rounds.cc:107] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:04.063841 27337 raft_consensus.cc:2889] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.064498 32630 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.067593 32705 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:04.068998   374 consensus_meta.cc:287] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.005s
I20260709 13:11:04.071512   408 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.040337   323 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.076272 27334 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 13:11:04.042268   309 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:04.034951 32140 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.079123   323 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.083006   381 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.091959 27339 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:04.096176 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:04.098624   395 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:04.099330   395 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.102243 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.103021 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.104161 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.104672 32286 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.105310 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:04.111198 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:04.116693   431 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.121479 27308 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:04.144263   379 raft_consensus.cc:2749] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.160595   408 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:04.160527   387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.265s	user 0.010s	sys 0.028s
W20260709 13:11:04.196069   387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.011s	sys 0.028s
I20260709 13:11:04.239748 27260 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:11:04.245179 27259 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:11:04.259444 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 368726us
I20260709 13:11:04.267797 27309 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:04.284497 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 339291us
W20260709 13:11:04.284523 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 309324us
I20260709 13:11:04.271147 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:04.298537 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:04.304168 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:04.305251 28010 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.315797 28012 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:04.316939 28012 raft_consensus.cc:606] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:04.319130 28014 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55754 (request call id 776) took 1518 ms. Trace:
I20260709 13:11:04.319679 28014 rpcz_store.cc:276] 0709 13:11:02.800517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.801910 (+  1393us) service_pool.cc:224] Handling call
0709 13:11:02.802217 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:02.821025 (+ 18808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.821055 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:03.662767 (+841712us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b2c00012878. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:11:03.719992 (+ 57225us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b2c00012878. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd8152aa11 00007fbd8153a372 00007fbd82c6ca01 00007fbd82c3143a 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2
0709 13:11:03.720599 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:11:04.007413 (+286814us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:04.007450 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.007535 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.318502 (+310967us) raft_consensus.cc:1685] finished
0709 13:11:04.318544 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.318903 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18357,"raft.queue_time_us":18608,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"spinlock_wait_cycles":52858368,"thread_start_us":286412,"threads_started":1,"wal-append.queue_time_us":473918}
I20260709 13:11:04.326439 31807 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.327687 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:04.313423 27166 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 9 to 13, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:04.332147 31807 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:04.333033 27166 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.334862 28014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:04.352226 32358 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:04.354271 32555 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.356940 32630 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:04.358790 32711 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:04.359723 32717 raft_consensus.cc:993] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:04.361079 32763 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:04.361766   377 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:04.363695   382 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:04.365515   374 consensus_queue.cc:1048] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:04.365974   342 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.429797 28010 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:04.431061 28014 raft_consensus.cc:606] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:04.196627   395 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.197526   387 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:04.433442 32711 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.461063 32763 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.467123   353 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:04.476203 32358 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:04.476753 32763 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.465235 32617 raft_consensus.cc:993] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:04.479635 32617 raft_consensus.cc:1081] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:04.480818 32717 raft_consensus.cc:1081] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:04.476933 32358 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:04.482765 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:04.471536   377 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:04.483899 32358 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.485999 27342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:04.486347 32358 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:04.486981 27342 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.487522 27342 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:04.489879 27339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:04.490824 27339 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:04.490338   353 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.463069 32630 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.492602   418 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.517987 27339 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.505036   440 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:04.504549 27166 catalog_manager.cc:5697] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 14, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 14 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.476576   342 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.533601   320 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:04.534147   342 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.534384   320 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.512871   387 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.465492 32555 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.485368   377 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.551633 27166 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 16, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 16 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.563275 32688 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.535939   418 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.551859 32711 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.556995   320 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.561837 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.558729 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:04.553797   395 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.550189 32630 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.564513 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:04.562649   353 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:04.538401 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.576640 31807 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.574744 27339 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.589998 31807 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.592780 31807 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.606148   383 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:04.609153   383 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:11:04.604326 27232 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.004s	sys 0.008s
W20260709 13:11:04.615149 27232 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.005s	sys 0.008s
W20260709 13:11:04.615135 27233 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.002s	sys 0.010s
I20260709 13:11:04.618295   431 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:04.619004 32555 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:04.619757 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 563524us
I20260709 13:11:04.610381   383 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.613884 32688 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:04.617302 27261 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.007s
W20260709 13:11:04.623293 27233 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.003s	sys 0.010s
I20260709 13:11:04.611243 31807 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.628924   431 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.630143 27337 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:04.631659 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:04.638411 27261 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.008s
I20260709 13:11:04.616086 27166 catalog_manager.cc:5697] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.641198 27339 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:04.643570   469 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:04.604804   440 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.644337   469 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:04.634865 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 681220us
I20260709 13:11:04.650830 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.657173 27415 raft_consensus.cc:2410] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:11:04.658174 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:04.658774 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:04.659669 27408 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:04.660601 27335 raft_consensus.cc:1275] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:04.663628 31807 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.666201 31807 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.669094   418 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.669456 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.666891 27166 catalog_manager.cc:5697] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.671909 32688 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.679324 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.674798   440 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:04.684192   477 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:11:04.697190 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 132851us
I20260709 13:11:04.702724 27336 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:04.693297 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:04.725349 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.707100   431 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.718024 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:11:04.735473 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 83792.7us
I20260709 13:11:04.733484 27166 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 18 to 19, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 19 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:04.757121 32753 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.757584   349 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:04.757998 32753 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.763716 27261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2864) took 1243 ms. Trace:
I20260709 13:11:04.765632 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:04.766408 28010 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:04.767632 28010 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:04.773422 27335 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:04.778995 27339 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:04.780467 27166 catalog_manager.cc:5697] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.765745 27261 rpcz_store.cc:276] 0709 13:11:03.508721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.514942 (+  6221us) service_pool.cc:224] Handling call
0709 13:11:03.515396 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:03.574842 (+ 59446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:03.574886 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:03.578460 (+  3574us) log.cc:844] Serialized 26 byte log entry
0709 13:11:03.956865 (+378405us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:11:04.654353 (+697488us) log.cc:844] Serialized 14 byte log entry
0709 13:11:04.730895 (+ 76542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.737366 (+  6471us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.741891 (+  4525us) raft_consensus.cc:1685] finished
0709 13:11:04.741916 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.752290 (+ 10374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58923,"prepare.queue_time_us":33734,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":67174,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":25489,"thread_start_us":984790,"threads_started":2,"wal-append.queue_time_us":414616}
I20260709 13:11:04.784284 28010 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.796682 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:04.819123 27408 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:04.790401   418 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:11:04.822135 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:04.821938 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:04.828688 32753 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:04.796897   349 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:04.822379   469 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.838162 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:04.843955 27334 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:11:04.845427 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:04.846217 27334 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:04.844055 28007 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:04.851464 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:04.839985 27415 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
I20260709 13:11:04.851358 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:04.863094 27337 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
W20260709 13:11:04.866452 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82480.4us
I20260709 13:11:04.866740 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:04.868249 27335 raft_consensus.cc:2468] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 19.
I20260709 13:11:04.837139   418 consensus_queue.cc:1243] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:04.874085 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:04.822396 32688 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:11:04.878469 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:04.857347 27166 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 4 to 9, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 9 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:04.881278   387 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:04.887593 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:04.854414 32763 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:11:04.879070 32630 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.895573 32630 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.898224 32630 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:04.905771   353 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.912204 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:04.906581   353 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:04.890810   387 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:04.923378 27161 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 213) took 54631 ms (client timeout 15000 ms). Trace:
I20260709 13:11:04.924355   353 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:04.924065 27161 rpcz_store.cc:269] 0709 13:10:10.279789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.281169 (+  1380us) service_pool.cc:224] Handling call
0709 13:10:11.281918 (+1000749us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540002a728. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88e23331 00007fbd88e1e3fc 00007fbd889f01b4 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:10:11.648571 (+366653us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:04.894551 (+53245980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:02.963846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:02.964489 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:02.964529 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:11:02.964548 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:02.965679 (+  1131us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:02.965741 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:02.965774 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:11:02.966848 (+  1074us) tablet.cc:701] Row locks acquired
0709 13:11:02.966866 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:02.967028 (+   162us) write_op.cc:270] Start()
0709 13:11:02.967140 (+   112us) write_op.cc:276] Timestamp: P: 1783602662966974 usec, L: 0
0709 13:11:02.967158 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:03.058272 (+ 91114us) log.cc:844] Serialized 4905 byte log entry
0709 13:11:03.697490 (+639218us) op_driver.cc:464] REPLICATION: finished
0709 13:11:04.013600 (+316110us) write_op.cc:301] APPLY: starting
0709 13:11:04.013708 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:04.041133 (+ 27425us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:04.041266 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:04.202702 (+161436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:04.204024 (+  1322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:11:04.204055 (+    31us) write_op.cc:312] APPLY: finished
0709 13:11:04.204283 (+   228us) log.cc:844] Serialized 113 byte log entry
0709 13:11:04.204449 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:04.204610 (+   161us) write_op.cc:454] Released schema lock
0709 13:11:04.204657 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:04.205018 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:04.205038 (+    20us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":436033,"reported_tablets":51,"spinlock_wait_cycles":296770304,"child_traces":[["op",{"apply.queue_time_us":315789,"apply.run_cpu_time_us":19183,"apply.run_wall_time_us":191413,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":165457,"prepare.run_cpu_time_us":39644,"prepare.run_wall_time_us":295676,"raft.queue_time_us":288287,"raft.run_cpu_time_us":42984,"raft.run_wall_time_us":256692,"replication_time_us":704088,"thread_start_us":722764,"threads_started":4,"wal-append.queue_time_us":280067}]]}
I20260709 13:11:04.914567   374 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:04.921720   387 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:04.937796   480 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:04.929925 27166 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:04.946336   480 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.935696 27380 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:04.939846 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:04.936084   374 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.940768   418 consensus_queue.cc:1048] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:11:04.971607 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:04.945336   353 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:04.976529 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:04.979998 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47303.1us
I20260709 13:11:04.967510   374 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:04.991123 27342 consensus_meta.cc:287] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.003s
I20260709 13:11:04.991731 27342 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.997017 32764 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:04.997838 32764 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.002415 28010 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:05.006088 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 150483us
I20260709 13:11:05.008440 27339 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
W20260709 13:11:05.012586 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69908.1us
I20260709 13:11:05.009996   353 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:04.991250 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:05.019595 27342 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.021385 27166 catalog_manager.cc:5697] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.025082 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.032423 28010 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:05.033670 32688 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.034415 32688 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.034086 27166 catalog_manager.cc:5697] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 15, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:05.036665 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:05.041102 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 65774.7us
I20260709 13:11:05.020098   383 raft_consensus.cc:2804] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:05.046608 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.040529   320 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:05.049615 27166 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.056217 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.055477 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.062702 27259 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:05.067342 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.063004 31807 consensus_queue.cc:1059] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:11:05.057595   480 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.052430 32764 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.053164   383 raft_consensus.cc:697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:05.071847 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.076207 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:05.064893   349 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:05.078006   349 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:05.079218   483 log.cc:927] Time spent T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:11:05.056169   395 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.083731 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.086323 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:05.090582 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.091938 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.082053 27166 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.084362   353 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.103987 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.098464 27380 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.090361   429 consensus_queue.cc:1059] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:11:05.108649   429 raft_consensus.cc:3055] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:05.109095 32630 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:11:05.113869 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 85809.4us
I20260709 13:11:05.106104   480 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:05.113564 32630 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.093971   395 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.121433 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.109107   429 raft_consensus.cc:740] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:05.122159 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.129778   472 raft_consensus.cc:3055] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:05.131803 27411 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:05.133162   342 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.133780 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:05.135187 27338 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:05.136062 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.117722 32753 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:05.110430 32763 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:05.113912   353 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:05.176247   492 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:05.175872 27166 catalog_manager.cc:5697] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.176779   492 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.177412   492 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.177482   349 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.156353   472 raft_consensus.cc:740] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:05.182657 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.174652 32753 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:05.193755 32764 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:05.194446 32764 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:05.195351   487 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:11:05.193459 32753 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.177767 27166 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.200878 27340 raft_consensus.cc:1217] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Deduplicated request from leader. Original: 8.4->[9.5-16.9]   Dedup: 9.5->[11.6-16.9]
I20260709 13:11:05.201380 27340 pending_rounds.cc:85] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 5
I20260709 13:11:05.201436 32764 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.201694 27340 pending_rounds.cc:107] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:11:05.201989 27340 raft_consensus.cc:2889] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.202802   353 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.204118   323 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:05.204731   323 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.208304 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.208907 27413 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:05.205040   353 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.157359   342 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.196935 27259 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:11:05.215404 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 94036.8us
I20260709 13:11:05.209973 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.179575   418 raft_consensus.cc:2804] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:05.223397 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.225121 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:05.207013   323 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.233420 27308 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.240877 27334 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:05.243486 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.244598 27259 raft_consensus.cc:2410] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 17 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
W20260709 13:11:05.247331 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 190649us
I20260709 13:11:05.248730   320 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:05.249066   349 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:05.229364 27166 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 7 to 14, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 14 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.256862 27338 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:05.264037 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.266141 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.217490 32763 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.277127 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:05.293200 28010 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:05.293545 28010 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:05.281059 27166 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.287911   349 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:05.291090 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.303537 27267 raft_consensus.cc:1240] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:05.268388 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:05.310696 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44303.2us
I20260709 13:11:05.264010   431 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:05.346903 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:05.347616 27259 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.323570 28010 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.350006 28010 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.254869   480 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:11:05.315985 32711 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:05.289842   489 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:05.268443   492 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.364864 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.324396   387 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.316250   431 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:05.381059   418 raft_consensus.cc:697] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:05.230599   383 consensus_queue.cc:237] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:05.369717   495 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:05.377002 32711 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:05.394649   490 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:05.369829   320 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:05.379407 32630 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.400417 27267 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:05.383978   431 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.404843 27259 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:05.469447 27413 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:05.404435 32711 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:05.471131 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.469146   320 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:05.475204 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 225681us
I20260709 13:11:05.479593 27409 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:05.548038 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:05.548568   494 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:11:05.551246   497 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.427219   395 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.587392 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:05.598292 27260 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:05.598766 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:05.601336 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.604056 27268 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:05.605070   497 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.607751 32763 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:05.607949   503 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:11:05.608610   342 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.610030   492 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.610589 32711 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.611315   387 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.474256   500 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:05.612363   500 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.615742 32688 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.614533   500 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:05.624480 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 143494us
I20260709 13:11:05.628432 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:05.630515   320 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.626214   349 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:05.633100   349 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.635726 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.635448   418 consensus_queue.cc:237] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:05.636132   374 consensus_meta.cc:287] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.615s	user 0.005s	sys 0.005s
I20260709 13:11:05.634888 28010 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:05.641274 32462 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:05.637648   502 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.641830 32462 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.642347   502 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.636926   349 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:05.647940 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 165256us
I20260709 13:11:05.661074 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:05.661814 27417 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:05.661700   349 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:05.663020 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.664288 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:05.664814 27339 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:05.639226   374 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.661163 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:05.667450 27334 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.648972 32462 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.670866   429 consensus_queue.cc:260] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.671793 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.672413 27410 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:11:05.672662   431 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.673434   374 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.676980 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.659783 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:05.679369   497 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.683080   472 consensus_queue.cc:260] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.692375   349 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.692729   493 consensus_queue.cc:1059] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:05.647907 32711 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.684540 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.695225 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:05.737082 27417 raft_consensus.cc:2468] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
I20260709 13:11:05.693758   493 raft_consensus.cc:3055] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:05.739391 27337 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:05.739319 27334 raft_consensus.cc:2468] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:05.741537 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:05.747776 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:05.742352 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:05.738782 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.680254 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.748903 27341 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:05.749945 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.752827 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.754086 27980 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.755463   481 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:05.755908   481 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:05.756618 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.759099 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:05.760501 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.761121 27259 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:05.692431   472 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:05.756971 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:05.769487 28007 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:05.770678 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.774976 27339 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:05.772746 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.778026 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.778638 27410 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:05.789999 27414 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:05.656855   377 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:11:05.746625   493 raft_consensus.cc:740] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:05.756336   481 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.793051 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.794049 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.795459 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.793051 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.757459   320 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:05.798723 27334 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: [13.8-14.9]
I20260709 13:11:05.805302 27335 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:05.798906 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:05.807654   320 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.808406 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.809516 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.809847   320 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.810263 27268 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:05.810184 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.811420 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.811420 27268 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:05.817978 27409 raft_consensus.cc:2368] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17.
I20260709 13:11:05.780386   374 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:05.821239 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.828342 27259 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:05.830138 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:05.796300 32462 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:05.831635 27380 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.838405 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.840023 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:05.830194 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 63500.2us
I20260709 13:11:05.834296 27335 raft_consensus.cc:2393] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:05.849385 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:05.849592 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 260076us
I20260709 13:11:05.825084 32750 raft_consensus.cc:2804] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:05.854692 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:05.852231 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:05.861093 27334 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.862516 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.867479 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:05.868220 27264 raft_consensus.cc:3060] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:05.869334 27336 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:05.871567 32462 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.863962   493 consensus_queue.cc:260] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.875059 27233 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:05.839630   374 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.872673 32750 raft_consensus.cc:697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:05.878150   349 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:11:05.894014 27263 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.894183   463 raft_consensus.cc:2804] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:05.881721   505 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:05.895650 28007 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:05.901289 31807 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:05.904616   509 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:05.905005 32718 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.905246   509 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:05.905665 32718 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.906244   509 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.908243   493 raft_consensus.cc:3060] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:05.909785 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:05.910530 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.911290 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.912555   374 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:05.913503 32462 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.914142 32462 raft_consensus.cc:993] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:05.914793 32462 raft_consensus.cc:1081] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:05.884922   501 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:05.914047   496 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.916539 27411 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:11:05.916266 27259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d14940356a45ada8e16731853b8769"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:48160
I20260709 13:11:05.921856   507 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.888252   431 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.927253 27268 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:05.928187 27259 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:05.928838 27259 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:05.928068   502 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:05.928118 32750 consensus_queue.cc:237] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:05.932578 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.902802   463 raft_consensus.cc:697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:05.946173 27334 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:05.949736 28015 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:11:05.949622 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 118067us
I20260709 13:11:05.950742 27380 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.949810 27259 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:05.956553 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:05.919679 32718 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:05.962693 27266 raft_consensus.cc:1240] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:05.963284 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 92116.3us
I20260709 13:11:05.964975 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:05.966161 27264 raft_consensus.cc:2468] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:05.955938   502 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:05.959266   496 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.934299   463 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:05.966367 27263 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:05.981449 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.982944 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.966720 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:05.998553 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:05.999023 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.999349 28012 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:06.000200 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.000917 27264 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 16: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:06.001657 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:05.980906 27383 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.25.139.129:44339 timed out after 1.915s (SENT)
I20260709 13:11:06.020448 27259 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:06.020704 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 54082us
I20260709 13:11:06.022629 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.024655 27268 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.028532 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.029548   504 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:06.030045   504 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:06.030586   504 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.032227 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:05.969035   502 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.035480   502 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.041452   469 consensus_queue.cc:1059] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:05.968288   501 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.027099   480 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:11:05.971869   496 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:06.053249 27980 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.060906 27415 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:11:06.078560 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.102118 27266 raft_consensus.cc:1240] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:11:06.102155 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 209626us
I20260709 13:11:06.105729 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:06.106560 27334 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:11:06.062858   320 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.108526   320 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.109683 27261 raft_consensus.cc:1240] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:11:06.110643   524 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:06.111421 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.112040 27260 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:06.112319 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:06.106240 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:06.113170 27340 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:06.110440   515 consensus_queue.cc:1059] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:06.113613 27340 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.115413 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:06.116207 27263 raft_consensus.cc:2393] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:11:06.119273 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 138395us
I20260709 13:11:06.066417   480 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.065558   469 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.125067 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.126446 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.127121 27259 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:06.124148 27335 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:11:06.131454 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.135141 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.110641   320 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.117458 32688 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.118211   524 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:06.129482   469 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:06.168324 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.140084   515 consensus_queue.cc:1243] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer d02eb2355bc54e7f8c13a30c33793d95 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:06.170703 31807 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.138640   496 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.173369 31807 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.173861 31807 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.179883   469 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.181430   469 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.144199   463 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.194192 27415 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2561) took 1064 ms. Trace:
I20260709 13:11:06.194645 27415 rpcz_store.cc:276] 0709 13:11:05.127117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.127922 (+   805us) service_pool.cc:224] Handling call
0709 13:11:05.128328 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.061866 (+933538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.191284 (+129418us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54000adf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:06.191491 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142247808}
I20260709 13:11:06.196044   374 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:06.196388   505 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:06.196811   505 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:06.147567   501 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:11:06.199468 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.191461 32688 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.201609 32717 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.202170 32717 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.203516 32688 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:06.194674   463 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.151858   526 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:11:06.240340 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 99277.6us
I20260709 13:11:06.274128 31807 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.217792 27340 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.219826 27380 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:06.277097 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 59814.1us
I20260709 13:11:06.222592 27981 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.175628   480 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.293648 27233 leader_election.cc:400] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17.
I20260709 13:11:06.293998 27233 leader_election.cc:403] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:06.294109 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 162384us
I20260709 13:11:06.295017 27981 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.296356 27340 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:06.295727 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105681us
I20260709 13:11:06.294476 27414 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56234 (request call id 2570) took 1005 ms. Trace:
I20260709 13:11:06.235471   492 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:11:06.297191 27414 rpcz_store.cc:276] 0709 13:11:05.288780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.291319 (+  2539us) service_pool.cc:224] Handling call
0709 13:11:05.291732 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.792670 (+500938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.294233 (+501563us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000e9054. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c31e01 00007fbd82c3083e 00007fbd87bf5419 00007fbd8116cbd4 00007fbd8116cb62 00007fbd8116ca91 00007fbd8116ca0c 00007fbd8116bcc2 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:11:06.294417 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144957312}
I20260709 13:11:06.275004   526 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.290645 32688 raft_consensus.cc:2804] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:06.303450 31807 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.290477   472 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
W20260709 13:11:06.307986 27978 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.307242 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 114641us
I20260709 13:11:06.223753   524 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.298148 32555 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:06.291659   497 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:06.239353   496 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.311760 27337 raft_consensus.cc:1240] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 18. Current term is 19. Ops: [17.10-18.11]
I20260709 13:11:06.312538 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:06.302625   498 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.341971   498 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.343941   493 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17.
I20260709 13:11:06.344581   498 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.302661 32358 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.288333   481 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.347414   496 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.348201 28010 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:06.331800 27342 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:06.351122 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.331872 27309 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:06.332954 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:06.356468 27338 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.333478 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:06.335877   429 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.307720   526 raft_consensus.cc:3060] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.363056   497 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.365487   497 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.334302   472 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.294845   502 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.367720 32717 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.368366   472 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.368748   502 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:06.295202   480 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.357228 27334 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:06.357684 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:06.371490   480 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.371835   377 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.372107 27268 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
W20260709 13:11:06.358853 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.311879 32688 raft_consensus.cc:697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:06.372538   387 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:06.373450 32688 consensus_queue.cc:237] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.356251   374 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:06.348369   528 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.193s	user 0.004s	sys 0.006s
I20260709 13:11:06.347680   481 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.384116 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.388959 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.397238 27261 raft_consensus.cc:2410] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:11:06.355253   505 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.393419 27338 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:06.399081 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:06.400629 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 125354us
I20260709 13:11:06.407603 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:06.407902 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.408370 27334 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:11:06.411566 27342 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.389810   496 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.404349   377 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.334142   504 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:06.419741 32764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.039s	sys 0.006s
W20260709 13:11:06.422757   532 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:11:06.429668 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.441762 32764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.039s	sys 0.006s
W20260709 13:11:06.479610 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 169355us
I20260709 13:11:06.513974 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.514396   504 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:06.485239   505 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.515810   515 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.517246   496 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:06.517726   496 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:06.417636 32763 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:11:06.518146   496 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.420495 27383 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.524186 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.511714   463 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:06.414395   506 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.525573   500 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.518244 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:06.496054 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81977.8us
I20260709 13:11:06.528856   515 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.530541 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:06.530926 32688 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.531510 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:06.530922 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 110481us
I20260709 13:11:06.528903 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.533036   505 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.533732   480 consensus_queue.cc:1059] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:06.533159 27383 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:06.534794 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.535887   509 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.536336 32763 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.537335 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:06.540436 27234 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.538652   505 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.541291 32763 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:06.541747 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.548657 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.549538 27409 raft_consensus.cc:2368] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:06.549976 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.550611 27408 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.552333 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
W20260709 13:11:06.555219 27307 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.556469 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.555315 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.564077 27415 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:06.564956 27383 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.565426 27309 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.566813 27309 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.567713   497 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:06.568290   497 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.568472 28011 raft_consensus.cc:1240] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:11:06.568655   497 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:06.569644 31807 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.570353 31807 consensus_queue.cc:1059] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:06.567792 27263 raft_consensus.cc:3055] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:06.572732 27263 raft_consensus.cc:740] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:06.573616 27263 consensus_queue.cc:260] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.574615 27263 raft_consensus.cc:3060] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:06.518654   526 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.575563 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.576493 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.577045   526 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:06.565711   472 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:06.578178   472 raft_consensus.cc:3055] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:06.578640   472 raft_consensus.cc:740] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:06.579850   472 consensus_queue.cc:260] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.537598   506 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:11:06.583153 27260 raft_consensus.cc:3055] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:06.583642 27260 raft_consensus.cc:740] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:06.584404 27260 consensus_queue.cc:260] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.564179   509 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:06.585326 27260 raft_consensus.cc:3060] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:06.585712   509 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.588627   509 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.579917 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:06.591818 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.592547   505 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:06.592939 27409 raft_consensus.cc:2410] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:11:06.593300   505 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.593906   505 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.594209 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.595856 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:06.596906 27265 raft_consensus.cc:2393] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 16: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:06.604005   498 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.605122   349 raft_consensus.cc:3055] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:06.605625   349 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:06.607332   515 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.607883   515 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.616616 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.617476 27416 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:06.626698 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 71445.6us
I20260709 13:11:06.627595 27231 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.628783 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:06.630533 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:06.632161 27267 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:11:06.632642 27267 pending_rounds.cc:85] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 10
I20260709 13:11:06.632907 27267 pending_rounds.cc:107] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:11:06.633234 27267 raft_consensus.cc:2889] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.635247 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.636008 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:06.636646 27264 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.638669 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:06.639338 27259 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 11.
I20260709 13:11:06.641122 27263 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:11:06.641487 27263 pending_rounds.cc:85] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 10
I20260709 13:11:06.641690 27263 pending_rounds.cc:107] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:11:06.641978 27263 raft_consensus.cc:2889] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.644975 27260 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:11:06.665606 27260 pending_rounds.cc:85] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 14
I20260709 13:11:06.665877 27260 pending_rounds.cc:107] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:11:06.666131 27260 raft_consensus.cc:2889] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.662539 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:06.667727 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.670794 27415 raft_consensus.cc:1240] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 19. Current term is 20. Ops: [17.14-19.15]
I20260709 13:11:06.674371 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.636407   480 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:06.637295   353 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:06.639715   538 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.685246 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.686250 27412 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:06.687155 27409 raft_consensus.cc:1240] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: [13.8-17.10]
W20260709 13:11:06.673352 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 105398us
I20260709 13:11:06.680068 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.690958 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.690375 27339 raft_consensus.cc:2468] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:11:06.694423   497 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.696089   408 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:06.696609   408 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:06.696602   497 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.698662   408 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:06.673895   349 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.710295 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.711958 27308 leader_election.cc:400] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:06.712340 27308 leader_election.cc:403] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.708503   349 raft_consensus.cc:3060] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:06.726594 27408 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:06.727984 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.729876 27414 raft_consensus.cc:1240] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:11:06.730088 32688 raft_consensus.cc:2764] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:11:06.683842   505 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.738234 27416 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:06.743130   548 raft_consensus.cc:3060] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:06.743379 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.737856   497 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:06.761022 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.764662 27268 raft_consensus.cc:1240] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:06.765628 27264 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:06.742132   501 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.769796   538 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:06.772756 27410 raft_consensus.cc:1275] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:06.767491 27308 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.778083 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:06.780637 27408 raft_consensus.cc:1240] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:06.782823   533 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:06.783298   429 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:06.784049   429 raft_consensus.cc:2804] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:06.784493   429 raft_consensus.cc:697] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:06.785496   429 consensus_queue.cc:237] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.792188 28007 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
I20260709 13:11:06.799669 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.769096   497 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.767957   508 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:11:06.834987 27263 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:11:06.868865 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:06.839821 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:06.849407   472 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:06.853983 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:06.859612   507 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:06.770650   538 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.869123 27263 pending_rounds.cc:85] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 8
I20260709 13:11:06.875813 27263 pending_rounds.cc:107] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:11:06.876070 27263 raft_consensus.cc:2889] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.839398   349 consensus_queue.cc:1059] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:06.892318 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.869222 27383 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.886508 28007 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:06.895187 27380 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:06.897903 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 58157.6us
I20260709 13:11:06.900861 28014 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:06.772715   501 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.865031   469 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:06.902942 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:06.912701 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 145255us
I20260709 13:11:06.809901   480 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:11:06.913954 27308 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.875285   507 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:06.892736   504 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.869805   496 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.903380 32688 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:06.919988 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 209795us
I20260709 13:11:06.913614   383 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:11:06.934348   540 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.514s	user 0.000s	sys 0.004s
I20260709 13:11:06.906939 32763 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:11:06.989693 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:06.874580   481 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:11:06.992084 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.996575 32718 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:06.981778 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:06.898895 32555 consensus_queue.cc:1059] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:11:06.954538 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 172956us
I20260709 13:11:06.999930 32555 raft_consensus.cc:3055] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:07.000409 32555 raft_consensus.cc:740] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:07.001446 32555 consensus_queue.cc:260] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.002846 32555 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:07.010192 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 116201us
I20260709 13:11:07.004091 32718 consensus_queue.cc:1048] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:06.922914 32711 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:07.009313   374 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:11:07.023939   519 log.cc:927] Time spent T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:11:07.030390 27383 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:06.943565 32688 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:07.024318   497 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:06.987789   431 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:07.018939   544 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:07.084446   544 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:07.085654   544 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.008129   383 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:07.087977   383 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.044530   374 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:06.944136   504 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.092638   374 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:07.093065   504 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:07.032368 32711 raft_consensus.cc:493] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:07.069720 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 68327.6us
W20260709 13:11:07.033830 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 121499us
I20260709 13:11:07.094995 27978 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:07.096167   496 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.097059   481 raft_consensus.cc:2804] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.097681   481 raft_consensus.cc:697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:07.104440   505 raft_consensus.cc:3055] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:11:07.007669 32717 consensus_queue.cc:1175] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" responder_term: 13 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:07.104946   505 raft_consensus.cc:740] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:07.105860   505 consensus_queue.cc:260] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.106890   505 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:07.011116   463 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:11:06.949460   507 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.123560   507 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:07.128186   501 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.129980   548 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:07.079973   538 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.093724 32711 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.073061 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:07.109287   515 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.151769   431 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:07.111945 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:07.114217   481 consensus_queue.cc:237] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.041385   418 consensus_queue.cc:1059] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 13:11:07.135943 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 154246us
I20260709 13:11:07.151127   323 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:07.109997 28011 raft_consensus.cc:1240] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:07.118903 32688 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:07.036770   506 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:11:07.150342 28007 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:07.161255 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.166337 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
W20260709 13:11:07.136751   480 consensus_queue.cc:1175] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d02eb2355bc54e7f8c13a30c33793d95" responder_term: 18 status { last_received { term: 18 index: 10 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: [13.8-17.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:07.152460   429 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.180367 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.195266 27340 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:07.199369   323 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:07.210976 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 180679us
I20260709 13:11:07.223553 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.224352 27339 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:07.218680 32763 raft_consensus.cc:2804] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:07.209582   408 raft_consensus.cc:3055] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:07.202744   497 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:11:07.213029 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 116769us
W20260709 13:11:07.294202 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 65371.8us
I20260709 13:11:07.298717 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.230461   408 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:07.234174   497 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.283720 32763 raft_consensus.cc:697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:07.312635   497 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.358696 32763 consensus_queue.cc:237] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.362260   557 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:07.362910   557 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.366350 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.367003 27343 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:07.367821 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.368165 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:07.368911 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:07.369622 27343 raft_consensus.cc:2393] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 16: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:07.370311 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.367844 27338 raft_consensus.cc:1275] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:07.371862 27334 raft_consensus.cc:1275] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:07.297770   431 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.377632 32711 raft_consensus.cc:515] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.381614 32711 leader_election.cc:290] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.382941   497 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.383993 27339 raft_consensus.cc:1240] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:07.384121 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:07.384789 27259 raft_consensus.cc:3060] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:07.389880 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.390288 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.392125 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.394263 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.384357   558 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:07.396526 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.399945 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:07.400185 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:07.400538 27338 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.401165 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.401718 27260 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:07.402292 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.402506 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:07.355368   553 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 13:11:07.395895 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.396461   558 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.365089   557 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.427587 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.421974 27335 raft_consensus.cc:2468] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:07.429756   323 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.430464   408 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.444585 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.456408   497 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.457374   408 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.465210 27166 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 132) took 10740 ms. Trace:
I20260709 13:11:07.466917 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.491892 27259 raft_consensus.cc:2468] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:11:07.514575 27231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.524616 27233 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.534143 27335 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:07.536695 27338 raft_consensus.cc:2468] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
I20260709 13:11:07.537997 27978 leader_election.cc:304] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:11:07.467710   472 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
I20260709 13:11:07.448220   349 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:07.469367 27166 rpcz_store.cc:276] 0709 13:10:56.724692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.735660 (+ 10968us) service_pool.cc:224] Handling call
0709 13:11:07.465126 (+10729466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:05.751354 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:05.752001 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:05.752057 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:11:05.752077 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:05.753603 (+  1526us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:05.753708 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:05.753733 (+    25us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:11:05.758708 (+  4975us) tablet.cc:701] Row locks acquired
0709 13:11:05.790741 (+ 32033us) write_op.cc:260] PREPARE: finished
0709 13:11:05.820851 (+ 30110us) write_op.cc:270] Start()
0709 13:11:05.850535 (+ 29684us) write_op.cc:276] Timestamp: P: 1783602665803938 usec, L: 0
0709 13:11:05.863883 (+ 13348us) op_driver.cc:348] REPLICATION: starting
0709 13:11:05.864687 (+   804us) log.cc:844] Serialized 7162 byte log entry
0709 13:11:06.194610 (+329923us) op_driver.cc:464] REPLICATION: finished
0709 13:11:06.285456 (+ 90846us) write_op.cc:301] APPLY: starting
0709 13:11:06.285572 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:06.340940 (+ 55368us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b18000b5060. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb44522 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:11:06.504614 (+163674us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:06.504671 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:06.699444 (+194773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:06.699858 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:11:06.699928 (+    70us) write_op.cc:312] APPLY: finished
0709 13:11:06.700389 (+   461us) log.cc:844] Serialized 164 byte log entry
0709 13:11:06.700591 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.700768 (+   177us) write_op.cc:454] Released schema lock
0709 13:11:06.700839 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:06.701516 (+   677us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.701547 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":233,"mutex_wait_us":174996,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":90550,"apply.run_cpu_time_us":31397,"apply.run_wall_time_us":415837,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":132554,"prepare.run_cpu_time_us":9929,"prepare.run_wall_time_us":152653,"raft.queue_time_us":211468,"raft.run_cpu_time_us":26747,"raft.run_wall_time_us":90838,"replication_time_us":330535,"spinlock_wait_cycles":16861056,"thread_start_us":347663,"threads_started":4,"wal-append.queue_time_us":56702}]]}
I20260709 13:11:07.559410   562 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.559839 27343 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:07.466652   558 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.560220   562 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.558631 32688 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.552313   509 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.567827   509 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.568339 27416 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:07.569473 32688 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:07.570611   509 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:07.539494   569 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.076s	user 0.003s	sys 0.004s
I20260709 13:11:07.574489   545 raft_consensus.cc:2804] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:07.575341   545 raft_consensus.cc:697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:07.576495   545 consensus_queue.cc:237] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.590852 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.596822 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.597541 27309 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.598032 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:07.600450 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.600595 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.601552 27259 raft_consensus.cc:2410] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:11:07.595690 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.603682 27309 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.586369   497 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.586771   349 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:07.615928 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.619879 27338 raft_consensus.cc:2468] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
I20260709 13:11:07.605044   496 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:07.659202 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55569.1us
I20260709 13:11:07.614360   498 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.652908 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.613862   509 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.661865 27309 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:07.665064 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.617549   349 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:07.720777 32612 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.721333 32612 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.727983 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.662894   562 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:07.729547 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.733444 32612 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:07.734705 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:07.617079   497 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:07.736009 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.730798   557 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:07.747632 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:07.742337   349 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:07.751103   583 log.cc:927] Time spent T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:07.757344   497 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.747695   557 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.762181   557 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:07.774243   349 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:07.780915 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:07.788636 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:07.792955 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 398683us
I20260709 13:11:07.795352   374 consensus_queue.cc:1059] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:07.799439 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:07.801760   506 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:07.805545   504 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:07.805846 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05efe4ee1469496f84eca86709a6b478" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:07.806419   504 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:07.809397   555 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.791s	user 0.017s	sys 0.006s
I20260709 13:11:07.807636 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.802423   506 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.813439 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.813292 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:07.826067 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 477063us
I20260709 13:11:07.826838 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:07.830242 32764 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:07.832414 27342 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:07.834151 27268 raft_consensus.cc:1275] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:11:07.834615 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.836438   581 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:07.836910   581 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.837253   581 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:07.840648 27267 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:07.841071 27267 pending_rounds.cc:85] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 9
I20260709 13:11:07.840960 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:07.841374 27267 pending_rounds.cc:107] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:07.841629 27267 raft_consensus.cc:2889] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.845340 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:07.848843 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:07.854061 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.885949 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.890888 27267 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:07.857684   488 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:07.896971 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.862792 32763 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:07.907773 28011 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:07.907974 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.911361 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.914563 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.916538 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:07.918856 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:07.917373 27267 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 17.
W20260709 13:11:07.927942 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64811us
I20260709 13:11:07.866456   374 consensus_queue.cc:1048] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:11:07.889544   463 consensus_queue.cc:1048] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:11:07.963830 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:07.962477 27233 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.966440 27233 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:07.967305 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 2916) took 1331 ms. Trace:
I20260709 13:11:07.979242 27267 raft_consensus.cc:1240] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
W20260709 13:11:07.961027 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54495.8us
I20260709 13:11:07.985129 28011 consensus_queue.cc:237] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:07.969342   507 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:07.969527   557 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:07.968878 27265 rpcz_store.cc:276] 0709 13:11:06.635530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.635654 (+   124us) service_pool.cc:224] Handling call
0709 13:11:06.635971 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:06.648846 (+ 12875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.648876 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:06.681461 (+ 32585us) log.cc:844] Serialized 52 byte log entry
0709 13:11:06.880149 (+198688us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:06.912437 (+ 32288us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.023272 (+110835us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b1800413200. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fabec0a 00007fbd891fe219 00007fbd7fb46a40 00007fbd7fb414e4 00007fbd7fb41455 00007fbd866293c7 00007fbd82c3b9a7 00007fbd82c4b0bf 00007fbd82c4b038
0709 13:11:07.023520 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.023747 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.023828 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.450895 (+427067us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b1800413200. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd88a0cde1 00007fbd88a195b1 00007fbd7fb443f3 00007fbd7fb467c1 00007fbd7fb46779 00007fbd7fb46709 00007fbd7fb466d1 00007fbd7fb459cd 000000000038f354 000000000038f199 00007fbd7fb2783a
0709 13:11:07.808782 (+357887us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b4400022b4c. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fa6ac85 00007fbd7fa6b6a2 00007fbd827dd1db 00007fbd827d8aaf 00007fbd827cc86e 00007fbd827cbbb6 00007fbd827cb7d8 00007fbd827d5221 00007fbd827d51d9 00007fbd827d5169
0709 13:11:07.963596 (+154814us) raft_consensus.cc:1685] finished
0709 13:11:07.963615 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.967249 (+  3634us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45111,"prepare.queue_time_us":132089,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":3502,"raft.queue_time_us":15937,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":24709,"spinlock_wait_cycles":34959872,"thread_start_us":140341,"threads_started":1,"wal-append.queue_time_us":304770}
I20260709 13:11:08.015060 27266 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:08.007534   592 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
W20260709 13:11:08.023653 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.967583   488 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:11:08.025545 28014 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:08.027094   507 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:08.030411 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 81845.8us
I20260709 13:11:08.031543 27383 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:08.040421   507 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:08.041093   507 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.041379   374 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.042411   374 consensus_queue.cc:1243] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer 203d83f7fac847e0beee51aa18513b25 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:08.016609   504 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.059720 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:08.061291 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:08.061550 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 112132us
I20260709 13:11:08.068621   506 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.069950   507 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.052369   488 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.071651 27268 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 18: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:08.075268 27268 raft_consensus.cc:1217] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-18.10]   Dedup: 12.7->[14.8-18.10]
I20260709 13:11:08.075726 27268 pending_rounds.cc:85] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 7
I20260709 13:11:08.075933 27268 pending_rounds.cc:107] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:11:08.076154 27268 raft_consensus.cc:2889] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.076434 27268 pending_rounds.cc:107] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:11:08.076680 27268 raft_consensus.cc:2889] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.113268 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:08.116752   469 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:08.117195   469 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.117528   469 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.120819   593 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:08.124058   581 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.125133 27410 raft_consensus.cc:1240] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:11:08.124076   597 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:11:08.126144   581 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.125603   374 consensus_queue.cc:1059] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:08.128535   374 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:08.128887   374 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:08.129763   374 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.150017 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:08.130980   374 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:08.152017   544 consensus_queue.cc:1059] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:08.162979   548 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.163578   548 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.165786   548 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:08.164045   578 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:11:08.169745 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:08.173312 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.183842 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:08.186792 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43806.3us
I20260709 13:11:08.189410 28011 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:08.190546   498 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.191067   498 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.193220   498 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.193750   498 consensus_queue.cc:1059] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:08.194733   498 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:08.195313   500 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.195588   600 consensus_queue.cc:1048] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.195853   500 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:08.196563 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 535237us
I20260709 13:11:08.197335 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.197922   500 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.198436   500 raft_consensus.cc:3055] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:08.183980   408 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:08.199492   408 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.201118   497 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.201442   408 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.202114 27412 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:08.178050   563 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:08.203931   563 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.205928   563 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.209002 27343 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:08.213038   320 raft_consensus.cc:3055] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:08.213469   320 raft_consensus.cc:740] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:08.214362   320 consensus_queue.cc:260] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.215955   320 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.216053 28015 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:08.216689 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:08.198359 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.218225 27336 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:08.220094 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.221771 27410 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:08.222645 27341 raft_consensus.cc:1275] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:11:08.233237 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:08.234063 27265 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 18: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:08.235062 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:08.198853   500 raft_consensus.cc:740] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:08.237795   500 consensus_queue.cc:260] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.239605 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.240283 27409 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:08.239229   500 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:08.244037 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45737.8us
I20260709 13:11:08.244881 27309 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.246613 31807 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:08.246763 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:08.247807 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:08.254707   496 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:08.255584   558 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:08.255708   538 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.256076   558 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.256461   558 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.256283   538 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.258512   538 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.242925   592 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:08.259248   592 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.261324   592 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.262081 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.243188   509 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:11:08.262821 27416 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:08.263744   497 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:08.267475 27416 raft_consensus.cc:1275] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:08.264008 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:08.273272 27309 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.280431 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:08.275343   586 log.cc:927] Time spent T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.516s	user 0.000s	sys 0.007s
I20260709 13:11:08.284400 27412 raft_consensus.cc:1240] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:08.246001   469 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.282163 27309 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.271780   566 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:11:08.285969 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.286813   469 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.286990   408 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:08.287480 31807 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:08.287557   408 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.288311 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.289093 31807 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:08.273470   509 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:08.289572 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.289793   408 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.289821   509 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.290923   509 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.291568 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:08.276746   496 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:08.269310 32717 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:11:08.264178   497 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:08.301079   538 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.283100   482 consensus_queue.cc:1048] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:11:08.272958   544 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:08.307065 27309 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:08.314904 27383 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.320770 31807 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.321780 27309 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.323585 27231 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.328372 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.335347 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.336589 27231 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.342253 27409 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:08.343709 31807 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:08.346910 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.315536   497 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.351410 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.353320   596 consensus_queue.cc:1059] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:08.354470   596 consensus_queue.cc:1243] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer b0e4232110db400d8f43fe2170c24c95 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:08.318071   429 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.317977   544 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.332252   557 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.289897   593 consensus_queue.cc:1048] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:08.332291   323 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:08.351549   493 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.305873   509 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.349475   507 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:08.349116   505 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.354979   492 raft_consensus.cc:3055] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:08.398514 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:11:08.385519 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.355408   408 raft_consensus.cc:3055] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:08.358604   349 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.362005   431 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.356812   480 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:08.389742 27306 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.320132   538 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.367755   544 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.400367 27343 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:08.400626 27335 raft_consensus.cc:1240] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:11:08.401224   429 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.419709 28015 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:11:08.420055   558 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.420442 27337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.421561 27336 raft_consensus.cc:1240] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:08.431084 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.431921 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:08.398006   492 raft_consensus.cc:740] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:08.436269 31807 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:08.402179   408 raft_consensus.cc:740] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:08.434294 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.437975 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.440442 27336 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:08.440682 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.441349 27343 raft_consensus.cc:2368] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:08.441256 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.461599 31807 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:08.462293 31807 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:08.463817 31807 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.463869 27337 raft_consensus.cc:2368] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:08.401902   563 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:11:08.465987 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:08.438318   472 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:08.426805   504 consensus_queue.cc:1059] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:11:08.444172   598 log.cc:927] Time spent T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:11:08.472330 31807 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:08.428483   463 consensus_queue.cc:1059] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:08.438874   429 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.547289 27341 raft_consensus.cc:2468] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:08.490525   492 consensus_queue.cc:260] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:08.557852   609 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:08.557762   492 raft_consensus.cc:3060] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:08.539574   408 consensus_queue.cc:260] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:08.559867   608 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:08.560591   408 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:08.561439   603 log.cc:927] Time spent T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:11:08.561795   599 log.cc:927] Time spent T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.410s	user 0.003s	sys 0.000s
I20260709 13:11:08.565898 27334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52492 (request call id 2881) took 1200 ms. Trace:
W20260709 13:11:08.572830 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 149521us
I20260709 13:11:08.566342 27334 rpcz_store.cc:276] 0709 13:11:07.365573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.372573 (+  7000us) service_pool.cc:224] Handling call
0709 13:11:07.775232 (+402659us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800010898. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0ceee 0000000000375939 00007fbd87b801e0 00007fbd87c490c4 00007fbd87c49131 00007fbd87c0afc0 00007fbd87bf5929 00007fbd87bf53d2 00007fbd8116cbd4
0709 13:11:07.775395 (+   163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.202052 (+426657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.202083 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.202455 (+   372us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.348832 (+146377us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:08.348871 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.348934 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.565550 (+216616us) raft_consensus.cc:1685] finished
0709 13:11:08.565574 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.565811 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":426298,"raft.queue_time_us":430318,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"spinlock_wait_cycles":2629888,"thread_start_us":146041,"threads_started":1,"wal-append.queue_time_us":224192}
I20260709 13:11:08.575860 27341 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:11:08.593626 27380 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:08.582341   482 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:11:08.657959 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 64471.3us
I20260709 13:11:08.658771 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:08.664583 27380 leader_election.cc:400] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:08.665004 27380 leader_election.cc:403] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:08.659581   463 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:08.683431 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:08.684407 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 331693us
I20260709 13:11:08.685304 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:08.687882   605 log.cc:927] Time spent T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:11:08.688155 27381 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.695593   619 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.655983   616 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:11:08.700634   606 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:11:08.703204   538 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:08.705058 27380 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:08.669209   488 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:08.735709 27340 raft_consensus.cc:1275] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:08.657317   482 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.735786   488 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:08.750514   488 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:08.685788   500 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:08.756385 27231 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:08.759521 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:08.712344   418 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:08.736668   538 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:08.744771   383 raft_consensus.cc:2804] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:11:08.753613   611 log.cc:927] Time spent T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:11:08.760802   480 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:11:08.782418   507 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:08.785343   558 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.857602 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:08.784785   383 raft_consensus.cc:697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:08.864435 27412 raft_consensus.cc:3060] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:11:08.762703   500 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.847899   562 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:08.835053   538 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:11:08.901598   497 consensus_meta.cc:287] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.005s
I20260709 13:11:08.886363   493 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:08.907368 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.918519 32711 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:08.925361 32711 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:08.927760   626 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:11:08.929692 32711 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.893533   562 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.946183   463 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.911047   563 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:08.964643   628 log.cc:927] Time spent T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:11:08.923985   320 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.966848   627 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:11:08.966737   320 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.952710 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.969861   320 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.971316   482 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.971208   463 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.973345   562 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.913018   497 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.973949   463 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:08.974853 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:08.975528 27416 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:08.976022 27334 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:08.957710   504 raft_consensus.cc:3055] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:11:08.920570   383 consensus_queue.cc:237] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.964260   563 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:08.979575 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.976835 27417 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:08.975622   497 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:08.981722 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:08.988276 27336 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:08.982191 27343 raft_consensus.cc:2393] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 19: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:08.979699   504 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:08.961900   595 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 7 to 9, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:08.952719 32711 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.952246 27412 raft_consensus.cc:2468] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
W20260709 13:11:08.961999   623 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:11:08.916781   493 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:08.949520   634 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:09.008034 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 85080.8us
W20260709 13:11:09.007858 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 84792.5us
I20260709 13:11:09.007807 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:09.020443 27308 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.018502 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.036844 27341 raft_consensus.cc:1240] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15. Ops: []
I20260709 13:11:09.042129 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.036486   614 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:09.035565   507 raft_consensus.cc:493] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:09.044239   614 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.044627   507 raft_consensus.cc:515] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.046754   614 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.071265 27261 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:09.046882   507 leader_election.cc:290] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.051257   349 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:09.055392   504 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.060391   493 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.061601   642 raft_consensus.cc:2804] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:09.063047 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 47356.2us
I20260709 13:11:09.086450 27265 raft_consensus.cc:1275] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:09.070065 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.070879 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.089485 27263 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:09.075688 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.077091 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:09.072721 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 61794.2us
I20260709 13:11:09.090838 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:09.042233 32717 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:09.074225 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.080983   581 raft_consensus.cc:3055] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:11:09.086231 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 87953.5us
I20260709 13:11:09.007071 32711 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.095719 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.097160 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:09.095245   544 consensus_meta.cc:287] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 13:11:09.015890   634 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.143273   639 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.143953   639 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.146257   509 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.149572 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:09.150235 27260 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.154706   619 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:09.165500 32711 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.166865   634 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.168499 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.171944 27343 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:09.175256   563 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.129585   642 raft_consensus.cc:697] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:09.177662   642 consensus_queue.cc:237] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.178364 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:09.179381   493 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.179757 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.179407 27260 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:09.180131   493 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.184711 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.197237 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.200049 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.213068 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.096359 32717 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:09.215458 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.215965 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.185418 27414 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:09.133118   544 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.244426   544 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.244565   488 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.248029 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:09.249755 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:09.098208   581 raft_consensus.cc:740] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:09.237407 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.253720   493 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.100306   349 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.254354   581 consensus_queue.cc:260] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.255947   581 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:09.256711   349 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.257474 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.258611 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:09.100961   504 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.260172 32717 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:09.260360   429 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.262948 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.266937 27408 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.269560 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:09.270726 27261 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 19: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:09.274634   592 consensus_queue.cc:1048] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:11:09.272984 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:09.146279   639 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.276553 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:09.275297 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 182651us
I20260709 13:11:09.281615 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.277606   488 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:09.284166   587 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:09.286492 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:09.286942 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 48625.3us
I20260709 13:11:09.287302 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.311730 27410 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
I20260709 13:11:09.321537 27308 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.313726 27414 raft_consensus.cc:2393] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 19: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:09.315728 27380 leader_election.cc:400] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:09.323024 27380 leader_election.cc:403] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:09.313611 27265 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:09.325537 27978 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.383845 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:09.388437 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 70764.7us
W20260709 13:11:09.392295 27309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.394771 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:09.395015 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:09.395440 27262 raft_consensus.cc:3060] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:09.387985 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 67816.7us
I20260709 13:11:09.396328 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.384668 27265 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:11:09.401866 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.403582 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.404500 27265 raft_consensus.cc:2393] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 17: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:11:09.405835 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 84523.4us
W20260709 13:11:09.406396 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 129936us
I20260709 13:11:09.406569 27308 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:09.408373 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 97296.5us
I20260709 13:11:09.409189 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.414775 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:09.416060 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:09.417989 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 111748us
I20260709 13:11:09.427651   545 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:09.428395   545 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:09.428867   545 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.431634 27262 raft_consensus.cc:2468] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
I20260709 13:11:09.434340   587 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:09.434767   587 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
W20260709 13:11:09.435575 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 120066us
I20260709 13:11:09.312429   595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35260 (request call id 0) took 1319 ms. Trace:
I20260709 13:11:09.433184   631 consensus_queue.cc:1048] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:09.436570 27380 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.432370 27309 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.442365 27309 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:09.445856   497 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:09.439843   595 rpcz_store.cc:276] 0709 13:11:07.958395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.958578 (+   183us) service_pool.cc:224] Handling call
0709 13:11:07.988155 (+ 29577us) log.cc:844] Serialized 508 byte log entry
0709 13:11:08.192089 (+203934us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b54000df320. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82bb1b26 00007fbd82bab49a 00007fbd82baa714 00007fbd82b8aeaa 00007fbd82b91d53 00007fbd82b91cd9 00007fbd82b91c69 00007fbd82b91c31 00007fbd82b90dfd 000000000038f354
0709 13:11:08.199811 (+  7722us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b54000df320. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82baa142 00007fbd82b8aeaa 00007fbd82b91d53 00007fbd82b91cd9 00007fbd82b91c69 00007fbd82b91c31 00007fbd82b90dfd 000000000038f354 000000000038f199 00007fbd7fb44475
0709 13:11:09.274801 (+1074990us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":593,"raft.run_cpu_time_us":4576,"raft.run_wall_time_us":287644,"spinlock_wait_cycles":19860864,"thread_start_us":61913,"threads_started":1,"wal-append.queue_time_us":143355}
I20260709 13:11:09.451618 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.418164   563 raft_consensus.cc:2804] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:09.454254 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.454484   497 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.455237   497 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.455328   533 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:09.454957   587 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.454499   563 raft_consensus.cc:697] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:09.456652   505 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:09.456667   587 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:09.456869   563 consensus_queue.cc:237] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.416803   429 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:09.420610   493 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.430997   545 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.472919 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.473587 27412 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:11:09.473953 27309 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.474815 27410 raft_consensus.cc:1275] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:11:09.475195 27410 pending_rounds.cc:85] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Aborting all ops after (but not including) 11
I20260709 13:11:09.475450 27410 pending_rounds.cc:107] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:11:09.475687 27410 raft_consensus.cc:2889] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.478384 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:09.484052   630 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:09.488396 27309 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.439595   592 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 18. Current term is 19.
I20260709 13:11:09.495663   630 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:09.527665 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:09.528443 28015 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 14.
W20260709 13:11:09.530465 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69952.5us
I20260709 13:11:09.464553   429 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:09.437893   349 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:11:09.472522   493 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:09.534418 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 218576us
W20260709 13:11:09.536701 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 100183us
I20260709 13:11:09.468878   507 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:09.521062   374 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:09.522594   619 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:09.584502 27341 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:09.542357   429 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:11:09.591873 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 43665.8us
I20260709 13:11:09.544868   493 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.546208   596 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:11:09.597844 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.601563 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:09.606739 27380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.613023 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287d5309a46494ca6fc1acd716c9c17" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:09.621708 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:09.622649 28011 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 15.
W20260709 13:11:09.636730 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 240320us
I20260709 13:11:09.600111   596 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.639732 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:09.640352 27981 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:09.580670   374 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.591671   619 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.588184   507 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.693754 27981 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:09.696198 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.654093   596 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:09.699548   547 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:09.690753   592 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.642781   505 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:09.655062   480 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:09.674945   545 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:09.709551 27306 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:09.643760   504 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:11:09.711627 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
W20260709 13:11:09.711746   644 log.cc:927] Time spent T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:11:09.771946   660 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:09.775877 27233 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.778786 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.722842   505 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.748685   545 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:09.728453   547 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.731954   480 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.758653   622 raft_consensus.cc:493] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:09.796172   652 log.cc:927] Time spent T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 13:11:09.799507   646 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.800143   646 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.800575   646 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:09.802409   374 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.804946   480 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.805409   619 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:09.805761   480 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:09.779821   349 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:09.814222 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.818388 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:09.827463 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.790124 32717 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:09.834112 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 55465.8us
I20260709 13:11:09.823385   480 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:09.839775 27231 leader_election.cc:304] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:09.806211   622 raft_consensus.cc:515] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.810693   349 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.856288 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a30a45f010dd49e5a9ddb107297fa03e with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:09.861769 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.862074   622 leader_election.cc:290] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:09.863646 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 169181us
I20260709 13:11:09.864521 27259 raft_consensus.cc:3060] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:09.865036 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:09.870297 27265 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:09.865334 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:09.868367 27150 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 56057.6us
I20260709 13:11:09.878594   645 consensus_queue.cc:1048] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:09.871861 27383 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.899572   622 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:09.898478   575 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:09.902272   575 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:09.902851   575 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:09.907976   673 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.908612   673 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:09.911005   673 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.911267   646 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.914743 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:09.848184   545 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:09.921598 27259 raft_consensus.cc:1275] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:11:09.923038 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 88174.5us
W20260709 13:11:09.929311 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89643.5us
I20260709 13:11:09.896039   480 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:09.931084 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:09.918748   507 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.924576   505 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.922996   492 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:09.945294 27414 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:09.929673   646 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.946355 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.946795 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.951921 27413 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:09.953735   349 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.954406   349 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:09.954836   349 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:09.955283   349 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:09.955962   668 log.cc:927] Time spent T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:11:09.957280   500 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:09.958389 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.934387   480 raft_consensus.cc:493] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.946789 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.931680   672 raft_consensus.cc:2749] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:09.971854 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:09.983711 27414 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:09.932951   374 consensus_queue.cc:1048] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:11:09.985929 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.950367   492 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.002770   489 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.003491   489 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.004879   492 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:10.006054   489 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:10.008702   672 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:10.009151   672 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.009497   672 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.009445   575 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.011950 27412 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.013414 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.015828 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.016706 27262 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:10.019943 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:10.023020   575 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:09.980562   480 raft_consensus.cc:3060] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:10.018875   678 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:11:10.036191 32717 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.036442   638 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.036899   638 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:10.044189 27383 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:09.983912   547 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:10.014889 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:10.038625 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.011047   429 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.055274   429 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.055052   596 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.057358   596 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:10.050720   489 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.061843   489 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.062224   489 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.066854 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:10.067615 27261 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.073532   672 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:10.079524 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 77004.5us
I20260709 13:11:10.085656 27412 raft_consensus.cc:2468] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 15.
I20260709 13:11:10.077297   638 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.118381   638 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.094074   493 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.083600   694 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:10.124678   694 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.125174   694 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:10.117300 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.127192 27410 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.090472   349 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.108703   672 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:10.109608 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 178620us
I20260709 13:11:10.076993 27261 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:10.106575   480 raft_consensus.cc:515] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.102286   489 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.136065 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:10.137848 27410 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:10.137220 27383 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:10.154734 27264 raft_consensus.cc:1240] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 15. Current term is 16. Ops: []
I20260709 13:11:10.159768   493 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.163260   377 raft_consensus.cc:2804] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.163539 27259 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:11:10.164009   377 raft_consensus.cc:697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:10.164656   480 leader_election.cc:290] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.165071   377 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.170723   349 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.178819 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.154608 27233 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:10.182425 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:10.182708 27981 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.183061 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:10.183108 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:10.183771 28007 raft_consensus.cc:606] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.184677 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:10.185874 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 476458us
I20260709 13:11:10.186892 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.187525 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:10.187604 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.188130 27267 raft_consensus.cc:2368] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
I20260709 13:11:10.188537 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.190430 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:10.191085 28015 raft_consensus.cc:2368] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:11:10.195345 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:10.205826 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 51325.3us
I20260709 13:11:10.207933 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.208271 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.216171 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2fa29e3bcf4670ab310ce67ee127c4" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:10.220072 27380 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:11:10.223636 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.203099   616 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.225458 28015 raft_consensus.cc:2393] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 15: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:11:10.230934 27232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.201959   633 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.235225 27160 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 11 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.239267 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:10.242148 27231 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.205588   657 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.218439   493 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:10.262972 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.218297   557 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.258790 27160 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 15, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.267287 27261 raft_consensus.cc:1240] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Rejecting Update request from peer d02eb2355bc54e7f8c13a30c33793d95 for earlier term 13. Current term is 14. Ops: []
I20260709 13:11:10.270546   616 consensus_queue.cc:1059] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:10.257012   640 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.272221   619 raft_consensus.cc:3055] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:10.277585 27160 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 13, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.281119 27160 catalog_manager.cc:5697] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 6 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 11 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.253540   635 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:11:10.295317 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 86670.4us
I20260709 13:11:10.262063   631 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.300143 27417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:10.300787 27417 raft_consensus.cc:606] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.301139 27417 raft_consensus.cc:614] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:10.272672   619 raft_consensus.cc:740] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:10.302165   631 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.304673   701 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.293601   493 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:10.299429   684 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.259680   633 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.311144   701 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.315651   489 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:10.317749   633 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.329180 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.328963   493 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.318049   694 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.323118   699 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.326843 28014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:10.334712 28014 raft_consensus.cc:606] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:10.306671   509 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:10.333873 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.335108 28014 raft_consensus.cc:614] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:10.339490   694 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.345297 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.346050 27338 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:10.347280   699 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.349120   619 consensus_queue.cc:260] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.350231   699 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.350361   619 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:10.352361   631 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.352258 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.353266 27338 raft_consensus.cc:3060] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.344724   509 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.361464 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.362157 27343 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.341434   701 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:10.363487 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 115728us
I20260709 13:11:10.368531   509 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.371523 28014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:10.372478 28014 raft_consensus.cc:606] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:10.374378 27308 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.378070   708 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:10.386791 27417 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:10.388792 28014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:10.389607 28014 raft_consensus.cc:606] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:10.390846 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:10.392678 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:10.394018 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.394811 27417 raft_consensus.cc:2368] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:10.396257 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.396971 27410 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:10.397033 27343 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:10.400015 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.401199 27410 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:10.286058 27160 catalog_manager.cc:5697] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 12, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 12 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.413930 27309 leader_election.cc:400] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
I20260709 13:11:10.414541 27309 leader_election.cc:403] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.410169 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:10.425004 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.425279 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.425769 27334 raft_consensus.cc:1813] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Handling vote request from an unknown peer 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.426586 27334 raft_consensus.cc:2410] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:11:10.419821   558 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:11:10.427533 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.403990   708 raft_consensus.cc:493] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:10.433386 27160 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.421725   429 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:10.436877 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.432001   631 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.450628 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.451680 27334 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:11:10.441648 27338 raft_consensus.cc:2468] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:10.441994 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.442763 27341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e376a729bb7c47e99662f97b33ea32c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.461647   701 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 17. Current term is 18.
I20260709 13:11:10.448998   631 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.462736   631 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.448998 27160 catalog_manager.cc:5697] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 12, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 12 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.464105 27160 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 14, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 14 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.467331 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.468106 27340 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:10.465672 27160 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.436013   429 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.495584 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.434383   708 raft_consensus.cc:515] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.500574   708 leader_election.cc:290] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.486987   429 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.505930   509 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:10.506451   509 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.508505   509 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.511154 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.512176 27335 raft_consensus.cc:2393] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:10.514319 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:10.517416 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.518262 27268 raft_consensus.cc:2393] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 15: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:10.518496 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.519198 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.505200 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.521090 27380 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.521955   619 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.522647   619 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.519995 27267 raft_consensus.cc:2410] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:10.519847   614 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.471218 27338 raft_consensus.cc:2955] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:10.527431 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.527287 27231 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.528177 27259 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:10.530913 27266 raft_consensus.cc:1275] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:10.531384 27160 catalog_manager.cc:5697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.533653 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:10.536636 27231 leader_election.cc:304] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.537835 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.542021 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:10.541235   504 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:10.543227   504 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:10.544095   504 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.545506   562 raft_consensus.cc:2749] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.533470   614 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.552250 27334 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:11:10.552701 27334 pending_rounds.cc:85] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting all ops after (but not including) 12
I20260709 13:11:10.552965 27334 pending_rounds.cc:107] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:11:10.553188 27334 raft_consensus.cc:2889] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.555142 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.556783 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.557430 27268 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:10.561635 27978 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.564715 27268 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:10.566661 27160 catalog_manager.cc:5697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.569387 27231 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.570395 27160 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 10 to 13, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:10.578572 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:10.586114 27160 catalog_manager.cc:5697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 6 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 11 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.586774 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:10.585419 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.589536 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:10.606716 32358 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:11:10.597353 32711 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:10.615015   704 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:10.598277   634 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:10.617240 28012 raft_consensus.cc:1240] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 18. Current term is 19. Ops: []
I20260709 13:11:10.617431   634 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:10.618081   634 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.566736   631 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.588405   700 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:10.628639   700 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.629021   700 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:10.629650   631 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.588249   658 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:10.580643   320 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.580714 32717 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:10.637140 32717 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.609081 27160 catalog_manager.cc:5697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.647238 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:10.643122 27160 catalog_manager.cc:5697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.685962 27980 leader_election.cc:304] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:10.687127 27308 leader_election.cc:400] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:10.687543 27308 leader_election.cc:403] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.687958   595 raft_consensus.cc:2804] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:10.688480   595 raft_consensus.cc:697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:10.688634 27308 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.689427   595 consensus_queue.cc:237] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.692495   640 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 15. Current term is 16.
I20260709 13:11:10.693174   613 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:10.701800   645 raft_consensus.cc:993] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:10.656203   701 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.702538   701 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.702579   645 raft_consensus.cc:1081] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:10.709384 27259 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:48160
I20260709 13:11:10.710038 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.710599 27412 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:10.720850 27266 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:10.655781   687 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.722267 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.725067 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:10.728817 27160 catalog_manager.cc:5697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 11, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 11 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.727990 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b732e9fe744ccfb9006867b9ec2cd7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.733103 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.734009 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.734872 27412 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.742980 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.744536 27308 leader_election.cc:304] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.591429   509 consensus_queue.cc:1048] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.148s
I20260709 13:11:10.749598 27308 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.751948 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.756143 27266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:10.756781 27266 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.763242 27412 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:10.773310 27308 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:10.767230 27160 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 12, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 12 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.785662 32717 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.786288   658 raft_consensus.cc:993] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:10.755658   563 raft_consensus.cc:2749] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:10.788381   429 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:10.742854   678 raft_consensus.cc:493] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.789347   678 raft_consensus.cc:515] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.741175   708 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:10.792132 27383 leader_election.cc:400] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:11:10.792477 27383 leader_election.cc:403] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.795382   600 consensus_queue.cc:1059] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:10.796239   408 raft_consensus.cc:2749] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 14. Current term is 15.
I20260709 13:11:10.796375   600 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:10.796837   600 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:10.757932   707 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:10.802387   635 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.804302 27160 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.745594   698 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:10.814404 27266 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:10.821033 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.821729 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.802958   635 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.824218 32358 raft_consensus.cc:1081] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:10.825923 27416 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:10.797775   600 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.831522 27259 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:10.832697 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:10.861819 27259 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.861930 27340 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:11:10.741622   687 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.754151   701 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.846760 27417 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:10.846380 27160 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.867743 27233 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:10.870901 27266 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:10.872373 27160 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 10 to 13, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 13 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.886627 27160 catalog_manager.cc:5697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 3 to 11, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 11 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.888607 27340 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:10.891906 27262 raft_consensus.cc:3060] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.893198 27259 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.895807 27160 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 12, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 12 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.898905 27259 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.899755   562 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.900018 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:10.900460   562 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.900949 28012 raft_consensus.cc:3055] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:10.901507 28012 raft_consensus.cc:740] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:10.902544 28012 consensus_queue.cc:260] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:10.904071   562 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.905903   562 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:10.907603   684 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:10.909642   687 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.872169   614 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:11:10.912065   714 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
I20260709 13:11:10.919523   635 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.921228   678 leader_election.cc:290] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:10.923199 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.923956 27339 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16.
I20260709 13:11:10.924891 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.925765 27335 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:10.923357 27341 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:10.926544 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:10.927367   600 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:10.928980 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.931389 27231 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16.
I20260709 13:11:10.931694 27231 leader_election.cc:403] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:10.935432 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 68012.1us
W20260709 13:11:10.938572 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60135.8us
I20260709 13:11:10.940186 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:10.940860 27413 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:10.942625 27262 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:10.943222 27340 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:10.906620   562 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:10.946419 27160 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:10.949182 27160 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 2 to 12, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 12 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.951277 27160 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 6 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 11 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:10.959334 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:10.971637 27408 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:10.969542   616 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:10.953330   684 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:10.976154 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:10.977841 27341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:11.012547 27341 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:11.012955 27341 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:10.974279   638 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:11:11.014782   562 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:10.924985   634 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:11.021399 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 248164us
W20260709 13:11:11.021611 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 54084.8us
I20260709 13:11:11.028646 27308 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:11.013023   678 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16.
I20260709 13:11:11.035787 27414 raft_consensus.cc:1275] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:11.036158 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:11.036994 27335 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:11.038019   500 raft_consensus.cc:2804] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:11.038641   500 raft_consensus.cc:697] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:11.039721   500 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:11.046561 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 47413.3us
I20260709 13:11:10.946077   700 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.049889 28012 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:11.054205 27408 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:11:11.055401 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.056257 27416 raft_consensus.cc:2368] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16.
I20260709 13:11:11.055666 27978 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.061317 27415 raft_consensus.cc:1240] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:11.057403 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.053503 27160 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 15, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 15 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:11.072635 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:11.073896 27233 leader_election.cc:400] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Vote denied by peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) with higher term. Message: Invalid argument: T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 for earlier term 15. Current term is 16.
I20260709 13:11:11.053503   630 consensus_queue.cc:1059] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:11:11.077967   642 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:11.078341   642 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:11.078723   622 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:11.079210   642 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.080675   642 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:11.074651 27233 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:11.082332 27233 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.074190   323 consensus_queue.cc:1048] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:11:11.086997   493 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:11.087582   493 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:11.071261 32358 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.088459   493 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.094007 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c247f301fde4963b4d1761a0b3254a9" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.094847 27334 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:11.096335 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.098529 27412 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:11.102964 27339 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:11:11.054834   558 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.115619 27233 leader_election.cc:304] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.089926   686 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:11.045444   506 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:11:11.079216   687 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:11.120203   695 raft_consensus.cc:2749] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:11.069998 27341 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.138801 27335 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:11.079242   622 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.125247   687 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:11.120288   383 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:11.118182   558 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.151726   687 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:11.146852   703 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:11.124043   684 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.220844   558 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:11.280316 28012 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 12.
I20260709 13:11:11.307627   700 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:11.309538   622 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:11.211886 32358 consensus_queue.cc:1059] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:11:11.312191 32358 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:11.312647 32358 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:11.313730 32358 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.211719   703 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.318035   703 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:11.335952 27267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.060s	sys 0.100s
W20260709 13:11:11.383196 27267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.061s	sys 0.100s
I20260709 13:11:11.401018 27341 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:11.333953   634 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:11.303014   687 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.476788 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:11.518167 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:11.528965 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:11.542557 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:11.546023 27979 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.544642   714 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:11.540719   614 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:11.567473 27415 raft_consensus.cc:1275] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:11:11.557117   600 consensus_meta.cc:287] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.002s
I20260709 13:11:11.564376   614 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:11.588717   687 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:11.591756   614 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.606475   600 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.607224   600 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.609738 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:11.610355 27415 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:11.638716 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.641425 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:11.644622 27414 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 16: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:11.650939 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:11.653760 27408 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:11.690233 27414 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:11.701957   600 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:11.673069   646 consensus_queue.cc:1048] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:11:11.722138 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:11.730752 27415 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
W20260709 13:11:11.737689 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 225780us
I20260709 13:11:11.738649 27308 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:11.698401   614 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.739259   703 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:11:11.750490   323 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:11.754659   323 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:11.755697   323 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:11.737206   701 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.758075 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:11.745375   646 consensus_queue.cc:1059] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:11:11.769790   701 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:11.808269 27259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:11.812036 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:11.821576 27264 raft_consensus.cc:2410] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:11:11.831637 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b61886e4de43d1a7459c0b2b639537" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:11.834622 27259 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:11.841045 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:11.864766 27309 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.866403 27309 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.868080 27309 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:11.849974   703 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:11.869395   703 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:11.871218   733 log.cc:927] Time spent T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:11:11.872660   703 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:11.874307 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 310858us
I20260709 13:11:11.883750   634 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:11.884606   634 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:11.912171   701 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:11.913156   706 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.913872   706 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:11.919876   735 log.cc:927] Time spent T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:11:11.923180   734 log.cc:927] Time spent T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:11:11.854799   614 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:11.931094 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54071.7us
I20260709 13:11:11.935490 27334 raft_consensus.cc:1240] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:11:11.937637 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69674.9us
W20260709 13:11:11.940387 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 77828.3us
I20260709 13:11:11.943747   707 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:11.974766   707 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
W20260709 13:11:11.981032   736 log.cc:927] Time spent T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:11:11.981047   707 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.007532 27410 raft_consensus.cc:1240] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer b0e4232110db400d8f43fe2170c24c95 for earlier term 16. Current term is 17. Ops: []
W20260709 13:11:12.012938 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 372106us
I20260709 13:11:12.028035 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.029012 27416 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:11.978534   716 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:12.040131 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.041075 27417 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:12.013993   702 raft_consensus.cc:3055] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:12.061262 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.062106 27342 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:11:12.071568 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:12.080425 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d586a4492094f0dbea7efd8255dd991" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.092484 28014 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:12.066006 27380 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.098222 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:12.099344 27338 raft_consensus.cc:2393] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:12.102413 27340 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:12.105031 27343 raft_consensus.cc:2393] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 13: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:12.049283   702 raft_consensus.cc:740] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:12.123311 27265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59118 (request call id 2053) took 1071 ms. Trace:
I20260709 13:11:12.123881 27265 rpcz_store.cc:276] 0709 13:11:11.052233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.060560 (+  8327us) service_pool.cc:224] Handling call
0709 13:11:11.060918 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.079436 (+ 18518us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:11.510025 (+430589us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.797181 (+287156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.798049 (+   868us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.806913 (+  8864us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:11.806960 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.807028 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.123016 (+315988us) raft_consensus.cc:1685] finished
0709 13:11:12.123046 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.123232 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18033,"prepare.queue_time_us":485601,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":21463,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":6578,"thread_start_us":681843,"threads_started":2,"wal-append.queue_time_us":493762}
I20260709 13:11:12.042966   716 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.067226   706 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:12.155964 27231 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:12.172451   738 log.cc:927] Time spent T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:11:12.173540   726 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.430s	user 0.002s	sys 0.002s
I20260709 13:11:12.173866   716 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:12.161942   730 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:12.179709   635 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:12.183622   730 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.184267   730 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.165642   408 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:12.185472   408 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.185926   408 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.187666   730 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.137122   562 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:12.200842 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.195992   635 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:12.166581   702 consensus_queue.cc:260] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:12.211834 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 197218us
I20260709 13:11:12.229717   743 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:12.263600 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.265704 32358 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.272478   757 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:12.273219   757 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.279038 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.280218   753 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:12.280804   753 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.281230   753 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.281922   408 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.284116   743 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.286700   743 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:12.290052 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.290902 27414 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:12.292634 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.293656   646 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:12.225870   635 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.294139   646 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.294585   646 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.299433   616 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.300051   616 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.305179 27308 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:12.299448   754 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 13:11:12.331321 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:12.322211   758 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.082s	user 0.001s	sys 0.002s
I20260709 13:11:12.342424 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:12.331629 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.347915 27335 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
W20260709 13:11:12.326736   720 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:11:12.324397   740 log.cc:927] Time spent T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.168s	user 0.004s	sys 0.000s
W20260709 13:11:12.331245   751 log.cc:927] Time spent T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:11:12.353636   408 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:12.358870 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.361114 27268 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:12.334949   716 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:12.375679   716 raft_consensus.cc:493] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:12.376161   716 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:12.390969 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.346491   638 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
W20260709 13:11:12.394861 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 193201us
I20260709 13:11:12.356241   323 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:11:12.395507 27265 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:12.360908   600 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:12.365149   730 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:12.419904 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:12.420946 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.421630 27267 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:12.423243 28012 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:12.425172 27415 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:12.426823 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.427623 27264 raft_consensus.cc:2393] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 14: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
W20260709 13:11:12.433115 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 84870.1us
W20260709 13:11:12.436551 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 88117.7us
I20260709 13:11:12.437628 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:12.442549 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.443264 27268 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:12.451036 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:12.451455 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.451925 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.452580 27409 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 16.
I20260709 13:11:12.454101 27267 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:12.475135 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:12.475989 27267 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.488864 27416 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:12.502708 27417 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 13.
I20260709 13:11:12.503312   757 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.504624   753 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.405467   638 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.447952   687 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:11:12.508510   616 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.428160   600 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.428375   730 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:12.526928 27981 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.521250   638 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:12.524987 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 60817us
I20260709 13:11:12.532848 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:12.544314   730 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:12.544152   646 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.556046   702 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:12.558853   635 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.562213 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.564471 27267 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:12.567759 27417 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:11:12.563323 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 72712.5us
I20260709 13:11:12.572400 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:12.573076 27409 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:12.575510 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.579401   646 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:12.580011   600 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:12.583212   506 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:12.587809 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:12.588474 27411 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.605187 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.606051 28011 raft_consensus.cc:2368] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 19. Current term is 20.
I20260709 13:11:12.568013   756 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.619879 28012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55768 (request call id 749) took 1114 ms. Trace:
I20260709 13:11:12.624032 28014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.624691 28014 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:12.620640 28012 rpcz_store.cc:276] 0709 13:11:11.476388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.476540 (+   152us) service_pool.cc:224] Handling call
0709 13:11:12.590609 (+1114069us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54006608d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c352fa 00007fbd87bf6b17 00007fbd811716d4 00007fbd81171662 00007fbd81171591 00007fbd8117150c 00007fbd811707c2 00007fbd80f6c48c 00007fbd80f6b8c6 00007fbd80f6b26f
0709 13:11:12.590686 (+    77us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087470464}
I20260709 13:11:12.623803 27383 leader_election.cc:304] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.631811 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:12.639317 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.640342 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.639956 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:12.639336 27417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:12.639974 27267 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:12.621613   756 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.650033 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:12.652156 27233 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:12.658093 27342 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:12.650173 27383 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.625169   730 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:12.575466   716 raft_consensus.cc:515] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.663751 27413 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:12.677100 27233 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:12.690480 27409 raft_consensus.cc:2468] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:12.645236   748 raft_consensus.cc:2804] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:12.695533 27342 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
I20260709 13:11:12.696655 27233 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:12.661988   686 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.660029   756 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.711341 27340 raft_consensus.cc:3060] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:12.638365   323 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:12.685847   687 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:12.698689   764 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:12.699921   638 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:12.745970   765 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:12.709486   686 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.714210   748 raft_consensus.cc:697] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:12.692412   730 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.772017   716 leader_election.cc:290] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:12.742959   741 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:12.745368   764 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.774722 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 111011us
I20260709 13:11:12.755916   687 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:12.764910   686 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.782305 27340 raft_consensus.cc:2468] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:12.830662   748 consensus_queue.cc:237] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.787757   764 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:12.838047   730 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.839881 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:12.746587   765 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.852707 27411 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
I20260709 13:11:12.748091   684 raft_consensus.cc:493] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:12.861020 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 79055.8us
I20260709 13:11:12.884270 28012 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:12.896864 27380 leader_election.cc:400] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 19. Current term is 20.
I20260709 13:11:12.897253 27380 leader_election.cc:403] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:12.899775 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 330376us
I20260709 13:11:12.900777 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:12.903687 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 253612us
I20260709 13:11:12.911379 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:12.904032   600 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 19. Current term is 20.
W20260709 13:11:12.919916 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 223351us
I20260709 13:11:12.919323 27308 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:12.893532   638 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:12.906277   489 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:12.895466   684 raft_consensus.cc:515] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.933034   784 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:12.933374   500 raft_consensus.cc:2804] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:12.936673 27261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:12.938133 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a055e36ded584640806637e94e87f6b9" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:12.959312 27268 raft_consensus.cc:2368] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:11:12.938781   634 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:12.939893 27260 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:12.944561 27334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.961174 27334 raft_consensus.cc:2368] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 19. Current term is 20.
I20260709 13:11:12.945417 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.932111   323 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:12.964123   638 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.955679   489 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.966976   489 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:12.968914   500 raft_consensus.cc:697] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:12.987788 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:12.963460   634 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:12.990127   794 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.995774   794 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:12.997911   794 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:12.999739   634 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:13.002357   684 leader_election.cc:290] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:13.006353 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46312.8us
I20260709 13:11:13.009891 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:13.012907 27260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:13.025823 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:13.026471   753 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:13.027467 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:13.028918   749 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.029093   500 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:13.037750 27978 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:13.038945 32358 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:13.039536 32358 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:13.040518 32358 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:13.045825 28011 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:11:13.049968   770 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:13.054908 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:13.113297 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.123967 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.131456 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.132341 27340 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 19: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:13.134761 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:13.150709 27380 leader_election.cc:400] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457) with higher term. Message: Invalid argument: T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for earlier term 19. Current term is 20.
I20260709 13:11:13.168751 27309 leader_election.cc:400] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:11:13.176296 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
W20260709 13:11:13.182276 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 254207us
I20260709 13:11:13.191799 27309 leader_election.cc:403] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:11:13.184990 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 249006us
I20260709 13:11:13.178220 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:12.962126   687 consensus_queue.cc:237] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:13.199898 27413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:13.154794   686 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:13.213783 27309 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:13.236068 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.238291 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.200330   765 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:13.242296 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:13.243770 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3412bba6f0c740dd9adb1895146dd937" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:13.205538   600 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:13.247139 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 66455us
I20260709 13:11:13.209476   770 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:11:13.221637   789 raft_consensus.cc:2749] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) with higher term. Message: Invalid argument: T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 14. Current term is 15.
I20260709 13:11:13.282534 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:13.241048   753 raft_consensus.cc:2749] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:13.199661   788 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:11:13.292985 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
W20260709 13:11:13.298403   796 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:11:13.304212 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:13.280227   794 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.308902   799 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:13.309541   799 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:13.309985   799 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:13.312162   638 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:13.288269   756 consensus_meta.cc:287] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.002s
W20260709 13:11:13.304780 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 182503us
I20260709 13:11:13.306205 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:13.317291 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 136492us
I20260709 13:11:13.318571   744 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:13.326435   730 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:13.324142   756 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:13.374049 27231 leader_election.cc:304] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:13.379094 27410 raft_consensus.cc:1240] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Rejecting Update request from peer 161ec4aacbd54a4989d6762a9ed4eafe for earlier term 16. Current term is 17. Ops: []
I20260709 13:11:13.382416   791 raft_consensus.cc:2749] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:13.374228   764 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:13.451960   756 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:13.455497 27264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:13.461508 27260 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:13.467223 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:11:13.526691   805 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:11:13.528338   810 log.cc:927] Time spent T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:11:13.544606   764 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:13.550411 27412 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:13.551457 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:13.552098 28007 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.553633   547 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:13.559623 28007 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:13.561395 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:13.562543   757 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:13.563176   757 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:13.564297   757 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:13.570736   804 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:11:13.583539 27342 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:13.593626 27342 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:11:13.607996   593 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:13.610658   788 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:13.662942 27338 raft_consensus.cc:1275] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:11:13.672613   748 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.673223   686 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:13.675390 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:13.676162 28007 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:13.688380 27415 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:13.699627 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:13.705363 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:13.706447 27267 raft_consensus.cc:2393] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 17: Already voted for candidate 203d83f7fac847e0beee51aa18513b25 in this term.
I20260709 13:11:13.685977   799 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:13.714004 27410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:13.727103 27233 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:13.717715   765 consensus_queue.cc:1048] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:11:13.728286   813 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.731801 27334 raft_consensus.cc:1240] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 17. Current term is 18. Ops: []
I20260709 13:11:13.713735   383 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:11:13.724885   791 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:11:13.764709 27409 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:11:13.775447   707 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:13.777922   701 consensus_queue.cc:1059] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:13.779016   701 raft_consensus.cc:3055] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:13.779696   701 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:13.780841   701 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:13.782466   701 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:13.784181   797 consensus_queue.cc:1059] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:11:13.819730   797 consensus_queue.cc:1243] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Peer 161ec4aacbd54a4989d6762a9ed4eafe log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:13.841708   799 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:13.857769 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 67728.5us
I20260709 13:11:13.865345 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:13.878957 28007 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:13.880400 27266 raft_consensus.cc:3055] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:13.880906 27266 raft_consensus.cc:740] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:13.880659 27231 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:13.886243 27335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:13.887076 27335 raft_consensus.cc:2393] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 19: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:13.881731 27266 consensus_queue.cc:260] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:13.892093 27266 raft_consensus.cc:3060] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:13.904246   730 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:13.930887 27266 raft_consensus.cc:1275] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:11:13.939858 27266 pending_rounds.cc:85] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting all ops after (but not including) 9
I20260709 13:11:13.940315 27266 pending_rounds.cc:107] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:11:13.940667 27266 raft_consensus.cc:2889] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:13.984372   821 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:11:13.944677   797 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:11:14.081094   700 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.081683   700 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:14.084275   700 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:13.944895   730 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:14.088255   730 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:14.093665 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 56326.5us
W20260709 13:11:14.094230 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 76267us
W20260709 13:11:14.104528   826 log.cc:927] Time spent T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
I20260709 13:11:14.106853   558 consensus_queue.cc:1048] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:14.132923 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:14.133989 28011 raft_consensus.cc:2410] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:11:14.176271 27263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:14.178645 28007 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:11:14.193230 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 326265us
I20260709 13:11:14.205377 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.209488 27309 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:14.175729   686 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
W20260709 13:11:14.216747 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45569.9us
I20260709 13:11:14.225219   686 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:14.231571   686 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:14.234613 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:14.274165 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 54388.9us
W20260709 13:11:14.274255 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 58172.3us
I20260709 13:11:14.225335   779 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:14.223320   794 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:11:14.332407 27267 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:11:14.371765 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 81886.8us
W20260709 13:11:14.357683   821 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:11:14.391506 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 169203us
I20260709 13:11:14.529911 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:14.564864   828 log.cc:927] Time spent T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:11:14.584753 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:14.586839   802 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:14.620645 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45135.4us
I20260709 13:11:14.622493   749 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:14.624070 27166 catalog_manager.cc:5697] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 15, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 15 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.626386 27166 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:14.628002 27166 catalog_manager.cc:5697] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 9 to 11, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.629850 27166 catalog_manager.cc:5697] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:14.634009 28011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:14.634791 28011 raft_consensus.cc:606] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:14.635226 28011 raft_consensus.cc:614] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.645577 27166 catalog_manager.cc:5697] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.660871 27166 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 17 to 19, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 19 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:14.699361 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55519.8us
I20260709 13:11:14.709867 27340 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:14.713181   797 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:14.718717 28010 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:11:14.733098   686 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:14.800792 27166 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.809208 27166 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 10 to 15, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 15 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:14.817842 27166 catalog_manager.cc:5697] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.825758 27160 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 215) took 19994 ms (client timeout 15000 ms). Trace:
I20260709 13:11:14.827482 28010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:14.828747 28010 raft_consensus.cc:606] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:14.822809 27166 catalog_manager.cc:5697] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 19 to 21, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 21 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:14.838917 27166 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 12, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 12 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:14.843267 28007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:14.850814 28007 raft_consensus.cc:606] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:14.851481 28007 raft_consensus.cc:614] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:14.827944 27160 rpcz_store.cc:269] 0709 13:10:54.927868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.980108 (+ 52240us) service_pool.cc:224] Handling call
0709 13:11:14.815630 (+19835522us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:11.797151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:11.916765 (+119614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:11.916818 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:11:11.916847 (+    29us) tablet.cc:662] Decoding operations
0709 13:11:11.918846 (+  1999us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:11.918913 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:11.918952 (+    39us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:11:12.124716 (+205764us) tablet.cc:701] Row locks acquired
0709 13:11:12.124749 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:11:12.124952 (+   203us) write_op.cc:270] Start()
0709 13:11:12.125121 (+   169us) write_op.cc:276] Timestamp: P: 1783602672124888 usec, L: 0
0709 13:11:12.125154 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:12.177492 (+ 52338us) log.cc:844] Serialized 10306 byte log entry
0709 13:11:12.449488 (+271996us) op_driver.cc:464] REPLICATION: finished
0709 13:11:12.545645 (+ 96157us) write_op.cc:301] APPLY: starting
0709 13:11:12.545751 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:13.295592 (+749841us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:13.295740 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:13.850642 (+554902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:13.851090 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:11:13.851155 (+    65us) write_op.cc:312] APPLY: finished
0709 13:11:13.981288 (+130133us) log.cc:844] Serialized 228 byte log entry
0709 13:11:14.219339 (+238051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.270608 (+ 51269us) write_op.cc:454] Released schema lock
0709 13:11:14.282159 (+ 11551us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:14.308481 (+ 26322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.308524 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12743,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":95884,"apply.run_cpu_time_us":106481,"apply.run_wall_time_us":1750155,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112651,"num_ops":26,"prepare.queue_time_us":595996,"prepare.run_cpu_time_us":43236,"prepare.run_wall_time_us":545491,"raft.queue_time_us":136807,"raft.run_cpu_time_us":18689,"raft.run_wall_time_us":63169,"replication_time_us":324153,"thread_start_us":991989,"threads_started":5,"wal-append.queue_time_us":537616,"wal-append.run_cpu_time_us":60439,"wal-append.run_wall_time_us":1125048}]]}
I20260709 13:11:14.854125 27166 catalog_manager.cc:5697] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.901713 27410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60414d130cdc460696513fb91e20161f"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:14.902647 27410 raft_consensus.cc:606] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:14.903123 27410 raft_consensus.cc:614] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.930840 28010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed"
dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:35486
I20260709 13:11:14.931747 28010 raft_consensus.cc:606] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:14.932463 28010 raft_consensus.cc:614] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.936283 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:14.949236   774 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:14.950227   774 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:14.981267 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:14.982579 27411 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:14.896848 27166 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 13, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:15.001973 27166 catalog_manager.cc:5697] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 8 to 20, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 20 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.985111   774 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:15.003593 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:15.015107 27166 catalog_manager.cc:5697] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 7 to 9, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 11 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.128010 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:15.128821 27339 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:15.143659   593 raft_consensus.cc:993] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:15.144307   593 raft_consensus.cc:1081] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:15.146863 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:15.147568 27340 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:15.147953 27340 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.181939   730 raft_consensus.cc:493] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:15.182796   730 raft_consensus.cc:515] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:15.183841 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:15.185690   562 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:15.186158   562 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:15.186583   562 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:15.273002   730 leader_election.cc:290] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:15.274876 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:15.281595   562 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:15.285497   562 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:15.300637 27340 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:15.303968 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:15.320109 27411 raft_consensus.cc:2393] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 203d83f7fac847e0beee51aa18513b25 in current term 17: Already voted for candidate d02eb2355bc54e7f8c13a30c33793d95 in this term.
I20260709 13:11:15.338681 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:15.370246 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a30a45f010dd49e5a9ddb107297fa03e" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:15.384003 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:15.389482 27231 leader_election.cc:304] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:15.412657 27340 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 21 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:15.413435   801 raft_consensus.cc:2749] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:15.416383 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:15.430455 28010 raft_consensus.cc:3055] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:11:15.430904 28010 raft_consensus.cc:740] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:15.465982 28010 consensus_queue.cc:260] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:15.491986 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:15.494956 27411 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.523376 28010 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:15.545231 27338 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:15.546861 27231 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:15.549574   797 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:15.550149   797 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:15.551146   797 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:15.555258 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 75543.3us
I20260709 13:11:15.571748 28010 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 21.
I20260709 13:11:15.575536 27411 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 21.
I20260709 13:11:15.594655 27308 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:15.598173   853 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:15.599717   853 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:15.600713   853 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:15.650352   600 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.651001   600 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:15.654444 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "203d83f7fac847e0beee51aa18513b25" is_pre_election: true
I20260709 13:11:15.662956 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:15.663878 27338 raft_consensus.cc:2410] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:11:15.665007 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:15.665887   765 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:15.669462   600 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:15.744822 27166 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 133) took 5171 ms. Trace:
I20260709 13:11:15.769507 27163 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 11 to 13, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.745358 27166 rpcz_store.cc:276] 0709 13:11:10.632849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.633089 (+   240us) service_pool.cc:224] Handling call
0709 13:11:15.744734 (+5111645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.331647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.332369 (+   722us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.332422 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:11:15.332456 (+    34us) tablet.cc:662] Decoding operations
0709 13:11:15.334065 (+  1609us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.334159 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.334282 (+   123us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:11:15.335727 (+  1445us) tablet.cc:701] Row locks acquired
0709 13:11:15.335778 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:11:15.335950 (+   172us) write_op.cc:270] Start()
0709 13:11:15.336122 (+   172us) write_op.cc:276] Timestamp: P: 1783602675335879 usec, L: 0
0709 13:11:15.336161 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.336876 (+   715us) log.cc:844] Serialized 6008 byte log entry
0709 13:11:15.435471 (+ 98595us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.540904 (+105433us) write_op.cc:301] APPLY: starting
0709 13:11:15.541008 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.649018 (+108010us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.649146 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:15.674460 (+ 25314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:15.674807 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:11:15.674863 (+    56us) write_op.cc:312] APPLY: finished
0709 13:11:15.679378 (+  4515us) log.cc:844] Serialized 139 byte log entry
0709 13:11:15.682387 (+  3009us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.682566 (+   179us) write_op.cc:454] Released schema lock
0709 13:11:15.682658 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:15.689004 (+  6346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.689045 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":158217,"reported_tablets":21,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":105116,"apply.run_cpu_time_us":21040,"apply.run_wall_time_us":148019,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66737,"num_ops":15,"prepare.queue_time_us":79114,"prepare.run_cpu_time_us":5622,"prepare.run_wall_time_us":5699,"replication_time_us":95937,"thread_start_us":73720,"threads_started":2}]]}
I20260709 13:11:15.813371 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet a30a45f010dd49e5a9ddb107297fa03e with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:55650
I20260709 13:11:15.840770 27163 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 8 to 11, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 11 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.843411 27163 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 8 to 9, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 9 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:15.849538   859 tablet_replica.cc:333] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:15.850008 27163 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 7 to 9, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 9 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.850870   859 raft_consensus.cc:2243] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:15.854215   859 raft_consensus.cc:2272] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:15.852869 27163 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 7 to 9, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 9 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.869589   859 ts_tablet_manager.cc:1916] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:15.901178 27166 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:15.904706 27166 catalog_manager.cc:5697] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.907073 27166 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 18 to 19, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 19 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:15.908785 27166 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 16 to 17, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 17 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:15.918951   859 ts_tablet_manager.cc:1929] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:11:15.929479   859 log.cc:1199] T a30a45f010dd49e5a9ddb107297fa03e P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/a30a45f010dd49e5a9ddb107297fa03e
I20260709 13:11:15.942999 27411 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:15.946424   797 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:15.941243 27166 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 11 to 12, leader changed from b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 12 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:15.965273 27163 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 234) took 48061 ms (client timeout 15000 ms). Trace:
W20260709 13:11:15.965708 27163 rpcz_store.cc:269] 0709 13:10:27.904385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:27.905148 (+   763us) service_pool.cc:224] Handling call
0709 13:11:15.965176 (+48060028us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.868497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.869097 (+   600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.869135 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:11:15.869154 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:15.869865 (+   711us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.869970 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.870007 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:11:15.870622 (+   615us) tablet.cc:701] Row locks acquired
0709 13:11:15.870641 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:15.870805 (+   164us) write_op.cc:270] Start()
0709 13:11:15.870913 (+   108us) write_op.cc:276] Timestamp: P: 1783602675870755 usec, L: 0
0709 13:11:15.870934 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.880046 (+  9112us) log.cc:844] Serialized 2109 byte log entry
0709 13:11:15.882708 (+  2662us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.883182 (+   474us) write_op.cc:301] APPLY: starting
0709 13:11:15.883264 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.886172 (+  2908us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.886275 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:15.891190 (+  4915us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:15.891389 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:11:15.891445 (+    56us) write_op.cc:312] APPLY: finished
0709 13:11:15.891673 (+   228us) log.cc:844] Serialized 57 byte log entry
0709 13:11:15.892433 (+   760us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.892557 (+   124us) write_op.cc:454] Released schema lock
0709 13:11:15.892602 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:15.893145 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.893181 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82280,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":267,"apply.run_cpu_time_us":7379,"apply.run_wall_time_us":9740,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":7310,"prepare.run_cpu_time_us":3674,"prepare.run_wall_time_us":24629,"replication_time_us":11641,"thread_start_us":6345,"threads_started":1}]]}
I20260709 13:11:15.984160 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet a30a45f010dd49e5a9ddb107297fa03e (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:11:16.008822 27338 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:11:16.014086   686 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:16.013563 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:16.046101 27161 catalog_manager.cc:5697] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.047519 27161 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 8 to 15, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 15 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.049324 27161 catalog_manager.cc:5697] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.050877 27161 catalog_manager.cc:5697] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 19, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 19 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.072597 27161 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 18, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.092041 27161 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 15 to 16, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 16 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.109863 27161 catalog_manager.cc:5697] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 16 to 19, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 19 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.116307 27161 catalog_manager.cc:5697] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 11 to 12, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 12 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.122732 27161 catalog_manager.cc:5697] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.140441 27161 catalog_manager.cc:5697] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 16, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 16 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.146588 27161 catalog_manager.cc:5697] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 11 to 13, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.153985 27161 catalog_manager.cc:5697] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 7 to 17, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 17 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.164824 27161 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.176569 27161 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.181228 28010 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:16.201970 27161 catalog_manager.cc:5697] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 11 to 12, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 12 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.209793   853 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:16.212903 27411 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:11:16.220577   500 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:16.350250 27161 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 11 to 18, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.358348 27161 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 12 to 16, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 16 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.407050 27161 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 12 to 15, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.435959 27161 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:16.440594 27161 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 9 to 18, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 18 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:16.815501 27166 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:16.935062 27161 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 216) took 4089 ms. Trace:
I20260709 13:11:16.937305 27160 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 11 to 13, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 13 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.946080 27160 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 11 to 13, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 13 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.935570 27161 rpcz_store.cc:276] 0709 13:11:12.846191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:12.863536 (+ 17345us) service_pool.cc:224] Handling call
0709 13:11:16.934963 (+4071427us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:16.581349 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:16.581929 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:16.581962 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:11:16.581989 (+    27us) tablet.cc:662] Decoding operations
0709 13:11:16.583762 (+  1773us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:16.583853 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:16.583885 (+    32us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:11:16.585424 (+  1539us) tablet.cc:701] Row locks acquired
0709 13:11:16.585442 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:16.585627 (+   185us) write_op.cc:270] Start()
0709 13:11:16.585755 (+   128us) write_op.cc:276] Timestamp: P: 1783602676585564 usec, L: 0
0709 13:11:16.585774 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:16.586502 (+   728us) log.cc:844] Serialized 7965 byte log entry
0709 13:11:16.598388 (+ 11886us) op_driver.cc:464] REPLICATION: finished
0709 13:11:16.657164 (+ 58776us) write_op.cc:301] APPLY: starting
0709 13:11:16.657244 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:16.723633 (+ 66389us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:16.723754 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:16.754887 (+ 31133us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:16.787268 (+ 32381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:11:16.787331 (+    63us) write_op.cc:312] APPLY: finished
0709 13:11:16.787943 (+   612us) log.cc:844] Serialized 180 byte log entry
0709 13:11:16.795865 (+  7922us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.796114 (+   249us) write_op.cc:454] Released schema lock
0709 13:11:16.796177 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:16.844352 (+ 48175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.844394 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24506,"reported_tablets":51,"spinlock_wait_cycles":80000,"child_traces":[["op",{"apply.queue_time_us":58508,"apply.run_cpu_time_us":26381,"apply.run_wall_time_us":187139,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87607,"num_ops":20,"prepare.queue_time_us":45625,"prepare.run_cpu_time_us":5495,"prepare.run_wall_time_us":16949,"replication_time_us":12470,"thread_start_us":105183,"threads_started":2}]]}
I20260709 13:11:17.021647 27409 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:17.200970 27160 catalog_manager.cc:5697] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 16 to 19, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 19 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:17.206048 27160 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 12 to 16, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 16 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
W20260709 13:11:17.223241 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 55173.1us
I20260709 13:11:17.308799 27339 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:17.258961 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 104147us
W20260709 13:11:17.267067 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 206822us
W20260709 13:11:17.281973 27380 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c065641be1624ea49a986708690a8b46. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:17.347483 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 65724.8us
W20260709 13:11:17.292800 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 53055.4us
I20260709 13:11:17.372893 27262 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:17.408288   850 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:17.429801   600 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:17.378103 27160 catalog_manager.cc:5697] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:17.445153 27160 catalog_manager.cc:5697] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 8 to 18. New cstate: current_term: 18 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:17.451196   744 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:17.467676 27267 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:17.530308 27342 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:11:17.536816 27214 auto_rebalancer.cc:629] Failed to schedule move for tablet 13cceb5d4cfd4e358a438f514c9e75f0: Illegal state: Replica 161ec4aacbd54a4989d6762a9ed4eafe is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:17.544135 27415 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:17.549404 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:17.636651 27267 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:11:17.637401 27380 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 415aa8030d05423fbf90a8f010b516d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.638257   872 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:17.639289 27342 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:11:17.641207   872 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:17.673520 27160 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 215) took 2012 ms. Trace:
I20260709 13:11:17.673889 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet a30a45f010dd49e5a9ddb107297fa03e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:55650
I20260709 13:11:17.712417   744 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:17.718376 27339 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:17.749959 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:17.750761 27415 raft_consensus.cc:606] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:17.754900 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet a30a45f010dd49e5a9ddb107297fa03e (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:11:17.759063 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:17.759728 27415 raft_consensus.cc:606] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:17.762733 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:17.763280 27415 raft_consensus.cc:606] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:17.766287 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
new_leader_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:33594
I20260709 13:11:17.766911 27415 raft_consensus.cc:606] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Received request to transfer leadership to TS 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:17.770969 27267 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:17.773407 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:17.776346 27161 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:17.673919 27160 rpcz_store.cc:276] 0709 13:11:15.661609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.661828 (+   219us) service_pool.cc:224] Handling call
0709 13:11:17.673429 (+2011601us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:17.533376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:17.533998 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:17.534027 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:11:17.534045 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:17.534832 (+   787us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:17.534913 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:17.534945 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:17.537383 (+  2438us) tablet.cc:701] Row locks acquired
0709 13:11:17.537402 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:17.537552 (+   150us) write_op.cc:270] Start()
0709 13:11:17.537743 (+   191us) write_op.cc:276] Timestamp: P: 1783602677537505 usec, L: 0
0709 13:11:17.537771 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:11:17.538368 (+   597us) log.cc:844] Serialized 2500 byte log entry
0709 13:11:17.554538 (+ 16170us) op_driver.cc:464] REPLICATION: finished
0709 13:11:17.556103 (+  1565us) write_op.cc:301] APPLY: starting
0709 13:11:17.556184 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:17.559622 (+  3438us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:17.559713 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:17.563670 (+  3957us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:17.563875 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:11:17.563917 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:17.564168 (+   251us) log.cc:844] Serialized 65 byte log entry
0709 13:11:17.578414 (+ 14246us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:17.578521 (+   107us) write_op.cc:454] Released schema lock
0709 13:11:17.578569 (+    48us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":51,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":1316,"apply.run_cpu_time_us":8775,"apply.run_wall_time_us":22840,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":80476,"prepare.run_cpu_time_us":3318,"prepare.run_wall_time_us":11112,"replication_time_us":16607,"thread_start_us":144645,"threads_started":2}]]}
I20260709 13:11:17.786275 27161 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 17, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 17 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:17.793318   872 raft_consensus.cc:993] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:17.794020   872 raft_consensus.cc:1081] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:17.795765 27262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59104
I20260709 13:11:17.796296 27262 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.796679 27262 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.801679   600 raft_consensus.cc:993] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:17.802183   600 raft_consensus.cc:1081] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:17.806123 27262 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.806936 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:17.815856 27342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52492
I20260709 13:11:17.817669 27342 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.818127 27342 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.822335 27336 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:17.826217 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:17.826956 27415 raft_consensus.cc:3055] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:11:17.827338 27415 raft_consensus.cc:740] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:17.831534 27415 consensus_queue.cc:260] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.832780 27415 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.836867 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:17.837491 27338 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:17.837936 27262 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:17.853236   888 raft_consensus.cc:993] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:17.853753   888 raft_consensus.cc:1081] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:17.856029 27342 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.856467 27415 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:17.858059 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52492
I20260709 13:11:17.858573 27340 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.858911 27340 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.860674 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:17.861294 27415 raft_consensus.cc:3055] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:17.861660 27415 raft_consensus.cc:740] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:17.863186 27233 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:17.864099   797 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:17.864500 27342 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:17.864553   797 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:17.863296 27415 consensus_queue.cc:260] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.867439   797 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.868932 27415 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.865850 27340 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.873808 27338 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 17.
I20260709 13:11:17.874238 27265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43ab3e6cd15341cd8cc43296cb7ce69d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:17.874840 27265 raft_consensus.cc:3060] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:17.876103 27412 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:11:17.873835 27306 consensus_peers.cc:597] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca25783a146d4038878d9ffd69f34217. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:17.890087 27267 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:17.890101 27265 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
I20260709 13:11:17.891880   870 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:17.892248 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:17.892966 27409 raft_consensus.cc:3055] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:17.893307 27409 raft_consensus.cc:740] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:17.894141 27409 consensus_queue.cc:260] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.895291 27409 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:17.895203 27158 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 235) took 20576 ms (client timeout 15000 ms). Trace:
I20260709 13:11:17.896852 27340 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:17.901072 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
W20260709 13:11:17.900190 27158 rpcz_store.cc:269] 0709 13:10:57.318505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.323361 (+  4856us) service_pool.cc:224] Handling call
0709 13:11:17.895044 (+20571683us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":51}
I20260709 13:11:17.905507 27309 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:17.906466   870 raft_consensus.cc:2804] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:17.901660 27267 raft_consensus.cc:3060] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:17.914026   883 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:11:17.919389 27415 raft_consensus.cc:2468] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
I20260709 13:11:17.906988   870 raft_consensus.cc:697] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:17.919386 27267 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:17.924288 27309 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:17.921665   870 consensus_queue.cc:237] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.931140 27409 raft_consensus.cc:2468] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:17.934315   867 raft_consensus.cc:2804] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:17.962852   867 raft_consensus.cc:697] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:17.963830   867 consensus_queue.cc:237] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:17.981308   900 ts_tablet_manager.cc:933] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:17.989189   888 raft_consensus.cc:993] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:17.989825   888 raft_consensus.cc:1081] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:17.996804 27262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59104
I20260709 13:11:17.997560 27262 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.997984 27262 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.006632 27262 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:18.009745 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:18.010440 27412 raft_consensus.cc:3055] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:18.010751 27412 raft_consensus.cc:740] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:18.009820   899 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:18.011502 27412 consensus_queue.cc:260] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:18.012609 27412 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.014281 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:18.015883 28007 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:18.023149 27415 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:18.032667 27262 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Requested vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:18.039414 28007 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:18.045648 27265 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:18.047261 27158 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.051517 27231 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:18.053393   797 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:18.053896   797 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:18.054989   797 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:18.087620   900 tablet_copy_client.cc:323] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:11:18.091570 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet c065641be1624ea49a986708690a8b46 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:11:18.092170 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet c065641be1624ea49a986708690a8b46 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-c065641be1624ea49a986708690a8b46
I20260709 13:11:18.099361 27412 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 18.
I20260709 13:11:18.142079 27426 tablet_copy_source_session.cc:215] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.153208   900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c065641be1624ea49a986708690a8b46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.167068   910 ts_tablet_manager.cc:933] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:18.190791 27162 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 214) took 44563 ms (client timeout 15000 ms). Trace:
I20260709 13:11:18.191741 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54712
I20260709 13:11:18.192279 27415 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:11:18.196310 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54712
I20260709 13:11:18.196863 27415 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:11:18.198312 27152 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 415aa8030d05423fbf90a8f010b516d3 already in progress [suppressed 2 similar messages]
W20260709 13:11:18.191357 27162 rpcz_store.cc:269] 0709 13:10:33.627121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.627605 (+   484us) service_pool.cc:224] Handling call
0709 13:11:18.190544 (+44562939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344924,"reported_tablets":51}
W20260709 13:11:18.208904 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73949.6us
I20260709 13:11:18.237591   900 tablet_copy_client.cc:806] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.238370   900 tablet_copy_client.cc:670] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:18.255458 27152 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 57284.5us
I20260709 13:11:18.259785 27415 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54712
I20260709 13:11:18.260445 27415 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:11:18.260313 27160 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 16 to 17, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 17 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.275015   872 raft_consensus.cc:993] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: : Instructing follower 203d83f7fac847e0beee51aa18513b25 to start an election
I20260709 13:11:18.275594   872 raft_consensus.cc:1081] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Signalling peer 203d83f7fac847e0beee51aa18513b25 to start an election
W20260709 13:11:18.279983 27214 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:11:18.280319   910 tablet_copy_client.cc:323] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
W20260709 13:11:18.280428 27214 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 415aa8030d05423fbf90a8f010b516d3 already in progress
W20260709 13:11:18.282088 27214 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 415aa8030d05423fbf90a8f010b516d3 already in progress
I20260709 13:11:18.281587 27262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
 from {username='slave'} at 127.0.0.1:59104
I20260709 13:11:18.282647 27262 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.283025 27262 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.284293 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet 415aa8030d05423fbf90a8f010b516d3 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:11:18.284936 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet 415aa8030d05423fbf90a8f010b516d3 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-415aa8030d05423fbf90a8f010b516d3
I20260709 13:11:18.289117 27158 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 9, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:18.297583 27426 tablet_copy_source_session.cc:215] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:18.301069   910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 415aa8030d05423fbf90a8f010b516d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.317988   910 tablet_copy_client.cc:806] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:18.318562   910 tablet_copy_client.cc:670] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:18.322206   910 tablet_copy_client.cc:538] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.329923 27415 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:18.332487   797 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:18.341063 27340 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:18.343559   911 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:18.356659   910 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:11:18.358842 27267 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:18.364426   867 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:18.380692 27267 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:18.383541   867 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:18.255885   900 tablet_copy_client.cc:538] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:18.400928 27262 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:18.406956 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:18.407261 27262 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:18.407608 27339 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.421481 27339 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:18.429672 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:18.430608 27412 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:11:18.431035 27412 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:18.428622 27231 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25; no voters: 
I20260709 13:11:18.432204 27412 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:18.439591 27412 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:18.437147   801 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:18.459540 27409 raft_consensus.cc:1275] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:18.459939 27410 raft_consensus.cc:1275] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:18.465057   870 consensus_queue.cc:1048] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:18.468449   801 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Leader. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:18.478804 27412 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 203d83f7fac847e0beee51aa18513b25 in term 19.
I20260709 13:11:18.469511   801 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:11:18.534353 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 96657.2us
I20260709 13:11:18.479506   883 consensus_queue.cc:1048] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:11:18.552908   923 ts_tablet_manager.cc:933] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:18.576120 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 80180.3us
I20260709 13:11:18.585758 28007 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:18.616894 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 128202us
W20260709 13:11:18.629055 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 134868us
I20260709 13:11:18.636683   906 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:11:18.648290   900 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:11:18.727119 27412 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:11:18.751358 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 89029.6us
W20260709 13:11:18.774766 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 47195.7us
I20260709 13:11:18.723261   923 tablet_copy_client.cc:323] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
W20260709 13:11:18.825218 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 57099.7us
W20260709 13:11:18.835523 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 106152us
W20260709 13:11:18.854501 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 113429us
W20260709 13:11:18.866343 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 151806us
W20260709 13:11:18.841790   918 log.cc:927] Time spent T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:11:18.988438   939 log.cc:927] Time spent T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:11:18.996991   946 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:11:18.839071 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:19.161674 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet ca25783a146d4038878d9ffd69f34217 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:11:19.162343 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet ca25783a146d4038878d9ffd69f34217 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-ca25783a146d4038878d9ffd69f34217
W20260709 13:11:19.184237 27157 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 214) took 19265 ms (client timeout 15000 ms). Trace:
I20260709 13:11:19.184965 27338 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:11:19.184746 27157 rpcz_store.cc:269] 0709 13:10:59.918258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.918495 (+   237us) service_pool.cc:224] Handling call
0709 13:11:19.183990 (+19265495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467359,"reported_tablets":51}
I20260709 13:11:19.199797 27160 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 17 to 18, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 18 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.212944 27353 tablet_copy_source_session.cc:215] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:19.213686   797 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:19.231670 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet a30a45f010dd49e5a9ddb107297fa03e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:55650
W20260709 13:11:19.235575 27231 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:19.304879 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 282426us
W20260709 13:11:19.320082 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 332683us
I20260709 13:11:19.343669 27410 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:11:19.362231   923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca25783a146d4038878d9ffd69f34217. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.393496   941 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:19.401611 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet a30a45f010dd49e5a9ddb107297fa03e (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
W20260709 13:11:19.446887 27164 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 233) took 77550 ms (client timeout 15000 ms). Trace:
W20260709 13:11:19.448782 27164 rpcz_store.cc:269] 0709 13:10:01.896868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.916285 (+ 19417us) service_pool.cc:224] Handling call
0709 13:11:19.446673 (+77530388us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":627080,"reported_tablets":50}
W20260709 13:11:19.487464 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 53403us
I20260709 13:11:19.649051   923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:55768 (request call id 797) took 1193 ms. Trace:
I20260709 13:11:19.649544   923 rpcz_store.cc:276] 0709 13:11:18.455548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.455706 (+   158us) service_pool.cc:224] Handling call
0709 13:11:18.553362 (+ 97656us) ts_tablet_manager.cc:934] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
0709 13:11:19.323799 (+770437us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:19.613558 (+289759us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:19.613690 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:19.648245 (+ 34555us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:19.648557 (+   312us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:19.648888 (+   331us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:19.648955 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":102878,"tablet-copy.queue_time_us":96662,"thread_start_us":154221,"threads_started":2}
I20260709 13:11:19.651528   923 tablet_copy_client.cc:806] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:19.652130   923 tablet_copy_client.cc:670] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:19.658267   923 tablet_copy_client.cc:538] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:19.680064   923 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:11:19.691279   910 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.692412   910 tablet_bootstrap.cc:492] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:19.703672   910 ts_tablet_manager.cc:1403] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 1.347s	user 0.058s	sys 0.004s
I20260709 13:11:19.709983   910 raft_consensus.cc:359] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:19.715749 27160 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 218) took 1408 ms. Trace:
I20260709 13:11:19.721726 27162 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 139) took 1040 ms. Trace:
I20260709 13:11:19.722266 27162 rpcz_store.cc:276] 0709 13:11:18.681430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.681595 (+   165us) service_pool.cc:224] Handling call
0709 13:11:19.721661 (+1040066us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387662,"reported_tablets":1,"spinlock_wait_cycles":496512}
I20260709 13:11:19.711115   910 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:19.727944   910 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:19.735862   910 ts_tablet_manager.cc:1434] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:11:19.717617 27160 rpcz_store.cc:276] 0709 13:11:18.306845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.322869 (+ 16024us) service_pool.cc:224] Handling call
0709 13:11:18.340584 (+ 17715us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54002b0110. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd7f9ccdb1 00007fbd7fb0cb71 00007fbd7fb0d0b2 00007fbd88a86a89 00007fbd88a1eda6 00007fbd889f0088 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc
0709 13:11:19.715685 (+1375101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:19.268481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:19.269119 (+   638us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:19.269159 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:11:19.269178 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:19.269716 (+   538us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:19.269793 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:19.269829 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:19.270025 (+   196us) tablet.cc:701] Row locks acquired
0709 13:11:19.270056 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:11:19.270217 (+   161us) write_op.cc:270] Start()
0709 13:11:19.270341 (+   124us) write_op.cc:276] Timestamp: P: 1783602679270161 usec, L: 0
0709 13:11:19.270365 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:11:19.329203 (+ 58838us) log.cc:844] Serialized 539 byte log entry
0709 13:11:19.652798 (+323595us) op_driver.cc:464] REPLICATION: finished
0709 13:11:19.666715 (+ 13917us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b540002a8d4. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9a571 00007fbd82c2e32a 00007fbd82bb3f14 00007fbd82bb3ec3 00007fbd82bb3e38 00007fbd82bb3df3 00007fbd82bb30dc 00007fbd82bdce16 00007fbd82bc4cbb 00007fbd82baf39d 00007fbd82bb2d75
0709 13:11:19.671405 (+  4690us) write_op.cc:301] APPLY: starting
0709 13:11:19.671505 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:19.672584 (+  1079us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:19.672610 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:19.683020 (+ 10410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:19.687714 (+  4694us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:11:19.690284 (+  2570us) write_op.cc:312] APPLY: finished
0709 13:11:19.690485 (+   201us) log.cc:844] Serialized 25 byte log entry
0709 13:11:19.691275 (+   790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:19.691365 (+    90us) write_op.cc:454] Released schema lock
0709 13:11:19.691405 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:19.707885 (+ 16480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:19.707932 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":164063,"reported_tablets":2,"spinlock_wait_cycles":34960256,"child_traces":[["op",{"apply.queue_time_us":18333,"apply.run_cpu_time_us":3397,"apply.run_wall_time_us":36434,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":65560,"prepare.run_cpu_time_us":55779,"prepare.run_wall_time_us":171501,"raft.queue_time_us":29871,"raft.run_cpu_time_us":4031,"raft.run_wall_time_us":28168,"replication_time_us":382266,"spinlock_wait_cycles":16702336,"thread_start_us":178246,"threads_started":4,"wal-append.queue_time_us":220105}]]}
I20260709 13:11:19.741696 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-415aa8030d05423fbf90a8f010b516d3 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:11:19.742178 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-415aa8030d05423fbf90a8f010b516d3 on tablet 415aa8030d05423fbf90a8f010b516d3 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:19.759742   900 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:19.779960 27157 catalog_manager.cc:5697] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 12 to 13, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:19.782017 27157 catalog_manager.cc:5697] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 18 to 19, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 19 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } }
I20260709 13:11:19.787647   900 tablet_bootstrap.cc:492] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:19.789507   900 ts_tablet_manager.cc:1403] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 1.141s	user 0.058s	sys 0.012s
I20260709 13:11:19.840845 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet a30a45f010dd49e5a9ddb107297fa03e with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:55650
W20260709 13:11:19.841383 27165 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33586 (request call id 213) took 42686 ms (client timeout 15000 ms). Trace:
W20260709 13:11:19.841845 27165 rpcz_store.cc:269] 0709 13:10:37.155234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.155569 (+   335us) service_pool.cc:224] Handling call
0709 13:11:19.841197 (+42685628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12693,"reported_tablets":51,"spinlock_wait_cycles":8192}
I20260709 13:11:19.844484 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet a30a45f010dd49e5a9ddb107297fa03e (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:11:19.862038 27160 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: term changed from 18 to 19, leader changed from d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131) to 203d83f7fac847e0beee51aa18513b25 (127.25.139.129). New cstate: current_term: 19 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.964591   900 raft_consensus.cc:359] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:19.966096   900 raft_consensus.cc:740] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:19.966811   900 consensus_queue.cc:260] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:19.974234   900 ts_tablet_manager.cc:1434] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.184s	user 0.008s	sys 0.000s
I20260709 13:11:19.990666 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-c065641be1624ea49a986708690a8b46 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:11:19.991146 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-c065641be1624ea49a986708690a8b46 on tablet c065641be1624ea49a986708690a8b46 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:20.141309   923 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.142503   923 tablet_bootstrap.cc:492] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:20.147656   923 ts_tablet_manager.cc:1403] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.468s	user 0.051s	sys 0.003s
I20260709 13:11:20.159255   923 raft_consensus.cc:359] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:20.179029   923 raft_consensus.cc:740] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:20.179934   923 consensus_queue.cc:260] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:20.182825   923 ts_tablet_manager.cc:1434] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.002s
I20260709 13:11:20.203104 27159 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33590 (request call id 236) took 6366 ms. Trace:
I20260709 13:11:20.211622 27159 rpcz_store.cc:276] 0709 13:11:13.836987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.837339 (+   352us) service_pool.cc:224] Handling call
0709 13:11:20.202910 (+6365571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13863,"reported_tablets":51,"spinlock_wait_cycles":1475968}
I20260709 13:11:20.221469 28010 raft_consensus.cc:1217] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:11:20.221625 28015 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Advancing to term 19
I20260709 13:11:20.239049 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-ca25783a146d4038878d9ffd69f34217 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:20.239605 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-ca25783a146d4038878d9ffd69f34217 on tablet ca25783a146d4038878d9ffd69f34217 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:20.247820 28010 raft_consensus.cc:1217] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:11:20.594128   944 raft_consensus.cc:1064] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:20.599947   944 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:20.645080 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:20.655262 28015 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 19 LEARNER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:20.663632   801 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:20.677220 27412 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:20.679991   944 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:20.706956   850 raft_consensus.cc:1064] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:20.710801 27342 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:11:20.710489   850 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:20.736071   944 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:20.751901 27265 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:20.756718 28015 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:20.760906   970 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:20.764843   944 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 11 to 13, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.767438 27412 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.777666 27340 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:11:20.778690   850 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:20.809006   969 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:20.852082   969 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.854725 27267 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.868434   867 raft_consensus.cc:1064] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:20.871562   867 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:20.879590 27160 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index 11 to 13, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:20.883832 28015 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.963363 28015 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.993880 27338 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:20.985196 27340 raft_consensus.cc:2955] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 11 to 13, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:21.013445 27980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 134772us
W20260709 13:11:21.035451 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 146605us
W20260709 13:11:21.039747 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 78194.4us
I20260709 13:11:21.073504 27409 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:21.077104  1008 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:21.089128 28012 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:11:21.109196  1007 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:11:21.335309 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 84488.5us
W20260709 13:11:21.350390 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 121750us
I20260709 13:11:21.356029 27262 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:11:21.397873 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53934us
I20260709 13:11:21.453557   867 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:21.449916 27157 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:21.490685 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46247.5us
W20260709 13:11:21.537258 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 138949us
I20260709 13:11:21.546886 27265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21d14940356a45ada8e16731853b8769"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:33696
I20260709 13:11:21.547588 27265 raft_consensus.cc:606] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Received request to transfer leadership to TS 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:21.553753   867 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.557039 27265 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "203d83f7fac847e0beee51aa18513b25"
mode: GRACEFUL
new_leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:33696
I20260709 13:11:21.557662 27265 raft_consensus.cc:606] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Received request to transfer leadership to TS d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:21.560114 28012 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.566303 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:21.569029 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:21.604398 27157 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 9 to 10, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.617568 27415 consensus_queue.cc:237] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.618492 27409 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.627362 28007 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:21.637108  1026 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:21.645340  1006 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.655576 28007 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.673164 27265 raft_consensus.cc:1275] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:21.725968  1031 raft_consensus.cc:993] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: : Instructing follower 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:21.726505  1031 raft_consensus.cc:1081] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Signalling peer 161ec4aacbd54a4989d6762a9ed4eafe to start an election
I20260709 13:11:21.730345 27340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21d14940356a45ada8e16731853b8769"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:11:21.730962 27340 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.731343 27340 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.729235   994 consensus_queue.cc:1048] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:11:21.737445 27152 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c065641be1624ea49a986708690a8b46 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:21.741329   987 raft_consensus.cc:993] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: : Instructing follower d02eb2355bc54e7f8c13a30c33793d95 to start an election
I20260709 13:11:21.741952   987 raft_consensus.cc:1081] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Signalling peer d02eb2355bc54e7f8c13a30c33793d95 to start an election
I20260709 13:11:21.745501 27415 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:56234
I20260709 13:11:21.746019 27415 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:21.746407 27415 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.759177 27340 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.774106 27267 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } attrs { replace: true } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.759626 27263 raft_consensus.cc:2955] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:21.798290 27159 catalog_manager.cc:5697] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 12 to 13, VOTER 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) evicted. New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.806941 27340 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:21.814023 27262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:21.814697 27262 raft_consensus.cc:3055] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:11:21.815037 27262 raft_consensus.cc:740] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:21.815828 27262 consensus_queue.cc:260] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.816716 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:21.817086 27262 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.817437 28007 raft_consensus.cc:3060] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:21.826378 27415 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.830276 28007 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:21.838582 27306 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:21.840426   955 raft_consensus.cc:2804] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:21.840989   955 raft_consensus.cc:697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:21.855504 27415 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:21.858314 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:21.860400 27336 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.862159 27267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "203d83f7fac847e0beee51aa18513b25"
I20260709 13:11:21.862807 27267 raft_consensus.cc:3055] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:11:21.863134 27267 raft_consensus.cc:740] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 203d83f7fac847e0beee51aa18513b25, State: Running, Role: LEADER
I20260709 13:11:21.864017 27267 consensus_queue.cc:260] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.874603 27262 raft_consensus.cc:2468] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:21.874918 27340 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.876530 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:21.877146 28007 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.889844 27415 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:21.891569   867 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:21.851965   955 consensus_queue.cc:237] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.905094 27336 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 20.
I20260709 13:11:21.909899 28015 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:21.911556 27267 raft_consensus.cc:3060] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:21.914337 27325 tablet_service.cc:1558] Processing DeleteTablet for tablet c065641be1624ea49a986708690a8b46 with delete_type TABLET_DATA_TOMBSTONED (TS 161ec4aacbd54a4989d6762a9ed4eafe not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60774
W20260709 13:11:21.861721 27153 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 122707us
W20260709 13:11:21.972493 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46018us
I20260709 13:11:21.927315 28007 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 20.
I20260709 13:11:21.962127 27409 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:22.038982 28012 raft_consensus.cc:1240] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Rejecting Update request from peer 203d83f7fac847e0beee51aa18513b25 for earlier term 19. Current term is 20. Ops: []
I20260709 13:11:22.042399 27380 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:22.042562 27267 raft_consensus.cc:2468] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 20.
I20260709 13:11:22.058732  1010 raft_consensus.cc:2804] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:22.088057  1041 tablet_replica.cc:333] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:22.089406  1041 raft_consensus.cc:2243] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.090520  1041 raft_consensus.cc:2272] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.094256  1041 ts_tablet_manager.cc:1916] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:22.060631  1020 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:11:22.083379  1010 raft_consensus.cc:697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:22.111402  1010 consensus_queue.cc:237] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:21.956732  1027 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:22.128738 27157 catalog_manager.cc:5697] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 15 to 16, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 16 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.131821 28007 raft_consensus.cc:2955] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:22.153021 27153 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 203d83f7fac847e0beee51aa18513b25 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:22.191720 27165 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 10 to 11, VOTER 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) evicted. New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:22.239892 27251 tablet_service.cc:1558] Processing DeleteTablet for tablet ca25783a146d4038878d9ffd69f34217 with delete_type TABLET_DATA_TOMBSTONED (TS 203d83f7fac847e0beee51aa18513b25 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55650
I20260709 13:11:22.269044 27150 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca25783a146d4038878d9ffd69f34217 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:22.290445  1044 tablet_replica.cc:333] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:22.291637  1044 raft_consensus.cc:2243] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.288529  1041 ts_tablet_manager.cc:1929] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:11:22.292522  1044 raft_consensus.cc:2272] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.292608  1041 log.cc:1199] T c065641be1624ea49a986708690a8b46 P 161ec4aacbd54a4989d6762a9ed4eafe: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/wals/c065641be1624ea49a986708690a8b46
I20260709 13:11:22.300520  1044 ts_tablet_manager.cc:1916] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:22.310256 27150 catalog_manager.cc:5028] TS 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): tablet c065641be1624ea49a986708690a8b46 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:11:22.341769 27157 catalog_manager.cc:5697] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 19 to 20, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.409543  1044 ts_tablet_manager.cc:1929] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:11:22.410197  1044 log.cc:1199] T ca25783a146d4038878d9ffd69f34217 P 203d83f7fac847e0beee51aa18513b25: Deleting WAL directory at /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/wals/ca25783a146d4038878d9ffd69f34217
I20260709 13:11:22.416733 27153 catalog_manager.cc:5028] TS 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): tablet ca25783a146d4038878d9ffd69f34217 (table test-workload [id=b00ddfdf72e54540b59533ffe08799ad]) successfully deleted
I20260709 13:11:22.445639 28007 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:22.456785  1027 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:22.488207 27262 raft_consensus.cc:1275] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:11:22.489955  1027 consensus_queue.cc:1048] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:22.570047 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.647832 27262 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:22.649422   994 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:22.693230 28015 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:22.696732   994 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:22.732199 27340 raft_consensus.cc:1275] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:11:22.734297   994 consensus_queue.cc:1048] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:22.847703 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46044.6us
W20260709 13:11:23.349393 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 73808.6us
I20260709 13:11:23.356387 27340 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:11:23.360716 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:23.374953 27306 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 41a124c306f9418a8556266f795a58b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.377803 27409 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:23.379513 27262 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:11:23.381402  1005 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:23.385798  1005 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:23.429687  1020 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.432858 27412 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.436456 27267 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.452536 27157 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index -1 to 11, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 16 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.472077 27412 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
W20260709 13:11:23.501722 27380 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4b61886e4de43d1a7459c0b2b639537. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.505441 27340 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:23.513666   994 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:23.517091 27267 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:11:23.519454  1054 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:23.558578 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 82682.6us
I20260709 13:11:23.584719  1054 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.588013 27340 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.609447 27265 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.674034 27159 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 10, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.714510 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:23.746742 27262 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:23.830374 27340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd"
dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
mode: GRACEFUL
new_leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:44086
I20260709 13:11:23.831048 27340 raft_consensus.cc:606] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Received request to transfer leadership to TS d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:23.840986 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:23.842625 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:23.873900 27231 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59877a2f8723407f9fd30c7505cc2e29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.874645 27409 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:23.877220 27342 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer 203d83f7fac847e0beee51aa18513b25: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:11:23.879992  1057 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:23.881102  1073 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:23.943277  1076 ts_tablet_manager.cc:933] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:23.945770  1073 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.957301 27409 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.969990 27342 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:23.972782 27159 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 reported cstate change: config changed from index -1 to 12, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 17 leader_uuid: "203d83f7fac847e0beee51aa18513b25" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.973099 27411 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:24.006140  1076 tablet_copy_client.cc:323] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.130:35457
I20260709 13:11:24.021138  1027 raft_consensus.cc:993] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: : Instructing follower d02eb2355bc54e7f8c13a30c33793d95 to start an election
I20260709 13:11:24.021781  1062 raft_consensus.cc:1081] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Signalling peer d02eb2355bc54e7f8c13a30c33793d95 to start an election
I20260709 13:11:24.023869 27409 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd"
dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
 from {username='slave'} at 127.0.0.1:56236
I20260709 13:11:24.024704 27409 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:24.025256 27409 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.035189 27353 tablet_copy_service.cc:140] P 161ec4aacbd54a4989d6762a9ed4eafe: Received BeginTabletCopySession request for tablet 41a124c306f9418a8556266f795a58b3 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:49416)
I20260709 13:11:24.035902 27353 tablet_copy_service.cc:161] P 161ec4aacbd54a4989d6762a9ed4eafe: Beginning new tablet copy session on tablet 41a124c306f9418a8556266f795a58b3 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:49416: session id = b0e4232110db400d8f43fe2170c24c95-41a124c306f9418a8556266f795a58b3
I20260709 13:11:24.049942 27353 tablet_copy_source_session.cc:215] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:24.054045 27409 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:24.062009 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:24.062736 27342 raft_consensus.cc:3055] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:11:24.063021 27342 raft_consensus.cc:740] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:24.063687 27409 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:24.064610 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:24.065284 27342 consensus_queue.cc:260] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:24.066816 27342 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.069352 28007 raft_consensus.cc:3060] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:24.080081 27342 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:24.082440  1082 ts_tablet_manager.cc:933] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:24.085122  1076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a124c306f9418a8556266f795a58b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:24.090039 27340 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:24.090844 28007 raft_consensus.cc:2468] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:24.097687 27380 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:24.112385  1010 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:24.113730  1011 raft_consensus.cc:2804] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:24.114388  1011 raft_consensus.cc:697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:24.119735  1011 consensus_queue.cc:237] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:24.125599 27380 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123): Couldn't send request to peer b0e4232110db400d8f43fe2170c24c95. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0aa2cbbfc6b45fe8d8f862c301f1909. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:24.124244 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 44541.4us
W20260709 13:11:24.144145 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 69435.5us
I20260709 13:11:24.146207 27262 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:11:24.139624  1082 tablet_copy_client.cc:323] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:11:24.158972 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet d4b61886e4de43d1a7459c0b2b639537 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:11:24.159693 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet d4b61886e4de43d1a7459c0b2b639537 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-d4b61886e4de43d1a7459c0b2b639537
I20260709 13:11:24.177326  1086 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:11:24.193070 27426 tablet_copy_source_session.cc:215] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:24.205380 27165 catalog_manager.cc:5697] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 17 to 18, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.207664  1082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b61886e4de43d1a7459c0b2b639537. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:24.223501 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 90958.8us
W20260709 13:11:24.291085 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 51564.8us
W20260709 13:11:24.292392 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 52868.1us
I20260709 13:11:24.360430 27265 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:24.353312  1085 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:11:24.372934 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 132093us
I20260709 13:11:24.383832 27342 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
W20260709 13:11:24.450762 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 124258us
W20260709 13:11:24.466503 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:24.479552 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 82147.1us
I20260709 13:11:24.509886  1076 tablet_copy_client.cc:806] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:24.510483  1076 tablet_copy_client.cc:670] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:24.514889 27165 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index -1 to 8, NON_VOTER b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) added. New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } } }
I20260709 13:11:24.538902  1082 tablet_copy_client.cc:806] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:24.539674  1082 tablet_copy_client.cc:670] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:24.545212  1082 tablet_copy_client.cc:538] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:24.546818  1076 tablet_copy_client.cc:538] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:24.552907 27336 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:24.554874  1010 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:11:24.583024  1082 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
I20260709 13:11:24.596200  1076 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
W20260709 13:11:24.632951 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 164187us
I20260709 13:11:24.635396  1105 ts_tablet_manager.cc:933] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339)
I20260709 13:11:24.692008 28015 raft_consensus.cc:1275] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:24.699386  1086 consensus_queue.cc:1048] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:11:24.725925 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71236.3us
I20260709 13:11:24.767558  1105 tablet_copy_client.cc:323] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.129:44339
W20260709 13:11:24.785941 27233 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 60248.6us
I20260709 13:11:24.833289 27278 tablet_copy_service.cc:140] P 203d83f7fac847e0beee51aa18513b25: Received BeginTabletCopySession request for tablet 59877a2f8723407f9fd30c7505cc2e29 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:48160)
I20260709 13:11:24.834139 27278 tablet_copy_service.cc:161] P 203d83f7fac847e0beee51aa18513b25: Beginning new tablet copy session on tablet 59877a2f8723407f9fd30c7505cc2e29 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:48160: session id = b0e4232110db400d8f43fe2170c24c95-59877a2f8723407f9fd30c7505cc2e29
I20260709 13:11:24.843564 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:24.877043  1110 ts_tablet_manager.cc:933] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Initiating tablet copy from peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:24.911279 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 185290us
I20260709 13:11:24.913755 27278 tablet_copy_source_session.cc:215] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:24.931236 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 46679.4us
I20260709 13:11:25.009622  1105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59877a2f8723407f9fd30c7505cc2e29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.044739  1110 tablet_copy_client.cc:323] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Beginning tablet copy session from remote peer at address 127.25.139.131:34895
I20260709 13:11:25.077770 27426 tablet_copy_service.cc:140] P d02eb2355bc54e7f8c13a30c33793d95: Received BeginTabletCopySession request for tablet d0aa2cbbfc6b45fe8d8f862c301f1909 from peer b0e4232110db400d8f43fe2170c24c95 ({username='slave'} at 127.0.0.1:36154)
I20260709 13:11:25.078329 27426 tablet_copy_service.cc:161] P d02eb2355bc54e7f8c13a30c33793d95: Beginning new tablet copy session on tablet d0aa2cbbfc6b45fe8d8f862c301f1909 from peer b0e4232110db400d8f43fe2170c24c95 at {username='slave'} at 127.0.0.1:36154: session id = b0e4232110db400d8f43fe2170c24c95-d0aa2cbbfc6b45fe8d8f862c301f1909
I20260709 13:11:25.085857 27426 tablet_copy_source_session.cc:215] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.096807  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0aa2cbbfc6b45fe8d8f862c301f1909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.111815  1082 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.113068  1082 tablet_bootstrap.cc:492] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:25.113963  1082 ts_tablet_manager.cc:1403] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.531s	user 0.046s	sys 0.018s
I20260709 13:11:25.114744  1105 tablet_copy_client.cc:806] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.115556  1105 tablet_copy_client.cc:670] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.117489  1082 raft_consensus.cc:359] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:25.118352  1082 raft_consensus.cc:740] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:25.119020  1082 consensus_queue.cc:260] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:25.135586  1082 ts_tablet_manager.cc:1434] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:11:25.137398 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-d4b61886e4de43d1a7459c0b2b639537 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:11:25.137848 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-d4b61886e4de43d1a7459c0b2b639537 on tablet d4b61886e4de43d1a7459c0b2b639537 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:25.150861  1110 tablet_copy_client.cc:806] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.151580  1110 tablet_copy_client.cc:670] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:25.258774  1076 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:11:25.271978  1110 tablet_copy_client.cc:538] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.276207  1105 tablet_copy_client.cc:538] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:25.359476  1076 log.cc:927] Time spent T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:11:25.366637 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:11:25.375545 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 59291.5us
W20260709 13:11:25.395635 27383 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:11:25.467581 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 72147.3us
I20260709 13:11:25.510360  1110 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
W20260709 13:11:25.524281 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.527521 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.532960 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.536011 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.541672 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 44202.5us
I20260709 13:11:25.560524 28007 raft_consensus.cc:1217] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 13:11:25.598177 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 71622.8us
I20260709 13:11:25.601996 26158 tablet_copy_service.cc:362] P 203d83f7fac847e0beee51aa18513b25: Destroying tablet copy session b0e4232110db400d8f43fe2170c24c95-59877a2f8723407f9fd30c7505cc2e29 due to service shutdown
I20260709 13:11:25.602481 26158 tablet_copy_service.cc:434] P 203d83f7fac847e0beee51aa18513b25: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-59877a2f8723407f9fd30c7505cc2e29 on tablet 59877a2f8723407f9fd30c7505cc2e29 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:25.599778  1076 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:11:25.625936 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.645670 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.662945  1105 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Bootstrap starting.
W20260709 13:11:25.662418 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 91113.1us
I20260709 13:11:25.665948  1076 tablet_bootstrap.cc:492] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
W20260709 13:11:25.660602 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.703783  1076 ts_tablet_manager.cc:1403] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 1.108s	user 0.040s	sys 0.024s
W20260709 13:11:25.706832 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.707530 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.752827 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45351.7us
W20260709 13:11:25.755566 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.756062 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 49304.4us
W20260709 13:11:25.751734 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.756886 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.762642 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.764499 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.768394 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.771634 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.810930 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.846542 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.849114 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.850580 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.847932 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.854506 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.859503 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.864861 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.887931 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.892163 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.892766 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.889601 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.907533 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.941100 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.954363  1076 raft_consensus.cc:359] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:25.955677  1076 raft_consensus.cc:740] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:25.956385  1076 consensus_queue.cc:260] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:25.959740  1076 ts_tablet_manager.cc:1434] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.197s	user 0.005s	sys 0.004s
W20260709 13:11:25.970489 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:25.972980 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.990331 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:11:25.994565 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.994524 26158 tablet_replica.cc:333] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.002650 26158 raft_consensus.cc:2243] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.003571 26158 raft_consensus.cc:2272] T d4b61886e4de43d1a7459c0b2b639537 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.018049 27353 tablet_copy_service.cc:342] P 161ec4aacbd54a4989d6762a9ed4eafe: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-41a124c306f9418a8556266f795a58b3 received from {username='slave'} at 127.0.0.1:49416
I20260709 13:11:26.018816 27353 tablet_copy_service.cc:434] P 161ec4aacbd54a4989d6762a9ed4eafe: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-41a124c306f9418a8556266f795a58b3 on tablet 41a124c306f9418a8556266f795a58b3 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:26.022257 26158 tablet_replica.cc:333] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
W20260709 13:11:26.022954 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.052574 26158 raft_consensus.cc:2243] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.054010 26158 raft_consensus.cc:2272] T 43ab3e6cd15341cd8cc43296cb7ce69d P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.066044  1110 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.067034  1110 tablet_bootstrap.cc:492] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:26.067819  1110 ts_tablet_manager.cc:1403] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.558s	user 0.044s	sys 0.006s
I20260709 13:11:26.072747 26158 tablet_replica.cc:333] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.073868 26158 raft_consensus.cc:2243] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.074482 26158 raft_consensus.cc:2272] T 1a2fa29e3bcf4670ab310ce67ee127c4 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.084698 28015 raft_consensus.cc:1217] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:11:26.091406  1033 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.092208  1033 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.088822  1110 raft_consensus.cc:359] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:26.095184  1110 raft_consensus.cc:740] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:26.095916  1110 consensus_queue.cc:260] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:26.097203 26158 tablet_replica.cc:333] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.095597  1033 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.098151 26158 raft_consensus.cc:2243] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.098858 26158 raft_consensus.cc:2272] T 3c247f301fde4963b4d1761a0b3254a9 P 203d83f7fac847e0beee51aa18513b25 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.112483 26158 tablet_replica.cc:333] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.113430 26158 raft_consensus.cc:2243] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.114457 26158 raft_consensus.cc:2272] T a4df1b7ffb3d487ea7c361ac87825c5d P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.116266  1110 ts_tablet_manager.cc:1434] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:11:26.118393 27426 tablet_copy_service.cc:342] P d02eb2355bc54e7f8c13a30c33793d95: Request end of tablet copy session b0e4232110db400d8f43fe2170c24c95-d0aa2cbbfc6b45fe8d8f862c301f1909 received from {username='slave'} at 127.0.0.1:36154
I20260709 13:11:26.118923 27426 tablet_copy_service.cc:434] P d02eb2355bc54e7f8c13a30c33793d95: ending tablet copy session b0e4232110db400d8f43fe2170c24c95-d0aa2cbbfc6b45fe8d8f862c301f1909 on tablet d0aa2cbbfc6b45fe8d8f862c301f1909 with peer b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:26.127434 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.130796 26158 tablet_replica.cc:333] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.139729 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "804fae3c2b684e6a8a7c159e417231fa" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.143887 26158 raft_consensus.cc:2243] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.161289 27233 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.163440  1057 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.163872 26158 raft_consensus.cc:2272] T 415aa8030d05423fbf90a8f010b516d3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.179906 26158 tablet_replica.cc:333] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.180765 26158 raft_consensus.cc:2243] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.181928 26158 raft_consensus.cc:2272] T 8a295e8566b04b49918a92cb09270d62 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.192456 26158 tablet_replica.cc:333] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.193331 26158 raft_consensus.cc:2243] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.194118 26158 raft_consensus.cc:2272] T e376a729bb7c47e99662f97b33ea32c7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.199265  1101 raft_consensus.cc:1064] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:26.202498  1101 consensus_queue.cc:237] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.222963 26158 tablet_replica.cc:333] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.223893 26158 raft_consensus.cc:2243] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.224781 26158 raft_consensus.cc:2272] T 4d586a4492094f0dbea7efd8255dd991 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.227705 26158 tablet_replica.cc:333] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.228524 26158 raft_consensus.cc:2243] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.255056 26158 raft_consensus.cc:2272] T cfbd4344db4a4ffb8868b58ddc53af83 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.273428 28007 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:26.275310  1085 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:26.296651 26158 tablet_replica.cc:333] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.300030 27340 raft_consensus.cc:1275] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:26.307449 26158 raft_consensus.cc:2243] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:11:26.309093 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.316315 26158 raft_consensus.cc:2272] T 59877a2f8723407f9fd30c7505cc2e29 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.340379  1079 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.341324  1079 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.334312  1085 consensus_queue.cc:1048] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:11:26.343520 26158 tablet_replica.cc:333] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.344329  1033 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.344674 26158 raft_consensus.cc:2243] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.345085  1033 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.373224  1079 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.376061 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.381390  1033 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:26.382680  1129 log.cc:927] Time spent T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:26.384469 26158 raft_consensus.cc:2272] T 0287d5309a46494ca6fc1acd716c9c17 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.388876 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60414d130cdc460696513fb91e20161f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.389479 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.374855  1079 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.398350  1079 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.412719 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f3e88c6f82141d8a7a8cb507f425200" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.422055 26158 tablet_replica.cc:333] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.424628 27231 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.426652  1057 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.428272  1130 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.427318  1057 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.435417 26158 raft_consensus.cc:2243] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.439605  1057 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:26.403306  1105 log.cc:927] Time spent T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:11:26.440891 26158 raft_consensus.cc:2272] T bf4fb4f20e74427f86180930e86a7afc P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.453905 26158 tablet_replica.cc:333] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.455229 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.471712  1079 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.494278 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.480165  1079 raft_consensus.cc:493] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.500002  1079 raft_consensus.cc:515] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.502110  1079 leader_election.cc:290] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.505234  1057 raft_consensus.cc:493] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.505805  1057 raft_consensus.cc:515] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.468408 26158 raft_consensus.cc:2243] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:26.525553 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 99687.9us
I20260709 13:11:26.527441 27231 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.530143 28015 raft_consensus.cc:1217] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:11:26.532382  1033 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.536046  1057 leader_election.cc:290] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.537328 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.536039 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.544034  1105 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.545012  1105 tablet_bootstrap.cc:492] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Bootstrap complete.
I20260709 13:11:26.545713  1105 ts_tablet_manager.cc:1403] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Time spent bootstrapping tablet: real 0.901s	user 0.043s	sys 0.013s
I20260709 13:11:26.555651 26158 raft_consensus.cc:2272] T a055e36ded584640806637e94e87f6b9 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.554620 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.554636 27231 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.562463 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170c6d7d3371409fbd512d4226e702f5" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.512495  1130 raft_consensus.cc:493] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.530014  1079 raft_consensus.cc:493] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.565361  1079 raft_consensus.cc:515] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.567750  1132 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:26.568818  1130 raft_consensus.cc:515] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:26.571918 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.575783  1079 leader_election.cc:290] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.576650 26158 tablet_replica.cc:333] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.578047 26158 raft_consensus.cc:2243] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.580190 26158 raft_consensus.cc:2272] T b390ed75f2f14d258d4cdff9c656d787 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.590456 26158 tablet_replica.cc:333] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.586440 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.595645  1130 leader_election.cc:290] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.578917  1101 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.599859 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.600203 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "189d9bcac7d24abe800257c915b738c7" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.600689 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a9f1b01ac8406691c2d1c83b5dcca0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.608419 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.600446  1079 raft_consensus.cc:493] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.610630  1079 raft_consensus.cc:515] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.613366  1079 leader_election.cc:290] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.619206 26158 raft_consensus.cc:2243] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.621552 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e622bd20107a4c4190d71a5b581aa506" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.625823  1057 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.626103  1132 raft_consensus.cc:493] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.626557  1057 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:26.626794  1132 raft_consensus.cc:515] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.631011 26158 raft_consensus.cc:2272] T 0f3e88c6f82141d8a7a8cb507f425200 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.631297  1057 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.631302  1105 raft_consensus.cc:359] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:26.632489  1105 raft_consensus.cc:740] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Initialized, Role: LEARNER
I20260709 13:11:26.633226  1105 consensus_queue.cc:260] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:26.634174 26158 tablet_replica.cc:333] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.623097  1130 raft_consensus.cc:493] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.636343  1130 raft_consensus.cc:515] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.636891  1105 ts_tablet_manager.cc:1434] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:11:26.639236  1130 leader_election.cc:290] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.639732 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.643042 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.647794  1132 leader_election.cc:290] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.650616 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4841dcf8d05d4ecaa8771d888fc649c0" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.652328 26158 raft_consensus.cc:2243] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.653121 26158 raft_consensus.cc:2272] T 3412bba6f0c740dd9adb1895146dd937 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.660045 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efee0a6a9d2c4ed096004a49852dbc86" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.660778 27233 leader_election.cc:304] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.661283 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.662303  1132 raft_consensus.cc:2749] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:26.663482 27415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.663604 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.664690 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d30dde9c4c4d778d398130da0cdaea" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:26.659647 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b3f6c9e74407ebaecb4a51f7b4fcf" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.667835 27231 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.669272  1130 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.681300 27231 leader_election.cc:304] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:26.676311 26158 tablet_replica.cc:333] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.682557 27231 leader_election.cc:304] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:26.681607 28015 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.682657 26158 raft_consensus.cc:2243] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.686721  1132 raft_consensus.cc:2749] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:26.688727 26158 raft_consensus.cc:2272] T 4b44d9e3827f45eabce8235344e58d0f P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.690560 27231 leader_election.cc:304] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:26.687096  1033 raft_consensus.cc:2749] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:26.703274 27231 leader_election.cc:304] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.709043  1079 raft_consensus.cc:2749] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:26.698446 27342 raft_consensus.cc:2955] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.716930  1033 raft_consensus.cc:2749] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:26.719940  1097 raft_consensus.cc:1064] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:26.724243 26158 tablet_replica.cc:333] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.725185 26158 raft_consensus.cc:2243] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.728945 27231 leader_election.cc:304] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.735997  1097 consensus_queue.cc:237] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.744805  1079 raft_consensus.cc:2749] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:26.742715 27157 catalog_manager.cc:5697] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: config changed from index 10 to 11, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.746479  1079 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.747076  1079 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.749357  1033 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.749390  1079 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.750363  1079 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.750231  1033 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.750970  1079 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.753334  1033 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.753531 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.754253 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.756247  1079 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.757233 27231 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.757957  1130 raft_consensus.cc:493] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.758478  1130 raft_consensus.cc:515] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.760592  1130 leader_election.cc:290] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.761133  1130 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:26.761811 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.762445 27231 leader_election.cc:304] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.763512  1079 raft_consensus.cc:2706] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:11:26.766106 26158 raft_consensus.cc:2272] T a0d30dde9c4c4d778d398130da0cdaea P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.768885 26158 tablet_replica.cc:333] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.770656 26158 raft_consensus.cc:2243] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:26.771301 26158 raft_consensus.cc:2272] T 170c6d7d3371409fbd512d4226e702f5 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.780234 27408 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:26.782130  1121 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:26.784188 28012 raft_consensus.cc:1275] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:11:26.785883  1027 consensus_queue.cc:1048] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:26.807073  1033 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:26.807809  1033 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.811209 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.811642  1033 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.826318  1027 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.834208 28012 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.844956  1130 raft_consensus.cc:493] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.845661  1130 raft_consensus.cc:515] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:26.849014  1130 leader_election.cc:290] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:26.849203 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.856704  1130 raft_consensus.cc:493] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.857402  1130 raft_consensus.cc:515] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.859493  1033 raft_consensus.cc:493] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b0e4232110db400d8f43fe2170c24c95)
I20260709 13:11:26.860255  1033 raft_consensus.cc:515] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.863481 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.863688  1033 leader_election.cc:290] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.867053 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.867283  1130 leader_election.cc:290] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:26.895067 27231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 130517us
I20260709 13:11:26.900758 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.908147 27412 raft_consensus.cc:2955] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:26.922633  1085 raft_consensus.cc:1064] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:26.928927  1085 consensus_queue.cc:237] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.935591 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c065641be1624ea49a986708690a8b46" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.939546 28015 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEARNER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:26.941272   994 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:26.967298 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a44de1887e445a5b020fd0cbae6a5a3" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.969789 26158 tablet_replica.cc:333] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:26.972108 28015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7b8babc1b46fbad021d233647b834" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:26.974006  1079 raft_consensus.cc:493] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:26.974573  1079 raft_consensus.cc:515] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:26.978907 27231 leader_election.cc:304] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:26.970968 26158 raft_consensus.cc:2243] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:26.985859  1079 leader_election.cc:290] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:26.986851 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:26.992602  1130 raft_consensus.cc:2749] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:26.996150 26158 raft_consensus.cc:2272] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:26.997318 27231 leader_election.cc:304] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.000943 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21d14940356a45ada8e16731853b8769" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.002288 27339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d09be3e7a494235854c88600f2adfad" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.002624 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76061244738f450fb409cb866212c235" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.003890 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e004b67b35dd4a9b8ccf73182f7bdf58" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.004292 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9cc5476f0fd4bceaab7f594e240f37c" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.005887 27338 raft_consensus.cc:1275] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:27.008950 27231 leader_election.cc:304] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.009668  1079 raft_consensus.cc:2749] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:11:27.012116  1033 raft_consensus.cc:2749] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.012557   994 consensus_queue.cc:1048] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:27.017584 27231 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:27.018829 27231 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.020292  1033 raft_consensus.cc:493] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:27.021276  1033 raft_consensus.cc:515] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:27.026173  1033 leader_election.cc:290] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.026275 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:27.031392  1079 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.020386 27231 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.026758  1033 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:27.037799 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dcb012538c4a0eb307834fbfd9752a" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:27.040313 27231 leader_election.cc:304] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.042171  1132 raft_consensus.cc:2749] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.042668 27231 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.043562  1132 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:27.040944  1130 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.046159 26158 tablet_replica.cc:333] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.047240 26158 raft_consensus.cc:2243] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.049175 27338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0aa2cbbfc6b45fe8d8f862c301f1909" candidate_uuid: "203d83f7fac847e0beee51aa18513b25" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.051223 26158 raft_consensus.cc:2272] T c4f1db10d9664160ae88f26e3becd4b7 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.052690 27231 leader_election.cc:304] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.056800 26158 tablet_replica.cc:333] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.057785 26158 raft_consensus.cc:2243] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.058745  1079 raft_consensus.cc:2749] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:11:27.062377 27231 leader_election.cc:304] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 203d83f7fac847e0beee51aa18513b25; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:27.065312  1130 raft_consensus.cc:2749] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:27.071151 26158 raft_consensus.cc:2272] T 41a124c306f9418a8556266f795a58b3 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:27.080600 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:27.089752 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.091084  1085 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:27.096860 27338 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:27.141165 28012 raft_consensus.cc:2955] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:27.156443 26158 tablet_replica.cc:333] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.223510 26158 raft_consensus.cc:2243] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.224445 26158 raft_consensus.cc:2272] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.208248 27159 catalog_manager.cc:5697] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 11 to 12, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:27.235091 27159 catalog_manager.cc:5697] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: config changed from index 8 to 9, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:27.255496 26158 tablet_replica.cc:333] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.256376 26158 raft_consensus.cc:2243] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.256985 26158 raft_consensus.cc:2272] T e004b67b35dd4a9b8ccf73182f7bdf58 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.259598 26158 tablet_replica.cc:333] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.260352 26158 raft_consensus.cc:2243] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.260931 26158 raft_consensus.cc:2272] T efee0a6a9d2c4ed096004a49852dbc86 P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.263650 26158 tablet_replica.cc:333] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.264439 26158 raft_consensus.cc:2243] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.265517 26158 raft_consensus.cc:2272] T 099c52bc6b98406cadce31d6411cb635 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.268265 26158 tablet_replica.cc:333] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.268954 26158 raft_consensus.cc:2243] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.269860 26158 raft_consensus.cc:2272] T 13cceb5d4cfd4e358a438f514c9e75f0 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.272460 26158 tablet_replica.cc:333] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.273190 26158 raft_consensus.cc:2243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.273830 26158 raft_consensus.cc:2272] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.276604 26158 tablet_replica.cc:333] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.277410 26158 raft_consensus.cc:2243] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.277981 26158 raft_consensus.cc:2272] T 83dcb012538c4a0eb307834fbfd9752a P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.280723 26158 tablet_replica.cc:333] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.281477 26158 raft_consensus.cc:2243] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.282641 26158 raft_consensus.cc:2272] T 56b15c3e61ae45a6b84a4d2a3838c018 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.284008  1011 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.284648  1011 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:27.285620 26158 tablet_replica.cc:333] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.286550 26158 raft_consensus.cc:2243] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.287621 26158 raft_consensus.cc:2272] T c760b3987ef34e0189563d3ccb585eed P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.288125 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.290474 26158 tablet_replica.cc:333] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.291352 26158 raft_consensus.cc:2243] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.292409 26158 raft_consensus.cc:2272] T cdb46c37e35142cf8e2148ef2d2da5e7 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.287094  1011 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:27.295193 26158 tablet_replica.cc:333] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.296005 26158 raft_consensus.cc:2243] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.296643 26158 raft_consensus.cc:2272] T 76061244738f450fb409cb866212c235 P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.299424 26158 tablet_replica.cc:333] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.300143 26158 raft_consensus.cc:2243] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.300678 26158 raft_consensus.cc:2272] T 4d09be3e7a494235854c88600f2adfad P 203d83f7fac847e0beee51aa18513b25 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:27.302802 27383 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.303215 26158 tablet_replica.cc:333] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.303435 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.304076 26158 raft_consensus.cc:2243] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.304771 26158 raft_consensus.cc:2272] T c065641be1624ea49a986708690a8b46 P 203d83f7fac847e0beee51aa18513b25 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.305073  1011 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:27.307544 26158 tablet_replica.cc:333] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.308317 26158 raft_consensus.cc:2243] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.308926 26158 raft_consensus.cc:2272] T 60414d130cdc460696513fb91e20161f P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.311460 26158 tablet_replica.cc:333] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.312198 26158 raft_consensus.cc:2243] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.312918 26158 raft_consensus.cc:2272] T 0a44de1887e445a5b020fd0cbae6a5a3 P 203d83f7fac847e0beee51aa18513b25 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.315431 26158 tablet_replica.cc:333] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.316143 26158 raft_consensus.cc:2243] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.316668 26158 raft_consensus.cc:2272] T 4841dcf8d05d4ecaa8771d888fc649c0 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.319411 26158 tablet_replica.cc:333] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.320116 26158 raft_consensus.cc:2243] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.320619 26158 raft_consensus.cc:2272] T 21d14940356a45ada8e16731853b8769 P 203d83f7fac847e0beee51aa18513b25 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.323563 26158 tablet_replica.cc:333] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.324446 26158 raft_consensus.cc:2243] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.325103 26158 raft_consensus.cc:2272] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 203d83f7fac847e0beee51aa18513b25 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.327630 26158 tablet_replica.cc:333] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.328387 26158 raft_consensus.cc:2243] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.329510 26158 raft_consensus.cc:2272] T 008af8ad84434532baca82a0654da9bf P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.332203 26158 tablet_replica.cc:333] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.332931 26158 raft_consensus.cc:2243] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.334024 26158 raft_consensus.cc:2272] T 3defd7d5f6684c09bb491b62d9c1cba1 P 203d83f7fac847e0beee51aa18513b25 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.336644 26158 tablet_replica.cc:333] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.337378 26158 raft_consensus.cc:2243] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.338186 26158 raft_consensus.cc:2272] T 804fae3c2b684e6a8a7c159e417231fa P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.341094 26158 tablet_replica.cc:333] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.341794 26158 raft_consensus.cc:2243] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.342625 26158 raft_consensus.cc:2272] T 2ea7b8babc1b46fbad021d233647b834 P 203d83f7fac847e0beee51aa18513b25 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.345453 26158 tablet_replica.cc:333] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.346148 26158 raft_consensus.cc:2243] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.346812 26158 raft_consensus.cc:2272] T 189d9bcac7d24abe800257c915b738c7 P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.349702 26158 tablet_replica.cc:333] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.350363 26158 raft_consensus.cc:2243] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.350973 26158 raft_consensus.cc:2272] T e9cc5476f0fd4bceaab7f594e240f37c P 203d83f7fac847e0beee51aa18513b25 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.353801 26158 tablet_replica.cc:333] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.354446 26158 raft_consensus.cc:2243] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:27.355688 26158 raft_consensus.cc:2272] T 17909c3b30eb43b79bd7ea94e48dcef1 P 203d83f7fac847e0beee51aa18513b25 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.358527 26158 tablet_replica.cc:333] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25: stopping tablet replica
I20260709 13:11:27.359225 26158 raft_consensus.cc:2243] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.359843 26158 raft_consensus.cc:2272] T e622bd20107a4c4190d71a5b581aa506 P 203d83f7fac847e0beee51aa18513b25 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.448205  1085 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.448854  1085 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:27.452805  1085 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:27.460067 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:27.470597 27383 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:27.471794 27383 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.479990  1011 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:11:27.508203   994 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.508797   994 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:27.512428 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.511090   994 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:27.513633 26158 connection.cc:466] server connection from 127.0.0.1:59104 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59104 (request call id 3547) could send its response
I20260709 13:11:27.532845  1063 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.534229  1063 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.536617  1063 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:27.537472  1027 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.538139  1027 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:27.546299  1027 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.547435 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:27.548247 27412 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:27.553915 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:27.556849  1063 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.557313  1063 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.557682  1063 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.565935  1133 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.566569  1133 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:27.589175 27383 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.589712 27383 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.590939   994 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.591869  1133 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.592257  1063 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:27.594676 27309 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.607411 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:27.610921 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:27.611891 27412 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:27.615438 27306 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:27.619468  1133 raft_consensus.cc:2749] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:11:27.622802  1063 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:27.623771 27309 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.631851 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4df1b7ffb3d487ea7c361ac87825c5d" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:27.632647 27412 raft_consensus.cc:3060] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:27.635617 27309 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:27.636212 27309 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.638315  1150 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.643517  1150 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:27.647645  1085 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.648661  1085 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.651005  1085 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:27.640501 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.652645  1063 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:27.653053  1063 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.653430  1063 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:27.655601 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:27.659642 27309 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.664307  1063 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:27.666618  1063 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:27.675226 27309 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.666163  1150 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.682931 27412 raft_consensus.cc:2468] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
W20260709 13:11:27.684629 27383 leader_election.cc:336] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.686978 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:27.688069 27416 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 17.
I20260709 13:11:27.697602 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a295e8566b04b49918a92cb09270d62" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:27.698436 27412 raft_consensus.cc:3060] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:27.699551 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 86667.7us
I20260709 13:11:27.701798 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:27.715626 27380 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:27.715983 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.717310  1074 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.717929  1074 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.721580 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:27.722245 27336 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
I20260709 13:11:27.723452 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:27.724445  1099 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:27.725828  1099 raft_consensus.cc:493] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.726238  1099 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:27.728740  1011 raft_consensus.cc:2749] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:27.726377  1074 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:27.731225 27981 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.727547 27308 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.746289 27412 raft_consensus.cc:2468] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
I20260709 13:11:27.751371 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.754129  1149 raft_consensus.cc:2804] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:11:27.755193  1063 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:27.756835 27308 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.757963  1063 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.759516  1063 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:27.758966  1149 raft_consensus.cc:697] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:27.764568  1149 consensus_queue.cc:237] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:27.758857  1074 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.771718  1074 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.771934  1099 raft_consensus.cc:515] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.779286  1150 raft_consensus.cc:2804] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:27.782017  1150 raft_consensus.cc:697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:27.782950  1150 consensus_queue.cc:237] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:27.785331 27981 leader_election.cc:336] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:27.786051 27981 leader_election.cc:336] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.790568 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:27.791349 27412 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:27.792759 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.793632  1074 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.795715  1074 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:11:27.796173  1074 raft_consensus.cc:493] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:27.796629  1074 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:11:27.799429  1099 leader_election.cc:290] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:27.806754 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.812892 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfbd4344db4a4ffb8868b58ddc53af83" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:27.813556 27336 raft_consensus.cc:3060] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:11:27.821126 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.824338 27336 raft_consensus.cc:2468] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
W20260709 13:11:27.826759  1105 tablet_copy_client.cc:1131] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.826655 27159 catalog_manager.cc:5697] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 18 to 19, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 19 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.833446 27978 leader_election.cc:304] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.823709  1063 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:27.837421 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:27.838091 27412 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:11:27.841143 27309 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.853994 27412 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 18.
I20260709 13:11:27.866873  1153 raft_consensus.cc:2804] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:11:27.875578  1153 raft_consensus.cc:697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:27.876579  1153 consensus_queue.cc:237] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.877547 27308 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.878440  1150 raft_consensus.cc:2804] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:27.878971  1150 raft_consensus.cc:697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:27.843061  1074 raft_consensus.cc:515] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:27.885079  1074 leader_election.cc:290] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:27.836408  1063 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:27.889616 27981 leader_election.cc:336] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:27.897181 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b390ed75f2f14d258d4cdff9c656d787" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:27.897840 27416 raft_consensus.cc:3060] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:11:27.904891 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.921510 27157 catalog_manager.cc:5697] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 19 to 20, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 20 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:27.925009 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.918331 27416 raft_consensus.cc:2468] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
W20260709 13:11:27.955149 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.959030 27980 leader_election.cc:304] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:27.959930  1099 raft_consensus.cc:2804] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:11:27.960227 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:27.880046  1150 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } }
I20260709 13:11:27.960438  1099 raft_consensus.cc:697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 19 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:27.961436  1099 consensus_queue.cc:237] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:27.981503 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:27.991115 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.019619 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.026459 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.043470 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.076336 27159 catalog_manager.cc:5697] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 12 to 13, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 13 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:28.084491 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.090561 27157 catalog_manager.cc:5697] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 18 to 19, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 19 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.087649 27159 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 17 to 18, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 18 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.103080  1149 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.103679  1149 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.106703  1149 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.107787 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:28.112124 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.114722 27309 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.115243 27309 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.116025  1149 raft_consensus.cc:2749] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:28.140930 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.141975 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.166651  1149 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.167256  1149 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.175819  1149 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.178540 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:28.194288 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.196451 27309 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.197141 27309 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.198820  1149 raft_consensus.cc:2749] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:11:28.226015 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.230490  1085 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.231115  1085 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.239130 27383 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.244982  1085 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.245168 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
W20260709 13:11:28.245600 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.246347 27340 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:28.247582 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:28.249380  1085 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:11:28.249807  1085 raft_consensus.cc:493] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.250217  1085 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.254815 27408 raft_consensus.cc:1275] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:11:28.257637  1149 consensus_queue.cc:1048] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:28.262892 27415 raft_consensus.cc:1275] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:28.268282  1152 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.268167  1149 consensus_queue.cc:1048] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:28.267822  1085 raft_consensus.cc:515] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.268895  1152 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.270972  1152 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.274758 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.275198  1085 leader_election.cc:290] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.281785 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f78b1bcfcd4b219e6af2bf690b4f4b" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:28.282437 27340 raft_consensus.cc:3060] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:11:28.288980 27336 raft_consensus.cc:1275] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:11:28.297739  1074 consensus_queue.cc:1048] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:11:28.303680 27340 raft_consensus.cc:2468] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
W20260709 13:11:28.302850 27383 leader_election.cc:336] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:28.318352 27383 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.319131 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:28.331419  1085 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:28.336984 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.344004 27380 leader_election.cc:304] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:28.347806 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.357048 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.349169  1011 raft_consensus.cc:2804] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:11:28.378144  1011 raft_consensus.cc:697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:28.379091  1011 consensus_queue.cc:237] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.391601 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:28.397806 27416 raft_consensus.cc:1275] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:11:28.399462  1158 consensus_queue.cc:1048] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:11:28.411263 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.411890 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.429119 28015 raft_consensus.cc:3060] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEARNER]: Advancing to term 18
I20260709 13:11:28.460774 28015 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:28.434589  1085 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.476469  1158 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.477129  1158 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.508263  1150 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.508816  1150 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.472117  1085 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.538170 26158 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27289)
I20260709 13:11:28.544435  1149 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.545862  1149 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.548259  1149 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.550444 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.566725  1149 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.567296  1149 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.569492  1149 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.570606 27416 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:28.572305  1175 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.572540 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.572870  1175 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.574558  1175 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.534282  1158 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.586804 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.591250  1150 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.593469 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.594120  1085 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:28.605696 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:28.606284 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.617002  1063 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.617600  1063 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.622252  1063 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.627590 27159 catalog_manager.cc:5697] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 17 to 18, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 18 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.628592  1182 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.629240  1182 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.617097  1155 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.631604  1182 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:28.631563  1155 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.642993 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:28.643903 27309 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.644486 27309 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.647449  1149 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: NON_VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:28.648124 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.648804 27411 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 15.
I20260709 13:11:28.654808  1133 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:11:28.661415  1063 raft_consensus.cc:2749] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:28.662626 27309 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.663321 27309 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.664063  1063 raft_consensus.cc:2749] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:28.665205 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:28.665699 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.666177 27309 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.666550 27309 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.668226  1063 raft_consensus.cc:2749] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:28.668886  1155 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:28.670249 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:28.670734 27981 leader_election.cc:336] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.671839 27408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.671082 27981 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:28.674594  1176 raft_consensus.cc:2749] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:28.674826 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.675287 27981 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.672505 27408 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 13.
W20260709 13:11:28.684147 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 120725us
I20260709 13:11:28.689513 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.690181 27336 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:28.691442 27380 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.699411  1085 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:11:28.699852  1085 raft_consensus.cc:493] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.700222  1085 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.673152 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.704507 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:28.705145 28007 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 12.
I20260709 13:11:28.729784 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.730768  1180 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:28.731235  1180 raft_consensus.cc:493] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.731613  1180 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:28.735424 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 170173us
I20260709 13:11:28.750016  1063 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.750515  1063 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.750998  1063 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.755542  1149 raft_consensus.cc:1064] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
W20260709 13:11:28.756055  1149 raft_consensus.cc:1068] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: Unable to promote non-voter b0e4232110db400d8f43fe2170c24c95: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:28.772667  1168 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.773669  1085 raft_consensus.cc:515] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.752676  1155 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.777278  1155 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.773561  1168 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.781598  1168 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.781791  1155 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:28.787962  1063 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.787988  1180 raft_consensus.cc:515] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.794624  1180 leader_election.cc:290] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:28.808159 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "099c52bc6b98406cadce31d6411cb635" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:28.809105 28007 raft_consensus.cc:3060] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.790381  1063 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.820628  1085 leader_election.cc:290] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:28.824043 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 89441.7us
I20260709 13:11:28.826949 28012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:28.827634 28012 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 19.
I20260709 13:11:28.828774 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.829391 27340 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 19.
W20260709 13:11:28.834874 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 161827us
I20260709 13:11:28.836123 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.842943 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.845439 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008af8ad84434532baca82a0654da9bf" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:28.845440 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f1db10d9664160ae88f26e3becd4b7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:28.846390 27409 raft_consensus.cc:3060] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.846621 27340 raft_consensus.cc:3060] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:11:28.842777  1181 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.849618  1063 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.845767 27336 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:11:28.850127  1063 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.851816 27309 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.856855 27306 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:28.856959 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:28.858089 27340 raft_consensus.cc:2468] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 17.
I20260709 13:11:28.858876  1174 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.859338  1174 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.859700  1174 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.861677  1011 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.862246  1011 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.864367  1011 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.869747  1174 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.872816  1150 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:28.873297  1150 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.874518  1063 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.873689  1150 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.880726 28007 raft_consensus.cc:2468] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 13.
I20260709 13:11:28.849336  1181 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.882220  1189 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:11:28.882680  1189 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.883054  1181 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.883035  1189 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:11:28.885672 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
W20260709 13:11:28.902841 27309 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.902704  1189 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:28.903712 27309 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:28.904373 27309 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.904098 27409 raft_consensus.cc:2468] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 16.
I20260709 13:11:28.898900  1150 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.872848  1174 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:28.909539  1150 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.911393 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.914930 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.915537 27336 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b0e4232110db400d8f43fe2170c24c95 in current term 20: Already voted for candidate 161ec4aacbd54a4989d6762a9ed4eafe in this term.
I20260709 13:11:28.915764 27340 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:28.916811  1189 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:28.917522 27981 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.918525 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:28.918838 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 69593.8us
I20260709 13:11:28.919792 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95"
I20260709 13:11:28.920506 28007 raft_consensus.cc:2393] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 161ec4aacbd54a4989d6762a9ed4eafe in current term 20: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:11:28.920346 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:28.921029 27340 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:28.921507  1176 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:28.921947 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:28.922595 27409 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 11.
I20260709 13:11:28.924512 27412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56b15c3e61ae45a6b84a4d2a3838c018" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:28.925112 27412 raft_consensus.cc:3060] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.927727  1181 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:28.919516 27380 leader_election.cc:304] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.928170  1181 raft_consensus.cc:493] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.928588  1181 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.928907  1188 raft_consensus.cc:2804] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:11:28.929421  1188 raft_consensus.cc:697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:28.930244  1188 consensus_queue.cc:237] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.935770 27380 leader_election.cc:304] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.940044  1011 raft_consensus.cc:2804] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:28.942847  1011 raft_consensus.cc:697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:28.943775  1011 consensus_queue.cc:237] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:28.940740 27308 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:28.948741 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.949019 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.949590  1191 raft_consensus.cc:2804] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:28.949872  1180 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:11:28.950143  1191 raft_consensus.cc:697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:28.950266  1189 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:28.950307  1180 raft_consensus.cc:493] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.950754  1189 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.951013  1180 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:11:28.951232  1189 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:28.942220 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.961915 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:28.951043  1191 consensus_queue.cc:237] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.967463  1189 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.972239  1189 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:28.969642 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.975364  1186 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:28.975773  1186 raft_consensus.cc:493] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 203d83f7fac847e0beee51aa18513b25)
I20260709 13:11:28.976130  1186 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:28.937291 27412 raft_consensus.cc:2468] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 14.
I20260709 13:11:28.978609 27411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3defd7d5f6684c09bb491b62d9c1cba1" candidate_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:28.979226 27411 raft_consensus.cc:3060] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.980175  1180 raft_consensus.cc:515] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:28.984309 27383 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:28.986037 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:28.986495 27383 leader_election.cc:336] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:28.989117 27308 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:28.990154  1192 raft_consensus.cc:2804] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:28.990640  1192 raft_consensus.cc:697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:28.991466  1192 consensus_queue.cc:237] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.992355  1181 raft_consensus.cc:515] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:28.994621  1181 leader_election.cc:290] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:29.001566 27309 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.007226 27340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13cceb5d4cfd4e358a438f514c9e75f0" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:29.007922 27340 raft_consensus.cc:3060] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:28.989197  1186 raft_consensus.cc:515] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:29.031086 27411 raft_consensus.cc:2468] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 161ec4aacbd54a4989d6762a9ed4eafe in term 12.
I20260709 13:11:29.039866 27308 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:29.052758 27336 raft_consensus.cc:1275] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:11:29.050696 27159 catalog_manager.cc:5697] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 16 to 17, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 17 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.061507 27340 raft_consensus.cc:2468] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 14.
I20260709 13:11:29.065882  1188 consensus_queue.cc:1048] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:29.060232  1189 raft_consensus.cc:2804] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:29.092348  1186 leader_election.cc:290] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:29.094681 27383 leader_election.cc:336] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:29.096516 27383 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.100641  1180 leader_election.cc:290] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:29.102137 27383 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:29.102949 27383 leader_election.cc:336] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.107758 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdb46c37e35142cf8e2148ef2d2da5e7" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:29.108403 27336 raft_consensus.cc:3060] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:29.112665 27157 catalog_manager.cc:5697] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 15 to 16, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 16 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.119717 27342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17909c3b30eb43b79bd7ea94e48dcef1" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:29.120361 27342 raft_consensus.cc:3060] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:11:29.127673 27309 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.128381 27309 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe; no voters: 203d83f7fac847e0beee51aa18513b25, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:29.149209 27336 raft_consensus.cc:2468] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 15.
I20260709 13:11:29.154460 27342 raft_consensus.cc:2468] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:29.129424 27159 catalog_manager.cc:5697] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 12 to 13, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 13 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.158262 27380 leader_election.cc:304] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:29.165484  1180 raft_consensus.cc:2804] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:29.166406  1180 raft_consensus.cc:697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:29.167661  1180 consensus_queue.cc:237] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:29.169955 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:29.170476 27383 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:29.171037 27383 leader_election.cc:336] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.157859  1149 raft_consensus.cc:2749] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:11:29.195452 27380 leader_election.cc:304] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:29.197168 27380 leader_election.cc:304] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
W20260709 13:11:29.204819 27309 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:29.223973 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 52153.8us
W20260709 13:11:29.224826 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.225229 27383 leader_election.cc:336] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:29.225911 27383 leader_election.cc:336] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.196592  1189 raft_consensus.cc:697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Becoming Leader. State: Replica: 161ec4aacbd54a4989d6762a9ed4eafe, State: Running, Role: LEADER
I20260709 13:11:29.206709  1181 raft_consensus.cc:2804] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:29.210022  1182 raft_consensus.cc:2804] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:11:29.247964  1181 raft_consensus.cc:697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:29.256188  1182 raft_consensus.cc:697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Becoming Leader. State: Replica: d02eb2355bc54e7f8c13a30c33793d95, State: Running, Role: LEADER
I20260709 13:11:29.286239  1182 consensus_queue.cc:237] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:29.299614 27309 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:29.294587  1189 consensus_queue.cc:237] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:29.311326  1181 consensus_queue.cc:237] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:29.324944  1063 raft_consensus.cc:1064] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: attempting to promote NON_VOTER b0e4232110db400d8f43fe2170c24c95 to VOTER
I20260709 13:11:29.328114  1063 consensus_queue.cc:237] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:29.337997 27338 raft_consensus.cc:1275] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:11:29.340113 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.343298  1168 consensus_queue.cc:1048] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:29.365651 27411 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:29.368088  1202 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:29.379071 28007 raft_consensus.cc:1275] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 LEARNER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:11:29.388573  1063 consensus_queue.cc:1048] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:11:29.403669 27416 raft_consensus.cc:1275] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:11:29.406291  1133 consensus_queue.cc:1048] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:29.427752  1212 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:11:29.430365 27159 catalog_manager.cc:5697] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 13 to 14, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 14 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.457738 27159 catalog_manager.cc:5697] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 14 to 15, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 15 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.469221 27159 catalog_manager.cc:5697] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 reported cstate change: term changed from 15 to 16, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131). New cstate: current_term: 16 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.482015 27165 catalog_manager.cc:5697] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 13 to 14, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 14 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.487418 27165 catalog_manager.cc:5697] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: term changed from 11 to 12, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130). New cstate: current_term: 12 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:29.492609 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.531623 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.538707 26158 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27289)
I20260709 13:11:29.555780 28015 raft_consensus.cc:1275] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:29.577750  1085 consensus_queue.cc:1048] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:11:29.608999  1063 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 12 to 14, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:29.683805  1212 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:11:29.703061 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 89145.8us
W20260709 13:11:29.769886 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.774171 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.784929 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.784941 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 59124.7us
W20260709 13:11:29.792418 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.794971 27340 raft_consensus.cc:1275] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:29.826367 27409 raft_consensus.cc:1275] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:29.829651 27415 raft_consensus.cc:1275] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Refusing update from remote peer 161ec4aacbd54a4989d6762a9ed4eafe: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:11:29.834041 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.833187 27414 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
I20260709 13:11:29.853515 27340 raft_consensus.cc:1275] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:11:29.855028  1203 consensus_queue.cc:1048] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:29.856052  1063 consensus_queue.cc:1048] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:29.856901  1011 consensus_queue.cc:1048] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:29.874832 28012 raft_consensus.cc:2955] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:29.881451  1222 log.cc:927] Time spent T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
W20260709 13:11:29.883882 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:29.895220 27157 catalog_manager.cc:5697] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe reported cstate change: config changed from index 12 to 14, b0e4232110db400d8f43fe2170c24c95 (127.25.139.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:29.922008 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 66394.2us
I20260709 13:11:29.927659 27336 raft_consensus.cc:1275] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Refusing update from remote peer d02eb2355bc54e7f8c13a30c33793d95: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:11:29.933388  1011 consensus_queue.cc:1048] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:29.958321  1188 consensus_queue.cc:1048] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:29.975833 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.976344 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.044945 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 44339.9us
W20260709 13:11:30.194309 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.255204 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.261569 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.356472 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.380076 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.402205 27981 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111) [suppressed 415 similar messages]
W20260709 13:11:30.451740 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.496174 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.539227 26158 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:30.562516 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.606227 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.625509 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.642167 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.654230 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.654865 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.668401 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.688100 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.740595 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:30.744148 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:30.780125 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.792580 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.811939 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.815866 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.845988 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.945775 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:30.959726 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:31.010600 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.114836 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:31.161159  1234 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.161780  1234 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:31.167503  1234 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:31.175514 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.176967 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.183558 27981 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:31.189141 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:31.229878 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:31.267093 27336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" is_pre_election: true
I20260709 13:11:31.267858 27336 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 20.
W20260709 13:11:31.269029 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:31.270229 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:31.270133 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:31.698022 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 427954us
W20260709 13:11:31.539757 26158 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 27289)
I20260709 13:11:31.699687  1210 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:11:31.700157  1210 raft_consensus.cc:493] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.700485  1210 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:11:31.718129 27308 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:34895, user_credentials={real_user=slave}} blocked reactor thread for 406131us
I20260709 13:11:31.806632  1210 raft_consensus.cc:515] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:31.817229  1210 leader_election.cc:290] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 election: Requested vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:31.844542 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.864123 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.878530 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.925693 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.931084 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:31.938112 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 169697us
I20260709 13:11:31.943873 27343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c760b3987ef34e0189563d3ccb585eed" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "161ec4aacbd54a4989d6762a9ed4eafe"
I20260709 13:11:31.944527 27343 raft_consensus.cc:3060] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:11:31.956220 27343 raft_consensus.cc:2468] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 21.
I20260709 13:11:31.958180 27978 leader_election.cc:304] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95; no voters: 
I20260709 13:11:31.959096  1174 raft_consensus.cc:2804] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:11:31.959726  1174 raft_consensus.cc:697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 21 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:31.960589  1174 consensus_queue.cc:237] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:31.926067 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 59033.6us
I20260709 13:11:31.988103 27159 catalog_manager.cc:5697] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 19 to 21, leader changed from 203d83f7fac847e0beee51aa18513b25 (127.25.139.129) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 21 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:32.017299 27981 leader_election.cc:336] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:32.050052 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.153836 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.184664 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.292624 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800164c20 after lost signal to thread 26161
W20260709 13:11:32.293871 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4540 after lost signal to thread 27200
W20260709 13:11:32.295337 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08000e61a0 after lost signal to thread 27367
W20260709 13:11:32.296506 27438 debug-util.cc:398] Leaking SignalData structure 0x7b0800032900 after lost signal to thread 27441
W20260709 13:11:32.297672 27438 debug-util.cc:398] Leaking SignalData structure 0x7b08003af820 after lost signal to thread 28039
W20260709 13:11:32.339977 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.394713 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.415983 27343 raft_consensus.cc:1275] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:11:32.426244  1174 consensus_queue.cc:1048] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:32.472472 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.522610 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:32.570586 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.572028 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.586984 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.589454 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.667429 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:32.699604 26158 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:32.825021 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:33.018822 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.089717 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.155710 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.190505 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.277292 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.324867 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.416805 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.429363 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.477033 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.588569 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.591192 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.611685 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.634586 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.643115 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.642298 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.647064 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.666252 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.676784 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.700170 26158 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:33.703253 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.714802 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.721764 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.727751 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.779147 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.820026 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.874300 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:33.980327 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:33.982265 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.037292 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.046233 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.124727 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.310140 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.324371 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.346410 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.364181 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.475677 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.558156 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:34.608150 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:34.610702 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:34.620141 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:34.700685 26158 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:34.758301 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:34.806994 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:34.835192 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:34.936558 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:35.001753 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:35.023726 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:35.117547 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:35.215519 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.280503 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.297163 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:35.330829 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:35.448575 27309 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260709 13:11:35.506788 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.564515 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.651913 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.701349 26158 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:35.889313 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.891542 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:35.979262 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.043183 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.047493 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.048358 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.086627 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.137132 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.148345 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.149559 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.190665 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.222514 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.222739 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.307960 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.318778 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.321718 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.330730 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.359407 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.489637 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.579243 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.671751 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 64808.7us
W20260709 13:11:36.685930 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.700292 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.701839 26158 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:36.784183 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.800894 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.804872 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.806397 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.817495 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:36.861200 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.864059 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:36.917791 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.039731 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.058684 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.087554 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.133180 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:37.226085 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.235366 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.243192 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:37.351402 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.433363 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:37.635023 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.702317 26158 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:37.729241 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.773895 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.822913 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:37.872854 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:37.927872 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.092826 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.105978 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:38.135217 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.292459 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.390930 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.455359 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.473240 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.540690 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.576814 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.578431 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.633361 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.671636 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:38.681135 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 57269.5us
W20260709 13:11:38.702836 26158 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:38.806229 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 61393.7us
W20260709 13:11:38.819380 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.869015 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.891626 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.944489 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:38.991385 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:39.025091 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.037392 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.064764 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.077361 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.123688 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.134493 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.150027 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.189540 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.270237 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.272567 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.289978 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.340111 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.433254 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.446267 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.472138 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:39.521973 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.539032 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.550150 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.552614 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.614995 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.703425 26158 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:39.712502 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.815774 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.837383 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:39.982746 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:39.991312 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 53078.7us
W20260709 13:11:40.083669 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.089659 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.158159 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.201243 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.264914 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.365331 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.462632 27383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111) [suppressed 469 similar messages]
W20260709 13:11:40.476226 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:40.488938 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:40.615515 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:40.615871 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:40.625957 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:40.703948 26158 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:40.851001 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:40.924062 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:40.941323 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.072829 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.152554 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.164011 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.367327 27380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 46801.7us
W20260709 13:11:41.368564 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.370543 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.384207 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.387362 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.395776 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.428484 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.454342 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.464016 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.465420 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.566916 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.601015 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.608650 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.633628 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.644027 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.705031 26158 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:41.711862 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.788393 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.816190 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:41.833808 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.858227 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.891601 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.894527 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.897280 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:41.919852 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.953660 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:41.999897 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.033601 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.065008 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.088989 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.103332 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.186120 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.508473 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.571615 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.681088 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.705519 26158 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:42.710610 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:42.717639 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.717427 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.879853 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:42.926476 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:43.006942 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:43.040694 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.091311 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:43.137889 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.139106 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.286010 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.318959 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.489936 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:43.533577 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:43.548756 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:43.669190 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.701419 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.706022 26158 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:43.745296 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.788168 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.834403 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.937681 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:43.945451 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.000802 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.019373 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.043335 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.114742 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.115581 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.175760 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.187517 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.253345 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.260233 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.300836 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.313522 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.313810 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.327414 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.349141 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.384929 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:44.420565 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.421765 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.431089 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.467657 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.482164 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.512624 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.512897 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:44.674719 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:44.706771 26158 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:44.840860 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:45.035151 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.043253 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.170831 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.181423 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:45.225255 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.234465 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:45.298780 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.385416 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.465183 27383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111) [suppressed 494 similar messages]
W20260709 13:11:45.480904 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:45.605389 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:11:45.606781 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:45.665824 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:45.707473 26158 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:45.821909 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:45.916451 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.040300 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.041019 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.041493 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.109995 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.184228 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.232151 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.264496 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.299685 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.309832 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.345156 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.350309 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.375821 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.418797 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.428318 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.439424 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.473910 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.521049 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.550598 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.638929 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.651093 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.708722 26158 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:46.736707 27306 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42123, user_credentials={real_user=slave}} blocked reactor thread for 48959.1us
W20260709 13:11:46.751821 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.759464 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.810318 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:46.811478 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.842399 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.843986 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.873008 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.893864 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.896239 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.987035 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:46.991860 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:46.992581 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.079420 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.169690 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:47.472195 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:47.510526 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:47.543766 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:47.579370 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.721160 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.724298 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:47.731292 26158 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 27289)
W20260709 13:11:47.738312 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:47.953737 27309 consensus_peers.cc:597] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:48.011590 27309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 57887.7us
W20260709 13:11:47.994760 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 246876us
W20260709 13:11:48.080134 27309 consensus_peers.cc:597] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:48.197124 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:11:48.294348 27309 consensus_peers.cc:597] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.472698 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:11:48.489986 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.495497 27309 consensus_peers.cc:597] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.556959 27309 consensus_peers.cc:597] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:48.567004 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:48.588122 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.648876 27309 consensus_peers.cc:597] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.712646 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.715345 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.734700 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.741881 27309 consensus_peers.cc:597] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:48.780735 27309 consensus_peers.cc:597] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.795514 27197 debug-util.cc:398] Leaking SignalData structure 0x7b08003641e0 after lost signal to thread 26161
W20260709 13:11:48.796697 27197 debug-util.cc:398] Leaking SignalData structure 0x7b0800338c00 after lost signal to thread 27200
W20260709 13:11:48.797996 27197 debug-util.cc:398] Leaking SignalData structure 0x7b08003363a0 after lost signal to thread 27367
W20260709 13:11:48.799094 27197 debug-util.cc:398] Leaking SignalData structure 0x7b0800141080 after lost signal to thread 27441
W20260709 13:11:48.802874 27197 debug-util.cc:398] Leaking SignalData structure 0x7b08003c96e0 after lost signal to thread 28039
I20260709 13:11:48.790649 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
W20260709 13:11:48.856258 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.936757 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:48.958141 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.094887 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.099531 27309 consensus_peers.cc:597] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.171881 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.174784 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.196079 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.224941 27309 consensus_peers.cc:597] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.228536 27309 consensus_peers.cc:597] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.240134 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.274703 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.282948 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 117444us
W20260709 13:11:49.316515 27309 consensus_peers.cc:597] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.325045 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.329807 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.340111 27309 consensus_peers.cc:597] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.379480 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:49.402987 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:49.490716 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
W20260709 13:11:49.522682 27978 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.526081 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.531683 27380 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.548794 27978 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.574604 27978 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.590792 27978 consensus_peers.cc:597] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.600607 27309 consensus_peers.cc:597] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.603442 27309 consensus_peers.cc:597] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.608861 27380 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.617792 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.628821 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:49.686785 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:49.693536 26158 tablet_replica.cc:333] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.694754 26158 raft_consensus.cc:2243] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.707206 26158 raft_consensus.cc:2272] T 43ab3e6cd15341cd8cc43296cb7ce69d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.709355 27380 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.714181 26158 tablet_replica.cc:333] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.715565 26158 raft_consensus.cc:2243] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.716490 26158 raft_consensus.cc:2272] T d4b61886e4de43d1a7459c0b2b639537 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.719126 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.721272 27380 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.724514 27978 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.726100 26158 tablet_replica.cc:333] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.731891 26158 raft_consensus.cc:2243] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.734202 26158 raft_consensus.cc:2272] T 1f43efa5ed2d4349a1025bedcb71ff49 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.739329 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.740170 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:49.742170 27380 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.744263 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:49.751561 26158 tablet_replica.cc:333] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.752632 26158 raft_consensus.cc:2243] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.753858 26158 raft_consensus.cc:2272] T a4df1b7ffb3d487ea7c361ac87825c5d P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.760093 27380 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.767913 26158 tablet_replica.cc:333] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.769023 26158 raft_consensus.cc:2243] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.770196 26158 raft_consensus.cc:2272] T fbda0aef93534e40827c2bc13b826560 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.773272 26158 tablet_replica.cc:333] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.776922 27978 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.780450 27978 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.786806 26158 raft_consensus.cc:2243] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.792346 26158 raft_consensus.cc:2272] T 60414d130cdc460696513fb91e20161f P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.863411 27978 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.872800 26158 tablet_replica.cc:333] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.888484 27978 consensus_peers.cc:597] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.871503 27380 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.893443 26158 raft_consensus.cc:2243] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:49.900660 27978 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.907979 26158 raft_consensus.cc:2272] T 415aa8030d05423fbf90a8f010b516d3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.911916 26158 tablet_replica.cc:333] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.912832 26158 raft_consensus.cc:2243] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.913882 26158 raft_consensus.cc:2272] T 8a295e8566b04b49918a92cb09270d62 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.918469 26158 tablet_replica.cc:333] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.919524 26158 raft_consensus.cc:2243] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.921859 26158 raft_consensus.cc:2272] T 59877a2f8723407f9fd30c7505cc2e29 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.925184 26158 tablet_replica.cc:333] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.925511 27309 consensus_peers.cc:597] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:49.926783 27380 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.927141 26158 raft_consensus.cc:2243] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:49.927992 27380 consensus_peers.cc:597] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.929171 27380 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.929682 26158 raft_consensus.cc:2272] T 0287d5309a46494ca6fc1acd716c9c17 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.929777 27380 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.939267 27380 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.939899 26158 tablet_replica.cc:333] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.940044 27380 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.940773 27380 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.941401 27380 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.942008 27380 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.942209 26158 raft_consensus.cc:2243] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.944046 26158 raft_consensus.cc:2272] T f872873b55df4f2ab953481b0bbe5229 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.947418 26158 tablet_replica.cc:333] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.949026 26158 raft_consensus.cc:2243] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.950358 26158 raft_consensus.cc:2272] T a30a45f010dd49e5a9ddb107297fa03e P 161ec4aacbd54a4989d6762a9ed4eafe [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.953639 26158 tablet_replica.cc:333] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.954758 26158 raft_consensus.cc:2243] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.955529 26158 raft_consensus.cc:2272] T 54f78b1bcfcd4b219e6af2bf690b4f4b P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.958633 26158 tablet_replica.cc:333] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:49.961473 26158 raft_consensus.cc:2243] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.962332 26158 raft_consensus.cc:2272] T e0b732e9fe744ccfb9006867b9ec2cd7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.964327 27309 consensus_peers.cc:597] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:49.970799 26158 tablet_replica.cc:333] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.970996 27978 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.971895 26158 raft_consensus.cc:2243] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.991385 26158 raft_consensus.cc:2272] T bf4fb4f20e74427f86180930e86a7afc P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.994441 26158 tablet_replica.cc:333] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:49.984282 27380 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.995344 26158 raft_consensus.cc:2243] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.996299 26158 raft_consensus.cc:2272] T a0d30dde9c4c4d778d398130da0cdaea P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.999773 26158 tablet_replica.cc:333] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.000805 26158 raft_consensus.cc:2243] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.010370 26158 raft_consensus.cc:2272] T 170c6d7d3371409fbd512d4226e702f5 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.013615 26158 tablet_replica.cc:333] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:50.027827 27978 consensus_peers.cc:597] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.024345 26158 raft_consensus.cc:2243] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.030973 26158 raft_consensus.cc:2272] T a055e36ded584640806637e94e87f6b9 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.034157 26158 tablet_replica.cc:333] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.035069 26158 raft_consensus.cc:2243] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.036303 26158 raft_consensus.cc:2272] T 0f3e88c6f82141d8a7a8cb507f425200 P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.055466 26158 tablet_replica.cc:333] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.056473 26158 raft_consensus.cc:2243] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.057188 26158 raft_consensus.cc:2272] T 3412bba6f0c740dd9adb1895146dd937 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.060269 26158 tablet_replica.cc:333] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.061146 26158 raft_consensus.cc:2243] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.062553 26158 raft_consensus.cc:2272] T 4b44d9e3827f45eabce8235344e58d0f P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.065478 26158 tablet_replica.cc:333] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.066468 26158 raft_consensus.cc:2243] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.068931 26158 raft_consensus.cc:2272] T e376a729bb7c47e99662f97b33ea32c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.074033 26158 tablet_replica.cc:333] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.079881 26158 raft_consensus.cc:2243] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.081243 26158 raft_consensus.cc:2272] T 4d586a4492094f0dbea7efd8255dd991 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.084698 26158 tablet_replica.cc:333] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.095911 26158 raft_consensus.cc:2243] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.097087 26158 raft_consensus.cc:2272] T cfbd4344db4a4ffb8868b58ddc53af83 P 161ec4aacbd54a4989d6762a9ed4eafe [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.100154 26158 tablet_replica.cc:333] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.101153 26158 raft_consensus.cc:2243] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.102988 26158 raft_consensus.cc:2272] T 41a124c306f9418a8556266f795a58b3 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.105967 26158 tablet_replica.cc:333] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.110602 26158 raft_consensus.cc:2243] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.111726 26158 raft_consensus.cc:2272] T d0aa2cbbfc6b45fe8d8f862c301f1909 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.122113 26158 tablet_replica.cc:333] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.123078 26158 raft_consensus.cc:2243] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:50.123489 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:50.124032 26158 raft_consensus.cc:2272] T c4f1db10d9664160ae88f26e3becd4b7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.135458 26158 tablet_replica.cc:333] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.136564 26158 raft_consensus.cc:2243] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.137861 26158 raft_consensus.cc:2272] T 0f07af3920db4e9da19de0ec4eba7c75 P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.141042 26158 tablet_replica.cc:333] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.141945 26158 raft_consensus.cc:2243] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.164422 26158 raft_consensus.cc:2272] T 13cceb5d4cfd4e358a438f514c9e75f0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.169517 26158 tablet_replica.cc:333] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.179883 26158 raft_consensus.cc:2243] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.181010 26158 raft_consensus.cc:2272] T e004b67b35dd4a9b8ccf73182f7bdf58 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.184085 26158 tablet_replica.cc:333] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.185048 26158 raft_consensus.cc:2243] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.185882 26158 raft_consensus.cc:2272] T efee0a6a9d2c4ed096004a49852dbc86 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.201915 26158 tablet_replica.cc:333] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.202873 26158 raft_consensus.cc:2243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.203951 26158 raft_consensus.cc:2272] T d1a9f1b01ac8406691c2d1c83b5dcca0 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.206951 26158 tablet_replica.cc:333] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.207829 26158 raft_consensus.cc:2243] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.214494 26158 raft_consensus.cc:2272] T 56b15c3e61ae45a6b84a4d2a3838c018 P 161ec4aacbd54a4989d6762a9ed4eafe [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.217633 26158 tablet_replica.cc:333] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
W20260709 13:11:50.233367 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:11:50.225419 26158 raft_consensus.cc:2243] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.236898 26158 raft_consensus.cc:2272] T 008af8ad84434532baca82a0654da9bf P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.240290 26158 tablet_replica.cc:333] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.241295 26158 raft_consensus.cc:2243] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.242585 26158 raft_consensus.cc:2272] T ca25783a146d4038878d9ffd69f34217 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.245643 26158 tablet_replica.cc:333] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.255972 26158 raft_consensus.cc:2243] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.262508 26158 raft_consensus.cc:2272] T 3defd7d5f6684c09bb491b62d9c1cba1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.265746 26158 tablet_replica.cc:333] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.266680 26158 raft_consensus.cc:2243] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.267619 26158 raft_consensus.cc:2272] T 05efe4ee1469496f84eca86709a6b478 P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.271988 26158 tablet_replica.cc:333] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.283809 26158 raft_consensus.cc:2243] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.285024 26158 raft_consensus.cc:2272] T c760b3987ef34e0189563d3ccb585eed P 161ec4aacbd54a4989d6762a9ed4eafe [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.294055 26158 tablet_replica.cc:333] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.294998 26158 raft_consensus.cc:2243] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.295886 26158 raft_consensus.cc:2272] T cdb46c37e35142cf8e2148ef2d2da5e7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.298123 26158 tablet_replica.cc:333] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.298902 26158 raft_consensus.cc:2243] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.300168 26158 raft_consensus.cc:2272] T 76061244738f450fb409cb866212c235 P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.303258 26158 tablet_replica.cc:333] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.304112 26158 raft_consensus.cc:2243] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.305258 26158 raft_consensus.cc:2272] T 4d09be3e7a494235854c88600f2adfad P 161ec4aacbd54a4989d6762a9ed4eafe [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.308310 26158 tablet_replica.cc:333] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.309110 26158 raft_consensus.cc:2243] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.310362 26158 raft_consensus.cc:2272] T 21d14940356a45ada8e16731853b8769 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.313265 26158 tablet_replica.cc:333] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.314075 26158 raft_consensus.cc:2243] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.314795 26158 raft_consensus.cc:2272] T 427b3f6c9e74407ebaecb4a51f7b4fcf P 161ec4aacbd54a4989d6762a9ed4eafe [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.317829 26158 tablet_replica.cc:333] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.318666 26158 raft_consensus.cc:2243] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.319993 26158 raft_consensus.cc:2272] T 804fae3c2b684e6a8a7c159e417231fa P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.322891 26158 tablet_replica.cc:333] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.323783 26158 raft_consensus.cc:2243] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.331182 26158 raft_consensus.cc:2272] T e622bd20107a4c4190d71a5b581aa506 P 161ec4aacbd54a4989d6762a9ed4eafe [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.334563 26158 tablet_replica.cc:333] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.335453 26158 raft_consensus.cc:2243] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.336229 26158 raft_consensus.cc:2272] T 189d9bcac7d24abe800257c915b738c7 P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.339412 26158 tablet_replica.cc:333] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.340211 26158 raft_consensus.cc:2243] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.341388 26158 raft_consensus.cc:2272] T e9cc5476f0fd4bceaab7f594e240f37c P 161ec4aacbd54a4989d6762a9ed4eafe [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.344429 26158 tablet_replica.cc:333] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.345239 26158 raft_consensus.cc:2243] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.345985 26158 raft_consensus.cc:2272] T 5b64b3a0d3c44ff1893b67152ebe2c50 P 161ec4aacbd54a4989d6762a9ed4eafe [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.348862 26158 tablet_replica.cc:333] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.349643 26158 raft_consensus.cc:2243] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.350313 26158 raft_consensus.cc:2272] T d07722edbe05448eaa1edebf1ce562cd P 161ec4aacbd54a4989d6762a9ed4eafe [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.353314 26158 tablet_replica.cc:333] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe: stopping tablet replica
I20260709 13:11:50.354070 26158 raft_consensus.cc:2243] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.354830 26158 raft_consensus.cc:2272] T 17909c3b30eb43b79bd7ea94e48dcef1 P 161ec4aacbd54a4989d6762a9ed4eafe [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.381564 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:50.390341 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:50.456525 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:50.526865 27383 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111) [suppressed 522 similar messages]
W20260709 13:11:50.722139 27978 connection.cc:573] client connection to 127.25.139.130:35457 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:11:51.627084  1345 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.628106  1345 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.631150  1346 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.631356  1345 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.631955  1345 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.631927  1346 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.632710  1345 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.635195  1345 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.635188  1346 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.641525 27160 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33596 (request call id 297) took 1224 ms. Trace:
I20260709 13:11:51.641912 27160 rpcz_store.cc:276] 0709 13:11:50.416543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.416778 (+   235us) service_pool.cc:224] Handling call
0709 13:11:51.641339 (+1224561us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:11:51.642768 27159 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55118 (request call id 212) took 1127 ms. Trace:
I20260709 13:11:51.643728 27159 rpcz_store.cc:276] 0709 13:11:50.515784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:50.515998 (+   214us) service_pool.cc:224] Handling call
0709 13:11:51.642594 (+1126596us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5269,"reported_tablets":1}
W20260709 13:11:51.655046 27978 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.655664 27978 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.656169 27978 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:51.671391  1340 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.672073  1340 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.674487  1340 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:51.751183 27981 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.028s	sys 0.014s
W20260709 13:11:51.755522 27981 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.030s	sys 0.014s
I20260709 13:11:51.760087  1350 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.760743  1350 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.760290  1325 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.761670  1325 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.763801  1325 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.765092  1340 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.765652  1340 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.739974  1352 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.767927  1352 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.771586  1352 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.773509  1338 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.781375  1353 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.787789  1351 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.800733  1351 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.801822  1339 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.802554  1343 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.802419  1339 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.803071  1343 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.805357  1339 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.805295  1353 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.806933  1351 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:51.763093  1350 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.827431  1343 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:51.807796  1340 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.800484  1352 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.828382  1352 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:51.829174 27981 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.829644 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:51.830272  1352 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.797204  1338 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.822654  1354 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.811501  1346 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.825170  1342 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:51.825785  1353 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:51.832768 27978 leader_election.cc:336] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:51.835112  1339 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.841528  1342 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.835278  1346 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.843058  1360 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.843616  1360 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.844424  1342 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.844781  1346 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.845093  1354 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.845656  1360 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:51.846663  1340 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.847148  1340 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.847648  1354 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:51.848249 27364 debug-util.cc:398] Leaking SignalData structure 0x7b08003d59c0 after lost signal to thread 26161
I20260709 13:11:51.849296  1340 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.849711  1352 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.850126  1360 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
W20260709 13:11:51.852313 27364 debug-util.cc:398] Leaking SignalData structure 0x7b080035e7a0 after lost signal to thread 27200
W20260709 13:11:51.856289 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:51.841333 27978 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.857384 27364 debug-util.cc:398] Leaking SignalData structure 0x7b08003e03c0 after lost signal to thread 27441
W20260709 13:11:51.858677 27364 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1d20 after lost signal to thread 28039
I20260709 13:11:51.860240  1338 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.861514  1343 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.862025  1343 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.864012  1343 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:51.864687  1358 raft_consensus.cc:493] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:51.867063  1350 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.873078  1350 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:51.875063 27981 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.868263 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.876135 27409 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:11:51.876356  1350 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:51.866086  1353 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.869033 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.877256 27981 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:51.877660 27414 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 21.
I20260709 13:11:51.877447  1353 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.881768  1353 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.878206  1354 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:51.869210  1360 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.867199  1351 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.883723  1351 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.885901  1351 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.856686  1352 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.870091  1349 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.886749  1349 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.888269  1360 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.888797  1349 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.870857  1361 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.889585  1361 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.891729  1361 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.870051  1340 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.892442  1340 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:51.894413  1340 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:51.872334  1358 raft_consensus.cc:515] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.896903  1358 leader_election.cc:290] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.899317  1352 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:51.902598 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 45520.9us
I20260709 13:11:51.903261 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.906899 27414 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 12.
W20260709 13:11:51.903894 27978 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.907784 27978 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.910071 27978 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:51.913434 27981 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.920717 27981 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:51.916481 27380 connection.cc:769] client connection to 127.25.139.130:35457 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:11:51.923830 27978 leader_election.cc:336] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:51.924449  1358 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:51.924916 27981 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.928751 27981 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:51.933954 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.934918 27409 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 16.
I20260709 13:11:51.936503 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "415aa8030d05423fbf90a8f010b516d3" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.939376  1358 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:51.945772 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.946493 27414 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 18.
I20260709 13:11:51.947784 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.948426 27414 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:11:51.950812 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07722edbe05448eaa1edebf1ce562cd" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
I20260709 13:11:51.951701 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:51.952368 28010 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:51.953272 27980 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:51.953704  1358 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:51.954407  1354 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:51.954270  1358 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.954814  1354 raft_consensus.cc:493] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.955243  1354 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:51.957221  1358 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.963266  1354 raft_consensus.cc:515] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.964493 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:51.968750  1339 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:11:51.967008 27978 leader_election.cc:336] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:51.969116  1339 raft_consensus.cc:493] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.969504  1339 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:51.970607 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:51.971469  1359 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:51.971894  1359 raft_consensus.cc:493] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.972308  1359 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:51.976819  1354 leader_election.cc:290] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:51.977692 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b44d9e3827f45eabce8235344e58d0f" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95" is_pre_election: true
W20260709 13:11:51.981443 27383 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.982301 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:51.986676 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:51.977679  1339 raft_consensus.cc:515] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:51.987926 27980 leader_election.cc:304] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:51.988502 28010 raft_consensus.cc:2393] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 22: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:11:51.990156  1354 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:51.988889  1342 raft_consensus.cc:2749] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:51.989002  1339 leader_election.cc:290] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:51.969441 27981 leader_election.cc:336] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:51.991061  1354 raft_consensus.cc:493] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:51.997179  1354 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:51.991029 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:51.999989  1339 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:51.984143  1359 raft_consensus.cc:515] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:52.003394 27414 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:51.992817 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca25783a146d4038878d9ffd69f34217" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:51.996594 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:52.003715 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f07af3920db4e9da19de0ec4eba7c75" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:52.003998 27414 raft_consensus.cc:3060] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:52.004360 27409 raft_consensus.cc:3060] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:11:52.004676 28010 raft_consensus.cc:2393] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:11:51.986688 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.006157 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.006608 27383 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.008935 27383 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:52.009268 27416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:52.009876 27416 raft_consensus.cc:3060] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:52.011618 27414 raft_consensus.cc:2468] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:11:52.012303  1359 leader_election.cc:290] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:52.014480 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43efa5ed2d4349a1025bedcb71ff49" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:52.015417 28010 raft_consensus.cc:2393] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 13: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
I20260709 13:11:52.024151 27416 raft_consensus.cc:2468] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 13.
I20260709 13:11:52.025270 27409 raft_consensus.cc:2468] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 22.
W20260709 13:11:52.021951 27978 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.032912 27980 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
W20260709 13:11:52.033440 27978 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.034018 27980 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 
I20260709 13:11:52.034763  1339 raft_consensus.cc:2804] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:52.034863 27980 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:52.035341  1339 raft_consensus.cc:697] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:52.035743  1358 raft_consensus.cc:2804] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:52.036027  1342 raft_consensus.cc:2804] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:11:52.036264  1358 raft_consensus.cc:697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:52.036556  1342 raft_consensus.cc:697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:52.036425  1339 consensus_queue.cc:237] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:52.037182  1358 consensus_queue.cc:237] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:52.037469  1342 consensus_queue.cc:237] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:52.045233 27383 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.066747 27383 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.067514 27383 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.068310 27383 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.050649 27978 leader_election.cc:336] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:52.077795 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:52.084313 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:52.085089 28010 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
W20260709 13:11:52.087343 27383 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.088953 27383 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.090040 27383 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.094787 27383 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.095424 27383 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.095960 27383 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.096495 27383 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:52.093288 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:52.100630 27383 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:52.103672 27383 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.104430  1352 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:52.105403 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:52.106199 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.106655 27383 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:52.109426 27159 catalog_manager.cc:5697] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 14, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 14 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.090991  1354 raft_consensus.cc:515] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:52.125147 28007 raft_consensus.cc:2393] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d02eb2355bc54e7f8c13a30c33793d95 in current term 14: Already voted for candidate b0e4232110db400d8f43fe2170c24c95 in this term.
W20260709 13:11:52.123042 27380 leader_election.cc:336] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.126731 27380 leader_election.cc:304] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:52.127867  1352 raft_consensus.cc:2749] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:52.129029 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.129503 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.130234  1352 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:52.131345 27380 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:52.131742 27978 leader_election.cc:336] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:52.133353 27380 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.133869 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.134683  1352 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:52.135591  1354 leader_election.cc:290] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Requested vote from peers 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:52.135687 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.136591 27380 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.136720 27409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbda0aef93534e40827c2bc13b826560" candidate_uuid: "b0e4232110db400d8f43fe2170c24c95" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "d02eb2355bc54e7f8c13a30c33793d95"
I20260709 13:11:52.137409 27409 raft_consensus.cc:3060] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:52.137450  1352 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:52.138856 27380 leader_election.cc:336] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.139348 27380 leader_election.cc:304] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:52.140120  1352 raft_consensus.cc:2749] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:52.141276 27380 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.141739 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.142496  1352 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:52.143757 27380 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.144208 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.144956  1352 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:52.145910 27380 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.146365 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.147117  1352 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:52.144958 27409 raft_consensus.cc:2468] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0e4232110db400d8f43fe2170c24c95 in term 14.
I20260709 13:11:52.149509 27980 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe
I20260709 13:11:52.150787  1354 raft_consensus.cc:2804] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:52.151522  1354 raft_consensus.cc:697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Becoming Leader. State: Replica: b0e4232110db400d8f43fe2170c24c95, State: Running, Role: LEADER
I20260709 13:11:52.152487  1354 consensus_queue.cc:237] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:52.154614 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:52.156036 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:52.156033 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.157946  1340 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:52.158851 27380 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.159300 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.159988  1340 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:52.160995 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.161412 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.162058  1340 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:52.163004 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.163434 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.164098  1340 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:52.165071 27380 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.165594 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.167013  1340 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:52.174307 27380 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.174824 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.175580  1340 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:52.176748 27380 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.177198 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.177927  1340 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:52.179111 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.179581 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.180294  1340 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:52.181463 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.193409 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:52.194255  1353 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:52.195427 27380 leader_election.cc:336] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:52.195946 27380 leader_election.cc:304] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
I20260709 13:11:52.196702  1353 raft_consensus.cc:2749] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:11:52.198489 27380 leader_election.cc:304] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, b0e4232110db400d8f43fe2170c24c95
W20260709 13:11:52.201435 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:52.199438  1353 raft_consensus.cc:2749] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:52.255641 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.271255 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.271898 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.305030 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:52.314752 27159 catalog_manager.cc:5697] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 12 to 13, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 13 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.316735 27159 catalog_manager.cc:5697] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 21 to 22, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 22 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.318394 27159 catalog_manager.cc:5697] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 reported cstate change: term changed from 13 to 14, leader changed from 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130) to b0e4232110db400d8f43fe2170c24c95 (127.25.139.132). New cstate: current_term: 14 leader_uuid: "b0e4232110db400d8f43fe2170c24c95" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:52.323449 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.395642 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:11:52.447253 27409 raft_consensus.cc:1275] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:52.448976  1354 consensus_queue.cc:1048] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:52.492362 27409 raft_consensus.cc:1275] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:11:52.494196 27978 consensus_peers.cc:597] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:52.495990  1359 consensus_queue.cc:1048] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:52.501195 26158 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 27364)
W20260709 13:11:52.546753 27978 consensus_peers.cc:597] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:52.551703 27978 consensus_peers.cc:597] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:52.581480 27409 raft_consensus.cc:1275] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:52.583353  1359 consensus_queue.cc:1048] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:11:52.608727 27978 consensus_peers.cc:597] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:52.622332 27409 raft_consensus.cc:1275] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 22 FOLLOWER]: Refusing update from remote peer b0e4232110db400d8f43fe2170c24c95: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:11:52.624073  1359 consensus_queue.cc:1048] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:11:52.629024 27978 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.643077 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.676779 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.690797 27978 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.713549 27978 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.740226 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.741195 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:52.740226 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.746973 27978 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.755468 27978 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.788370 27978 consensus_peers.cc:597] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.828032 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:52.836320 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.849932 27978 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.851486 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:52.865911 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:52.915619 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:52.945484 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:52.974335 27978 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.996136 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:53.062474 27978 consensus_peers.cc:597] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.086560 27978 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.193832 27380 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.212644 27380 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.244083 27380 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.248304 27380 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.276705 27380 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.290171 27380 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.308926 27978 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.316926 27380 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.341167 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:53.345577 27380 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.383345 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:53.390025 27380 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.411430 27380 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.412123 27380 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.428041 27380 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.444270 27978 consensus_peers.cc:597] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.486925 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:53.501835 26158 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 27364)
W20260709 13:11:53.515233 27380 consensus_peers.cc:597] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.573994 27380 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:53.669452  1360 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.670053  1360 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:53.672286  1360 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:53.680994 27380 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:53.693295 27383 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:53.694185 27383 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:53.697099  1360 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:53.713826  1346 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.714567  1346 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:53.734797  1346 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:53.737010 27978 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:53.752671 27981 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:53.755509 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:53.757531  1359 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:53.784807 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:53.813795 27380 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:53.848596  1349 raft_consensus.cc:493] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.849241  1349 raft_consensus.cc:515] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:53.853340  1349 leader_election.cc:290] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:53.873970 27383 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:53.902771  1349 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.903505  1349 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:53.903851  1360 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.904503  1360 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:53.907748  1360 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:53.911141  1349 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:53.942826 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:53.943611 28007 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
W20260709 13:11:53.945346 27383 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:53.952450 27380 leader_election.cc:336] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:53.946841 27383 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:53.963184 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:11:53.962524 27380 leader_election.cc:304] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:53.968900  1360 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:53.969515  1360 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:53.975761  1360 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:53.982805  1360 raft_consensus.cc:2749] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.001819 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:54.002087  1360 raft_consensus.cc:493] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.011935  1360 raft_consensus.cc:515] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.014467  1360 leader_election.cc:290] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.019297 27383 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.023063 27383 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:54.024622  1360 raft_consensus.cc:493] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.025219  1360 raft_consensus.cc:515] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.027523  1360 leader_election.cc:290] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.032538 27383 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:54.039119  1380 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.039793  1380 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.044822  1380 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.053668 27383 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:54.058436  1360 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.059154  1360 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:54.062410  1360 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
I20260709 13:11:54.079239 28007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:54.079924 28007 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
W20260709 13:11:54.108733 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:11:54.118031 27383 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.120810 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.123477 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.125097  1349 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:54.132172  1349 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.132819  1349 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.135830  1349 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.131567 27380 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.159610 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.163851  1349 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:54.163057 27383 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:54.177134  1349 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.177742  1349 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.180861  1360 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.181493  1360 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.183696  1360 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:54.184224  1380 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.185004  1349 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:54.187959  1380 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.190162  1380 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:54.194828  1380 raft_consensus.cc:493] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.195401  1380 raft_consensus.cc:515] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.197564  1380 leader_election.cc:290] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.218770 27383 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.219480 27383 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.219980 27383 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.220500 27383 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.211880 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.221657 27380 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.240000  1380 raft_consensus.cc:493] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.240749  1380 raft_consensus.cc:515] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.244900  1380 leader_election.cc:290] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:54.245712  1380 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:54.247536 27380 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:54.249904 27380 leader_election.cc:336] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.251108 27380 leader_election.cc:304] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.256822  1380 raft_consensus.cc:2749] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:54.259889 27380 leader_election.cc:336] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.262724 27380 leader_election.cc:304] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:54.265743 27383 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:54.266449  1380 raft_consensus.cc:2749] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.275511 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.277173 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.278173  1380 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:54.281185 27380 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:54.281796 27380 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.282326 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.283948  1380 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:54.306093  1380 raft_consensus.cc:493] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:54.306929  1380 raft_consensus.cc:515] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:54.309605  1380 leader_election.cc:290] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:54.322216 27383 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:54.350190 27380 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.350740 27380 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.354102  1360 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:54.377823 27383 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.382901 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.383462 27380 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:54.384194 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:54.384388 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.384843 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.386075  1380 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:54.386197  1381 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:11:54.385735 27380 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.386986 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:54.387898 27380 leader_election.cc:336] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.388314 27380 leader_election.cc:304] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.388407  1380 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:54.389174  1380 raft_consensus.cc:2749] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:54.389334 27380 leader_election.cc:336] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.389884 27380 leader_election.cc:304] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.391330  1381 raft_consensus.cc:2749] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.400261 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.412802 27380 leader_election.cc:336] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:54.413339 27380 leader_election.cc:304] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:54.416078  1349 raft_consensus.cc:2749] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:11:54.446521 27383 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.493721 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.502388 26158 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 27364)
W20260709 13:11:54.656299 27383 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.722991 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.765422 27383 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.829968 27383 consensus_peers.cc:597] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.858134 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:54.877930 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.006747 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:55.014555 27978 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.026880 27978 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.033434 27978 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.084739 27978 consensus_peers.cc:597] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.086436 27383 consensus_peers.cc:597] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.107766 27383 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:55.129647 27978 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.147409 27981 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:11:55.152897 27978 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.170706 27383 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.200587 27978 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.235400 27978 consensus_peers.cc:597] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.249136 27978 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.251323 27383 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:55.267994 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.302533 27978 consensus_peers.cc:597] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.327080 27383 consensus_peers.cc:597] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.367781 27978 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.378159 27978 consensus_peers.cc:597] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.395915 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:55.403401 27383 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.419315 27152 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 415aa8030d05423fbf90a8f010b516d3 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer d02eb2355bc54e7f8c13a30c33793d95 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 20 leader_uuid: "d02eb2355bc54e7f8c13a30c33793d95" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } } }
W20260709 13:11:55.425700 27383 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.430620 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.440007 27978 consensus_peers.cc:597] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.512135 27380 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.541996 27978 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111) [suppressed 621 similar messages]
W20260709 13:11:55.708256 27383 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:55.765895 27383 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:11:55.774164  1349 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:55.779928  1349 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:55.783545 27978 consensus_peers.cc:597] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.810413 27978 consensus_peers.cc:597] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.810736 27380 consensus_peers.cc:597] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.826074 27380 consensus_peers.cc:597] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:55.833657 28010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59877a2f8723407f9fd30c7505cc2e29" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:55.834810 28010 raft_consensus.cc:2468] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 18.
I20260709 13:11:55.830224  1349 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:55.837105 27383 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:55.857450 27380 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:55.857918 27380 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95, d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:55.858832  1349 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:55.862658 27380 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.867364 27380 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.935537 27978 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:55.943015 27981 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:55.956807 27380 consensus_peers.cc:597] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:55.969000  1346 raft_consensus.cc:493] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:55.970110  1346 raft_consensus.cc:515] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:55.979961 27978 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.000546  1380 raft_consensus.cc:493] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.001513  1380 raft_consensus.cc:515] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.004009  1380 leader_election.cc:290] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:56.129460  1346 leader_election.cc:290] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:56.315764 27380 consensus_peers.cc:597] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:56.323954  1380 raft_consensus.cc:493] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.324669  1380 raft_consensus.cc:515] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:56.326164 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 313208us
I20260709 13:11:56.326881  1380 leader_election.cc:290] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:56.330588 27380 consensus_peers.cc:597] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.331117 27380 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:56.332214 27380 consensus_peers.cc:597] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.335491 27380 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.336072 27380 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.336512 27380 consensus_peers.cc:597] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.336966 27380 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:56.339663 27383 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 332403us
W20260709 13:11:56.349498 27383 leader_election.cc:336] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.350045 27383 leader_election.cc:304] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.351261  1380 raft_consensus.cc:2749] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:56.354787 27383 consensus_peers.cc:597] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:11:56.355393 27383 consensus_peers.cc:597] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:56.355988 27383 leader_election.cc:336] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.356371 27383 leader_election.cc:304] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:56.357369 27383 consensus_peers.cc:597] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:56.357522  1380 raft_consensus.cc:2749] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.362010  1389 raft_consensus.cc:493] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.363343  1389 raft_consensus.cc:515] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:56.368335  1389 leader_election.cc:290] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), b0e4232110db400d8f43fe2170c24c95 (127.25.139.132:42123)
W20260709 13:11:56.362030 27380 consensus_peers.cc:597] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.372377 27380 consensus_peers.cc:597] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.375412 27380 consensus_peers.cc:597] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.374868 27383 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.391484  1389 raft_consensus.cc:493] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.392297  1389 raft_consensus.cc:515] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.396745  1389 leader_election.cc:290] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:56.421368  1389 raft_consensus.cc:493] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.422154  1389 raft_consensus.cc:515] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
W20260709 13:11:56.425704 27383 consensus_peers.cc:597] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:56.426687 27383 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.427330  1389 leader_election.cc:290] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:56.431094 27383 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:56.435456 27981 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:44339, user_credentials={real_user=slave}} blocked reactor thread for 141483us
W20260709 13:11:56.437237 27978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35457, user_credentials={real_user=slave}} blocked reactor thread for 110435us
W20260709 13:11:56.487651 27380 consensus_peers.cc:597] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.488170 27380 leader_election.cc:336] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.490624 27380 leader_election.cc:304] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
W20260709 13:11:56.493991 27380 leader_election.cc:336] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:56.489310 27981 leader_election.cc:336] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.497823 27380 leader_election.cc:304] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.496668 28011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a124c306f9418a8556266f795a58b3" candidate_uuid: "d02eb2355bc54e7f8c13a30c33793d95" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b0e4232110db400d8f43fe2170c24c95" is_pre_election: true
I20260709 13:11:56.498090 27981 leader_election.cc:304] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.499737  1391 raft_consensus.cc:2749] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:11:56.500247 28011 raft_consensus.cc:2468] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d02eb2355bc54e7f8c13a30c33793d95 in term 16.
I20260709 13:11:56.500779  1394 raft_consensus.cc:2749] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:56.501173 27380 leader_election.cc:336] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.501664 27380 leader_election.cc:304] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.495848  1389 raft_consensus.cc:2749] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:11:56.502844  1391 raft_consensus.cc:2749] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:56.503047  1389 raft_consensus.cc:493] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.503858  1389 raft_consensus.cc:515] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.506330  1389 leader_election.cc:290] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:56.507138 27981 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:11:56.512799 27383 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:56.525208 27380 leader_election.cc:336] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.525805 27380 leader_election.cc:304] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.527004  1389 raft_consensus.cc:2749] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.613262 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
I20260709 13:11:56.644896  1391 raft_consensus.cc:493] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.645865  1391 raft_consensus.cc:515] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.649461  1391 leader_election.cc:290] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
W20260709 13:11:56.657086 27383 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:56.661574 27380 leader_election.cc:336] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.663599 27380 leader_election.cc:304] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.664515  1391 raft_consensus.cc:2749] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.750803 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
W20260709 13:11:56.756038 27380 consensus_peers.cc:597] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:56.783767 27383 consensus_peers.cc:597] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:11:56.804040 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:56.805269 26158 tablet_replica.cc:333] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.806537 26158 raft_consensus.cc:2243] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.811949 26158 raft_consensus.cc:2272] T d4b61886e4de43d1a7459c0b2b639537 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.815447 26158 tablet_replica.cc:333] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.816429 26158 raft_consensus.cc:2243] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.817185 26158 raft_consensus.cc:2272] T 1f43efa5ed2d4349a1025bedcb71ff49 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.820132 26158 tablet_replica.cc:333] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.821077 26158 raft_consensus.cc:2243] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.821817 26158 raft_consensus.cc:2272] T 43ab3e6cd15341cd8cc43296cb7ce69d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.831524 26158 tablet_replica.cc:333] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.832666 26158 raft_consensus.cc:2243] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.833623 26158 raft_consensus.cc:2272] T a4df1b7ffb3d487ea7c361ac87825c5d P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.836535 26158 tablet_replica.cc:333] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.837422 26158 raft_consensus.cc:2243] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.838356 26158 raft_consensus.cc:2272] T e0b732e9fe744ccfb9006867b9ec2cd7 P d02eb2355bc54e7f8c13a30c33793d95 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:56.840595 27980 consensus_peers.cc:597] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.841349 26158 tablet_replica.cc:333] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.842257 26158 raft_consensus.cc:2243] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.843876 26158 raft_consensus.cc:2272] T 415aa8030d05423fbf90a8f010b516d3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.847417 26158 tablet_replica.cc:333] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.848345 26158 raft_consensus.cc:2243] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.849237 26158 raft_consensus.cc:2272] T 8a295e8566b04b49918a92cb09270d62 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.852509 26158 tablet_replica.cc:333] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.853602 26158 raft_consensus.cc:2243] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.854182  1349 raft_consensus.cc:493] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.854540 26158 raft_consensus.cc:2272] T fbda0aef93534e40827c2bc13b826560 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.854745  1349 raft_consensus.cc:515] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.857916 26158 tablet_replica.cc:333] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.859155 26158 raft_consensus.cc:2243] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.860054 26158 raft_consensus.cc:2272] T 170c6d7d3371409fbd512d4226e702f5 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.863212 26158 tablet_replica.cc:333] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.864173 26158 raft_consensus.cc:2243] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.865511 26158 raft_consensus.cc:2272] T a0d30dde9c4c4d778d398130da0cdaea P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.868414 26158 tablet_replica.cc:333] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.869309 26158 raft_consensus.cc:2243] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.870561 26158 raft_consensus.cc:2272] T 59877a2f8723407f9fd30c7505cc2e29 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.873579 26158 tablet_replica.cc:333] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.874352 26158 raft_consensus.cc:2243] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.875432 26158 raft_consensus.cc:2272] T f872873b55df4f2ab953481b0bbe5229 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.878245 26158 tablet_replica.cc:333] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.879045 26158 raft_consensus.cc:2243] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:11:56.880393 27383 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.885119 26158 raft_consensus.cc:2272] T e376a729bb7c47e99662f97b33ea32c7 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.890815 26158 tablet_replica.cc:333] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
W20260709 13:11:56.891002 27980 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.892009 26158 raft_consensus.cc:2243] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.887120  1349 leader_election.cc:290] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:56.892755 26158 raft_consensus.cc:2272] T 4d586a4492094f0dbea7efd8255dd991 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:56.894383 27380 leader_election.cc:336] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.894933 27380 leader_election.cc:304] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.896301  1349 raft_consensus.cc:2749] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:56.898779 26158 tablet_replica.cc:333] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.899686 26158 raft_consensus.cc:2243] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.901541 26158 raft_consensus.cc:2272] T 3412bba6f0c740dd9adb1895146dd937 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.905094 26158 tablet_replica.cc:333] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.906185 26158 raft_consensus.cc:2243] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:11:56.908608 27980 consensus_peers.cc:597] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:56.909391 27980 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.913831 26158 raft_consensus.cc:2272] T 4b44d9e3827f45eabce8235344e58d0f P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.917948 26158 tablet_replica.cc:333] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.921322 26158 raft_consensus.cc:2243] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:56.918861 27383 consensus_peers.cc:597] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:56.923046 26158 raft_consensus.cc:2272] T a30a45f010dd49e5a9ddb107297fa03e P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.928499 26158 tablet_replica.cc:333] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.929422 26158 raft_consensus.cc:2243] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.930879 26158 raft_consensus.cc:2272] T 54f78b1bcfcd4b219e6af2bf690b4f4b P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.935984 26158 tablet_replica.cc:333] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.936697  1349 raft_consensus.cc:493] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:56.937377  1349 raft_consensus.cc:515] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } }
I20260709 13:11:56.939754  1349 leader_election.cc:290] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457)
I20260709 13:11:56.940877 26158 raft_consensus.cc:2243] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.942266 26158 raft_consensus.cc:2272] T 41a124c306f9418a8556266f795a58b3 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:56.945148 27380 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:56.945775 26158 tablet_replica.cc:333] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.946753 26158 raft_consensus.cc:2243] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.948776 26158 raft_consensus.cc:2272] T d0aa2cbbfc6b45fe8d8f862c301f1909 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.953533 26158 tablet_replica.cc:333] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.954582 26158 raft_consensus.cc:2243] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.956238 26158 raft_consensus.cc:2272] T c4f1db10d9664160ae88f26e3becd4b7 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.959298 26158 tablet_replica.cc:333] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.960275 26158 raft_consensus.cc:2243] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.961161 26158 raft_consensus.cc:2272] T 0f07af3920db4e9da19de0ec4eba7c75 P d02eb2355bc54e7f8c13a30c33793d95 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:56.963671 27383 leader_election.cc:336] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:56.964224 26158 tablet_replica.cc:333] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.964145 27383 leader_election.cc:304] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d02eb2355bc54e7f8c13a30c33793d95; no voters: 161ec4aacbd54a4989d6762a9ed4eafe, 203d83f7fac847e0beee51aa18513b25
I20260709 13:11:56.965253 26158 raft_consensus.cc:2243] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.965286  1349 raft_consensus.cc:2749] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:11:56.966488 27981 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:11:56.967307 26158 raft_consensus.cc:2272] T e004b67b35dd4a9b8ccf73182f7bdf58 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.970158 26158 tablet_replica.cc:333] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.970968 26158 raft_consensus.cc:2243] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.972261 26158 raft_consensus.cc:2272] T efee0a6a9d2c4ed096004a49852dbc86 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.975433 26158 tablet_replica.cc:333] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.976271 26158 raft_consensus.cc:2243] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.977550 26158 raft_consensus.cc:2272] T 099c52bc6b98406cadce31d6411cb635 P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.980639 26158 tablet_replica.cc:333] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.981559 26158 raft_consensus.cc:2243] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:11:56.982710 27980 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.983182 26158 raft_consensus.cc:2272] T 13cceb5d4cfd4e358a438f514c9e75f0 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.986269 26158 tablet_replica.cc:333] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.987196 26158 raft_consensus.cc:2243] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:56.988494 26158 raft_consensus.cc:2272] T 83dcb012538c4a0eb307834fbfd9752a P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:56.990180 27980 consensus_peers.cc:597] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:56.991302 26158 tablet_replica.cc:333] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.992228 26158 raft_consensus.cc:2243] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.993304 26158 raft_consensus.cc:2272] T 56b15c3e61ae45a6b84a4d2a3838c018 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:56.996441 26158 tablet_replica.cc:333] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:56.997254 26158 raft_consensus.cc:2243] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:56.998801 26158 raft_consensus.cc:2272] T 05efe4ee1469496f84eca86709a6b478 P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.001700 27980 consensus_peers.cc:597] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.002782 26158 tablet_replica.cc:333] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.003782 26158 raft_consensus.cc:2243] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.004451 26158 raft_consensus.cc:2272] T 76061244738f450fb409cb866212c235 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.007704 26158 tablet_replica.cc:333] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.008514 26158 raft_consensus.cc:2243] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.010038 26158 raft_consensus.cc:2272] T cdb46c37e35142cf8e2148ef2d2da5e7 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.013267 26158 tablet_replica.cc:333] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.014129 26158 raft_consensus.cc:2243] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.015997 26158 raft_consensus.cc:2272] T ca25783a146d4038878d9ffd69f34217 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.019089 26158 tablet_replica.cc:333] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.019904 26158 raft_consensus.cc:2243] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.020635 26158 raft_consensus.cc:2272] T 3defd7d5f6684c09bb491b62d9c1cba1 P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.023559 26158 tablet_replica.cc:333] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.024345 26158 raft_consensus.cc:2243] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.025235 26158 raft_consensus.cc:2272] T 008af8ad84434532baca82a0654da9bf P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.027237 27980 consensus_peers.cc:597] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.028198 26158 tablet_replica.cc:333] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.029084 26158 raft_consensus.cc:2243] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.030331 26158 raft_consensus.cc:2272] T 60414d130cdc460696513fb91e20161f P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.030462 27980 consensus_peers.cc:597] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.033546 26158 tablet_replica.cc:333] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.034389 26158 raft_consensus.cc:2243] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.035375 26158 raft_consensus.cc:2272] T 0a44de1887e445a5b020fd0cbae6a5a3 P d02eb2355bc54e7f8c13a30c33793d95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.038235 26158 tablet_replica.cc:333] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.039067 26158 raft_consensus.cc:2243] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.039717 26158 raft_consensus.cc:2272] T 4841dcf8d05d4ecaa8771d888fc649c0 P d02eb2355bc54e7f8c13a30c33793d95 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.042433 26158 tablet_replica.cc:333] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.043246 26158 raft_consensus.cc:2243] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.043982 26158 raft_consensus.cc:2272] T 4d09be3e7a494235854c88600f2adfad P d02eb2355bc54e7f8c13a30c33793d95 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.047001 26158 tablet_replica.cc:333] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.047852 26158 raft_consensus.cc:2243] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.049196 26158 raft_consensus.cc:2272] T c065641be1624ea49a986708690a8b46 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.052116 26158 tablet_replica.cc:333] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.052892 26158 raft_consensus.cc:2243] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.053589 26158 raft_consensus.cc:2272] T 1a2fa29e3bcf4670ab310ce67ee127c4 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.056617 26158 tablet_replica.cc:333] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.057387 26158 raft_consensus.cc:2243] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.058710 26158 raft_consensus.cc:2272] T a055e36ded584640806637e94e87f6b9 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.061533 26158 tablet_replica.cc:333] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
W20260709 13:11:57.061533 27980 consensus_peers.cc:597] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.062431 26158 raft_consensus.cc:2243] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.063119 26158 raft_consensus.cc:2272] T 0f3e88c6f82141d8a7a8cb507f425200 P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.066133 26158 tablet_replica.cc:333] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.066879 26158 raft_consensus.cc:2243] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.067552 26158 raft_consensus.cc:2272] T b390ed75f2f14d258d4cdff9c656d787 P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.069882 27980 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.070276 26158 tablet_replica.cc:333] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.071197 26158 raft_consensus.cc:2243] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.071838 26158 raft_consensus.cc:2272] T 804fae3c2b684e6a8a7c159e417231fa P d02eb2355bc54e7f8c13a30c33793d95 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.072736 27980 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.074817 27980 consensus_peers.cc:597] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.074998 26158 tablet_replica.cc:333] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.075872 26158 raft_consensus.cc:2243] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.076705 26158 raft_consensus.cc:2272] T 2ea7b8babc1b46fbad021d233647b834 P d02eb2355bc54e7f8c13a30c33793d95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.079638 26158 tablet_replica.cc:333] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.080416 26158 raft_consensus.cc:2243] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.081550 26158 raft_consensus.cc:2272] T 427b3f6c9e74407ebaecb4a51f7b4fcf P d02eb2355bc54e7f8c13a30c33793d95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.084677 26158 tablet_replica.cc:333] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.085443 26158 raft_consensus.cc:2243] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.086154 26158 raft_consensus.cc:2272] T 5b64b3a0d3c44ff1893b67152ebe2c50 P d02eb2355bc54e7f8c13a30c33793d95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.089053 26158 tablet_replica.cc:333] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.089794 26158 raft_consensus.cc:2243] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.091032 26158 raft_consensus.cc:2272] T d07722edbe05448eaa1edebf1ce562cd P d02eb2355bc54e7f8c13a30c33793d95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.094256 26158 tablet_replica.cc:333] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
W20260709 13:11:57.094596 27980 consensus_peers.cc:597] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 -> Peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Couldn't send request to peer d02eb2355bc54e7f8c13a30c33793d95. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.095059 26158 raft_consensus.cc:2243] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.096081 26158 raft_consensus.cc:2272] T e9cc5476f0fd4bceaab7f594e240f37c P d02eb2355bc54e7f8c13a30c33793d95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.099262 26158 tablet_replica.cc:333] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.099948 26158 raft_consensus.cc:2243] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.101266 26158 raft_consensus.cc:2272] T 17909c3b30eb43b79bd7ea94e48dcef1 P d02eb2355bc54e7f8c13a30c33793d95 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.103493 27981 consensus_peers.cc:597] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:11:57.104269 26158 tablet_replica.cc:333] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95: stopping tablet replica
I20260709 13:11:57.105067 26158 raft_consensus.cc:2243] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.106242 26158 raft_consensus.cc:2272] T 3c247f301fde4963b4d1761a0b3254a9 P d02eb2355bc54e7f8c13a30c33793d95 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.379911 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe160 after lost signal to thread 26161
W20260709 13:11:57.381102 28036 debug-util.cc:398] Leaking SignalData structure 0x7b08000ab760 after lost signal to thread 27200
W20260709 13:11:57.382179 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800375340 after lost signal to thread 27441
W20260709 13:11:57.383109 28036 debug-util.cc:398] Leaking SignalData structure 0x7b0800364880 after lost signal to thread 28039
W20260709 13:11:57.405755 27981 consensus_peers.cc:597] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:57.487259 27981 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:57.515017 27981 consensus_peers.cc:597] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:57.533291 27978 consensus_peers.cc:597] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.649947 27978 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:57.664168  1383 raft_consensus.cc:493] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 161ec4aacbd54a4989d6762a9ed4eafe)
I20260709 13:11:57.664853  1383 raft_consensus.cc:515] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
W20260709 13:11:57.673592 27981 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
W20260709 13:11:57.682825 27980 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111)
I20260709 13:11:57.683373 27980 leader_election.cc:304] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:57.684158  1394 raft_consensus.cc:2749] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:11:57.691393 27981 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:57.693643  1383 leader_election.cc:290] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:57.698318 27978 leader_election.cc:336] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:57.727306 27978 consensus_peers.cc:597] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:57.777550 27978 consensus_peers.cc:597] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.838922 27978 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.859319 27981 consensus_peers.cc:597] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:11:57.886706 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
W20260709 13:11:57.912519 27978 consensus_peers.cc:597] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.924326 27981 consensus_peers.cc:597] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:57.957639 27978 consensus_peers.cc:597] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:57.967183 27981 consensus_peers.cc:597] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 -> Peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Couldn't send request to peer 203d83f7fac847e0beee51aa18513b25. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:11:57.989584 27978 consensus_peers.cc:597] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:57.994652  1383 raft_consensus.cc:493] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:57.995429  1383 raft_consensus.cc:515] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:57.998325  1394 raft_consensus.cc:493] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:57.999336  1394 raft_consensus.cc:515] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } attrs { replace: true } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:58.003408  1394 leader_election.cc:290] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:58.010391 27980 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111)
I20260709 13:11:58.021456  1383 leader_election.cc:290] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
W20260709 13:11:58.024421 27980 leader_election.cc:336] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111)
W20260709 13:11:58.030293 27981 leader_election.cc:336] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:58.033257 27981 leader_election.cc:304] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
W20260709 13:11:58.038198 27981 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:58.035030  1394 raft_consensus.cc:493] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader d02eb2355bc54e7f8c13a30c33793d95)
I20260709 13:11:58.039947  1394 raft_consensus.cc:515] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "203d83f7fac847e0beee51aa18513b25" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44339 } } peers { permanent_uuid: "161ec4aacbd54a4989d6762a9ed4eafe" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35457 } attrs { replace: true } } peers { permanent_uuid: "d02eb2355bc54e7f8c13a30c33793d95" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34895 } } peers { permanent_uuid: "b0e4232110db400d8f43fe2170c24c95" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42123 } attrs { promote: false } }
I20260709 13:11:58.038722  1383 raft_consensus.cc:2749] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.033740 26158 tablet_server.cc:179] TabletServer@127.25.139.132:0 shutting down...
I20260709 13:11:58.042375 27981 leader_election.cc:304] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:58.044170  1394 leader_election.cc:290] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339), 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457), d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895)
I20260709 13:11:58.044196  1383 raft_consensus.cc:2749] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:11:58.045455 27978 leader_election.cc:336] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:58.054442 27978 consensus_peers.cc:597] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:58.054589 27980 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111)
W20260709 13:11:58.054976 27978 leader_election.cc:336] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
W20260709 13:11:58.055868 27978 consensus_peers.cc:597] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 -> Peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Couldn't send request to peer 161ec4aacbd54a4989d6762a9ed4eafe. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:58.062933 27981 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 203d83f7fac847e0beee51aa18513b25 (127.25.139.129:44339): Network error: Client connection negotiation failed: client connection to 127.25.139.129:44339: connect: Connection refused (error 111)
I20260709 13:11:58.063419 27981 leader_election.cc:304] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b0e4232110db400d8f43fe2170c24c95; no voters: 203d83f7fac847e0beee51aa18513b25, d02eb2355bc54e7f8c13a30c33793d95
I20260709 13:11:58.067555  1383 raft_consensus.cc:2749] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:11:58.069617 27978 leader_election.cc:336] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 161ec4aacbd54a4989d6762a9ed4eafe (127.25.139.130:35457): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35457: connect: Connection refused (error 111)
I20260709 13:11:58.104429 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:58.105604 26158 tablet_replica.cc:333] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.106505 26158 raft_consensus.cc:2243] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.107381 26158 raft_consensus.cc:2272] T d0aa2cbbfc6b45fe8d8f862c301f1909 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.110399 26158 tablet_replica.cc:333] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.111038 26158 raft_consensus.cc:2243] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.111800 26158 raft_consensus.cc:2272] T 415aa8030d05423fbf90a8f010b516d3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.114521 26158 tablet_replica.cc:333] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.115399 26158 raft_consensus.cc:2243] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.116241 26158 raft_consensus.cc:2272] T a30a45f010dd49e5a9ddb107297fa03e P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.118620 26158 tablet_replica.cc:333] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.119235 26158 raft_consensus.cc:2243] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.120229 26158 raft_consensus.cc:2272] T 4b44d9e3827f45eabce8235344e58d0f P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.123063 26158 tablet_replica.cc:333] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.123901 26158 raft_consensus.cc:2243] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.124677 26158 raft_consensus.cc:2272] T 59877a2f8723407f9fd30c7505cc2e29 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.127745 26158 tablet_replica.cc:333] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.128540 26158 raft_consensus.cc:2243] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.129739 26158 raft_consensus.cc:2272] T c760b3987ef34e0189563d3ccb585eed P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.132771 26158 tablet_replica.cc:333] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.133431 26158 raft_consensus.cc:2243] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.134358 26158 raft_consensus.cc:2272] T e0b732e9fe744ccfb9006867b9ec2cd7 P b0e4232110db400d8f43fe2170c24c95 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.136453 26158 tablet_replica.cc:333] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.137219 26158 raft_consensus.cc:2243] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.137845 26158 raft_consensus.cc:2272] T 3c247f301fde4963b4d1761a0b3254a9 P b0e4232110db400d8f43fe2170c24c95 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.141089 26158 tablet_replica.cc:333] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.141916 26158 raft_consensus.cc:2243] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.143064 26158 raft_consensus.cc:2272] T e622bd20107a4c4190d71a5b581aa506 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.145776 26158 tablet_replica.cc:333] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.146685 26158 raft_consensus.cc:2243] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.147662 26158 raft_consensus.cc:2272] T 1f43efa5ed2d4349a1025bedcb71ff49 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.150662 26158 tablet_replica.cc:333] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.151324 26158 raft_consensus.cc:2243] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.151883 26158 raft_consensus.cc:2272] T 83dcb012538c4a0eb307834fbfd9752a P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.154156 26158 tablet_replica.cc:333] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.154956 26158 raft_consensus.cc:2243] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.155632 26158 raft_consensus.cc:2272] T 099c52bc6b98406cadce31d6411cb635 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.158496 26158 tablet_replica.cc:333] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.159293 26158 raft_consensus.cc:2243] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.160264 26158 raft_consensus.cc:2272] T fbda0aef93534e40827c2bc13b826560 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.162680 26158 tablet_replica.cc:333] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.163451 26158 raft_consensus.cc:2243] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.164492 26158 raft_consensus.cc:2272] T 0a44de1887e445a5b020fd0cbae6a5a3 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.167212 26158 tablet_replica.cc:333] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.167954 26158 raft_consensus.cc:2243] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.168823 26158 raft_consensus.cc:2272] T 4841dcf8d05d4ecaa8771d888fc649c0 P b0e4232110db400d8f43fe2170c24c95 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.170867 26158 tablet_replica.cc:333] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.171461 26158 raft_consensus.cc:2243] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.172380 26158 raft_consensus.cc:2272] T b390ed75f2f14d258d4cdff9c656d787 P b0e4232110db400d8f43fe2170c24c95 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.174330 26158 tablet_replica.cc:333] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.174916 26158 raft_consensus.cc:2243] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.175603 26158 raft_consensus.cc:2272] T d4b61886e4de43d1a7459c0b2b639537 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.177920 26158 tablet_replica.cc:333] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.178460 26158 raft_consensus.cc:2243] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.179399 26158 raft_consensus.cc:2272] T bf4fb4f20e74427f86180930e86a7afc P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.181484 26158 tablet_replica.cc:333] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.182061 26158 raft_consensus.cc:2243] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.182937 26158 raft_consensus.cc:2272] T 0f07af3920db4e9da19de0ec4eba7c75 P b0e4232110db400d8f43fe2170c24c95 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.185439 26158 tablet_replica.cc:333] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.185961 26158 raft_consensus.cc:2243] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.186838 26158 raft_consensus.cc:2272] T d1a9f1b01ac8406691c2d1c83b5dcca0 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.188966 26158 tablet_replica.cc:333] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.189496 26158 raft_consensus.cc:2243] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.190376 26158 raft_consensus.cc:2272] T 2ea7b8babc1b46fbad021d233647b834 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.192613 26158 tablet_replica.cc:333] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.193231 26158 raft_consensus.cc:2243] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.193883 26158 raft_consensus.cc:2272] T 41a124c306f9418a8556266f795a58b3 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.196244 26158 tablet_replica.cc:333] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.196907 26158 raft_consensus.cc:2243] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.197742 26158 raft_consensus.cc:2272] T 1a2fa29e3bcf4670ab310ce67ee127c4 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.199819 26158 tablet_replica.cc:333] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.200384 26158 raft_consensus.cc:2243] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.201287 26158 raft_consensus.cc:2272] T 05efe4ee1469496f84eca86709a6b478 P b0e4232110db400d8f43fe2170c24c95 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.203150 26158 tablet_replica.cc:333] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.203708 26158 raft_consensus.cc:2243] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.204188 26158 raft_consensus.cc:2272] T 21d14940356a45ada8e16731853b8769 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.206151 26158 tablet_replica.cc:333] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.206696 26158 raft_consensus.cc:2243] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.207649 26158 raft_consensus.cc:2272] T cfbd4344db4a4ffb8868b58ddc53af83 P b0e4232110db400d8f43fe2170c24c95 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.209698 26158 tablet_replica.cc:333] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.210179 26158 raft_consensus.cc:2243] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.211033 26158 raft_consensus.cc:2272] T 189d9bcac7d24abe800257c915b738c7 P b0e4232110db400d8f43fe2170c24c95 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.212917 26158 tablet_replica.cc:333] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.213451 26158 raft_consensus.cc:2243] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.214605 26158 raft_consensus.cc:2272] T ca25783a146d4038878d9ffd69f34217 P b0e4232110db400d8f43fe2170c24c95 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.218858 26158 tablet_replica.cc:333] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.219448 26158 raft_consensus.cc:2243] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.219937 26158 raft_consensus.cc:2272] T d07722edbe05448eaa1edebf1ce562cd P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.221822 26158 tablet_replica.cc:333] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.222322 26158 raft_consensus.cc:2243] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.223255 26158 raft_consensus.cc:2272] T 0287d5309a46494ca6fc1acd716c9c17 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.225312 26158 tablet_replica.cc:333] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.225848 26158 raft_consensus.cc:2243] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.226490 26158 raft_consensus.cc:2272] T c065641be1624ea49a986708690a8b46 P b0e4232110db400d8f43fe2170c24c95 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.228909 26158 tablet_replica.cc:333] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.229362 26158 raft_consensus.cc:2243] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.230192 26158 raft_consensus.cc:2272] T 5b64b3a0d3c44ff1893b67152ebe2c50 P b0e4232110db400d8f43fe2170c24c95 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.232197 26158 tablet_replica.cc:333] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95: stopping tablet replica
I20260709 13:11:58.232679 26158 raft_consensus.cc:2243] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.233582 26158 raft_consensus.cc:2272] T f872873b55df4f2ab953481b0bbe5229 P b0e4232110db400d8f43fe2170c24c95 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:59.201282 26158 tablet_server.cc:196] TabletServer@127.25.139.132:0 shutdown complete.
I20260709 13:11:59.267824 26158 master.cc:562] Master@127.25.139.190:43657 shutting down...
W20260709 13:11:59.306147 27214 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:11:59.306505 27214 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:11:59.306766 27214 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:28.217897 27152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111) [suppressed 306 similar messages]
W20260709 13:12:28.221778 27152 catalog_manager.cc:4755] TS d02eb2355bc54e7f8c13a30c33793d95 (127.25.139.131:34895): ChangeConfig:REMOVE_PEER RPC failed for tablet 415aa8030d05423fbf90a8f010b516d3: Network error: Client connection negotiation failed: client connection to 127.25.139.131:34895: connect: Connection refused (error 111)
I20260709 13:12:32.486151 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.487406 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.487861 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1dbd25262fd84bb38e8451d89b086534: stopping tablet replica
I20260709 13:12:32.685688 26158 master.cc:584] Master@127.25.139.190:43657 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (253412 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:32.810282 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:41051
I20260709 13:12:32.812688 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:32.820071  1404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:32.820163  1403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:32.820879  1406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:32.822876 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:32.826839 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:32.827059 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:32.827605 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602752827585 us; error 0 us; skew 500 ppm
I20260709 13:12:32.828173 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:32.830853 26158 webserver.cc:533] Webserver started at http://127.25.139.190:38491/ using document root <none> and password file <none>
I20260709 13:12:32.831429 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:32.831606 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:32.831852 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:32.833180 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "fd5616a2f655436cb398d7d61eefc3de"
format_stamp: "Formatted at 2026-07-09 13:12:32 on dist-test-slave-v5z2"
I20260709 13:12:32.838114 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:32.841653  1411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:32.842499 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:32.842854 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "fd5616a2f655436cb398d7d61eefc3de"
format_stamp: "Formatted at 2026-07-09 13:12:32 on dist-test-slave-v5z2"
I20260709 13:12:32.843160 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:32.856655 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:32.857930 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:32.897923 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:41051
I20260709 13:12:32.898072  1462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:41051 every 8 connection(s)
I20260709 13:12:32.902046  1463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:32.914382  1463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de: Bootstrap starting.
I20260709 13:12:32.919845  1463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:32.924651  1463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de: No bootstrap required, opened a new log
I20260709 13:12:32.927120  1463 raft_consensus.cc:359] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER }
I20260709 13:12:32.927703  1463 raft_consensus.cc:385] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:32.927912  1463 raft_consensus.cc:740] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd5616a2f655436cb398d7d61eefc3de, State: Initialized, Role: FOLLOWER
I20260709 13:12:32.928547  1463 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER }
I20260709 13:12:32.929015  1463 raft_consensus.cc:399] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:32.929232  1463 raft_consensus.cc:493] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:32.929466  1463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:32.934303  1463 raft_consensus.cc:515] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER }
I20260709 13:12:32.934851  1463 leader_election.cc:304] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd5616a2f655436cb398d7d61eefc3de; no voters: 
I20260709 13:12:32.936131  1463 leader_election.cc:290] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:32.936502  1466 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:32.938097  1466 raft_consensus.cc:697] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 1 LEADER]: Becoming Leader. State: Replica: fd5616a2f655436cb398d7d61eefc3de, State: Running, Role: LEADER
I20260709 13:12:32.938947  1466 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER }
I20260709 13:12:32.939586  1463 sys_catalog.cc:565] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:32.947964  1467 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd5616a2f655436cb398d7d61eefc3de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER } }
I20260709 13:12:32.947789  1468 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd5616a2f655436cb398d7d61eefc3de. Latest consensus state: current_term: 1 leader_uuid: "fd5616a2f655436cb398d7d61eefc3de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5616a2f655436cb398d7d61eefc3de" member_type: VOTER } }
I20260709 13:12:32.948725  1467 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:32.948967  1468 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:32.950798  1476 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:32.959550  1476 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:32.960667 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:32.969513  1476 catalog_manager.cc:1383] Generated new cluster ID: 841db73b3ee240c2866556e1e42e03d9
I20260709 13:12:32.969817  1476 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:33.005108  1476 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:33.006549  1476 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:33.019029  1476 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de: Generated new TSK 0
I20260709 13:12:33.019690  1476 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:33.027113 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:33.033447  1484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.034957  1485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.035774  1487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:33.036855 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:33.039054 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:33.039309 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:33.039436 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602753039425 us; error 0 us; skew 500 ppm
I20260709 13:12:33.039986 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:33.042272 26158 webserver.cc:533] Webserver started at http://127.25.139.129:36365/ using document root <none> and password file <none>
I20260709 13:12:33.042693 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:33.042855 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:33.043057 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:33.044216 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.048781 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:12:33.052045  1492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.052875 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:33.053269 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.053519 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:33.082763 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:33.083981 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:33.085489 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:33.087791 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:33.088006 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.088250 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:33.088436 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.131844 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:38043
I20260709 13:12:33.131958  1554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:38043 every 8 connection(s)
I20260709 13:12:33.137612 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:33.145901  1559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.146991  1560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.149664  1562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:33.149879 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:33.152848 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:33.153153 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:33.153357 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602753153340 us; error 0 us; skew 500 ppm
I20260709 13:12:33.154054 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:33.155124  1555 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41051
I20260709 13:12:33.155563  1555 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:33.156358  1555 heartbeater.cc:507] Master 127.25.139.190:41051 requested a full tablet report, sending...
I20260709 13:12:33.156894 26158 webserver.cc:533] Webserver started at http://127.25.139.130:43619/ using document root <none> and password file <none>
I20260709 13:12:33.157424 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:33.157619 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:33.157929 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:33.158713  1428 ts_manager.cc:194] Registered new tserver with Master: f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:33.159713 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.161325  1428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35054
I20260709 13:12:33.165032 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:12:33.168603  1567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.169386 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:33.169700 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.169998 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:33.183027 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:33.184337 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:33.185765 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:33.188102 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:33.188325 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.188555 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:33.188719 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.230381 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:35065
I20260709 13:12:33.230475  1629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:35065 every 8 connection(s)
I20260709 13:12:33.235328 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:33.244135  1633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.244601  1634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:33.248260  1630 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41051
W20260709 13:12:33.248292  1636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:33.248915  1630 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:33.248965 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:33.250065  1630 heartbeater.cc:507] Master 127.25.139.190:41051 requested a full tablet report, sending...
I20260709 13:12:33.250234 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:33.250617 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:33.250834 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602753250813 us; error 0 us; skew 500 ppm
I20260709 13:12:33.251559 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:33.252250  1428 ts_manager.cc:194] Registered new tserver with Master: 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:33.253785  1428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35068
I20260709 13:12:33.254309 26158 webserver.cc:533] Webserver started at http://127.25.139.131:45435/ using document root <none> and password file <none>
I20260709 13:12:33.254899 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:33.255230 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:33.255640 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:33.257097 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.261968 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:12:33.265568  1641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.266283 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:33.266579 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.266865 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:33.288569 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:33.289841 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:33.291396 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:33.293684 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:33.293860 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.294144 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:33.294337 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.336103 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:45361
I20260709 13:12:33.336225  1703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:45361 every 8 connection(s)
I20260709 13:12:33.341529 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:33.349401  1707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.350548  1708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:33.353801  1710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:33.354302 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:33.354521  1704 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41051
I20260709 13:12:33.354977  1704 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:33.355439 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:33.355731 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:33.355931 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602753355915 us; error 0 us; skew 500 ppm
I20260709 13:12:33.355985  1704 heartbeater.cc:507] Master 127.25.139.190:41051 requested a full tablet report, sending...
I20260709 13:12:33.356567 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:33.358361  1428 ts_manager.cc:194] Registered new tserver with Master: 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:33.359508 26158 webserver.cc:533] Webserver started at http://127.25.139.132:41999/ using document root <none> and password file <none>
I20260709 13:12:33.360204 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:33.360322  1428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35084
I20260709 13:12:33.360463 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:33.360939 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:33.362263 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-3-root/instance:
uuid: "81b721300bd34373862d7937c3bf394a"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.366848 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.005s
I20260709 13:12:33.370211  1715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.370983 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:33.371322 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
uuid: "81b721300bd34373862d7937c3bf394a"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:33.371608 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:33.380514 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:33.381752 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:33.383248 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:33.385416 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:33.385651 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.385983 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:33.386191 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:33.428885 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.132:42975
I20260709 13:12:33.428988  1777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.132:42975 every 8 connection(s)
I20260709 13:12:33.442754  1778 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41051
I20260709 13:12:33.443234  1778 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:33.444108  1778 heartbeater.cc:507] Master 127.25.139.190:41051 requested a full tablet report, sending...
I20260709 13:12:33.446092  1428 ts_manager.cc:194] Registered new tserver with Master: 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:33.446879 26158 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014656568s
I20260709 13:12:33.447681  1428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35086
I20260709 13:12:33.474570  1428 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35092:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:33.710151  1669 tablet_service.cc:1511] Processing CreateTablet for tablet ea444d3b35d44516a3598e78aa5a6771 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:33.711772  1669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea444d3b35d44516a3598e78aa5a6771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.711629  1595 tablet_service.cc:1511] Processing CreateTablet for tablet ea444d3b35d44516a3598e78aa5a6771 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:33.711979  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 71e6f598fa6943a3b2a180ba51e31e1c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:33.713194  1595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea444d3b35d44516a3598e78aa5a6771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.713860  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e6f598fa6943a3b2a180ba51e31e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.721339  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 56487f97c81348d18d1336ca6b5a08e2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:33.722873  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56487f97c81348d18d1336ca6b5a08e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.726011  1520 tablet_service.cc:1511] Processing CreateTablet for tablet ea444d3b35d44516a3598e78aa5a6771 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:33.726477  1593 tablet_service.cc:1511] Processing CreateTablet for tablet 52c0b8276e87458183fa270edf8307f3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:33.727599  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea444d3b35d44516a3598e78aa5a6771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.727970  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c0b8276e87458183fa270edf8307f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.732537  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 71e6f598fa6943a3b2a180ba51e31e1c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:33.734088  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e6f598fa6943a3b2a180ba51e31e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.736315  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 56487f97c81348d18d1336ca6b5a08e2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:33.737684  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56487f97c81348d18d1336ca6b5a08e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.739609  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 52c0b8276e87458183fa270edf8307f3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:33.741528  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c0b8276e87458183fa270edf8307f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.747265  1517 tablet_service.cc:1511] Processing CreateTablet for tablet ec881282fcaa453cb97c580feb5000c9 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:33.748888  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec881282fcaa453cb97c580feb5000c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.761008  1592 tablet_service.cc:1511] Processing CreateTablet for tablet ec881282fcaa453cb97c580feb5000c9 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:33.765879  1666 tablet_service.cc:1511] Processing CreateTablet for tablet ec881282fcaa453cb97c580feb5000c9 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:33.767544  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4bdf431b24970b2da0f2c5bf1fdec (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:33.769515  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4bdf431b24970b2da0f2c5bf1fdec (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:33.769989  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 35b348df9bbb4e10aedb07823b2f015d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:33.772782  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 35b348df9bbb4e10aedb07823b2f015d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:33.773072  1664 tablet_service.cc:1511] Processing CreateTablet for tablet c98bf1eac1604413a4fb7dc095aa0e4d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:33.775210  1590 tablet_service.cc:1511] Processing CreateTablet for tablet c98bf1eac1604413a4fb7dc095aa0e4d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:33.785697  1514 tablet_service.cc:1511] Processing CreateTablet for tablet b158c68a91e44e46bc65d09542c6ef0d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:33.778615  1589 tablet_service.cc:1511] Processing CreateTablet for tablet b158c68a91e44e46bc65d09542c6ef0d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:33.778669  1663 tablet_service.cc:1511] Processing CreateTablet for tablet b158c68a91e44e46bc65d09542c6ef0d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:33.793526  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b158c68a91e44e46bc65d09542c6ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.794459  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec881282fcaa453cb97c580feb5000c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.813079  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4bdf431b24970b2da0f2c5bf1fdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.801999  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98bf1eac1604413a4fb7dc095aa0e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.857095  1513 tablet_service.cc:1511] Processing CreateTablet for tablet a43dc0ea5206435ebf2346061be97395 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:33.858662  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43dc0ea5206435ebf2346061be97395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.884229  1588 tablet_service.cc:1511] Processing CreateTablet for tablet a43dc0ea5206435ebf2346061be97395 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:33.885756  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43dc0ea5206435ebf2346061be97395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.891630  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4bdf431b24970b2da0f2c5bf1fdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.895601  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b158c68a91e44e46bc65d09542c6ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.895823  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b158c68a91e44e46bc65d09542c6ef0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.905732  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b348df9bbb4e10aedb07823b2f015d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.910857  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec881282fcaa453cb97c580feb5000c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.912079  1794 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:33.915340  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98bf1eac1604413a4fb7dc095aa0e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.916468  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3c6f8fd494b03a01e4794bf69e59f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:33.916534  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3c6f8fd494b03a01e4794bf69e59f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:33.918490  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3c6f8fd494b03a01e4794bf69e59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.919503  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b348df9bbb4e10aedb07823b2f015d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.918478  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3c6f8fd494b03a01e4794bf69e59f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:33.951735  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:33.952412  1796 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:33.962707  1743 tablet_service.cc:1511] Processing CreateTablet for tablet 71e6f598fa6943a3b2a180ba51e31e1c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:33.964196  1743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e6f598fa6943a3b2a180ba51e31e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.970914  1742 tablet_service.cc:1511] Processing CreateTablet for tablet 56487f97c81348d18d1336ca6b5a08e2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:33.972007  1738 tablet_service.cc:1511] Processing CreateTablet for tablet c98bf1eac1604413a4fb7dc095aa0e4d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:33.972601  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56487f97c81348d18d1336ca6b5a08e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.973369  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98bf1eac1604413a4fb7dc095aa0e4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.970912  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 35b348df9bbb4e10aedb07823b2f015d (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:33.974924  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35b348df9bbb4e10aedb07823b2f015d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.976293  1741 tablet_service.cc:1511] Processing CreateTablet for tablet 52c0b8276e87458183fa270edf8307f3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:33.977701  1741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52c0b8276e87458183fa270edf8307f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.980850  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec3c6f8fd494b03a01e4794bf69e59f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:33.982344  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec3c6f8fd494b03a01e4794bf69e59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.984189  1737 tablet_service.cc:1511] Processing CreateTablet for tablet a43dc0ea5206435ebf2346061be97395 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:33.984280  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 43d4bdf431b24970b2da0f2c5bf1fdec (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:33.987242  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43d4bdf431b24970b2da0f2c5bf1fdec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.991605  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43dc0ea5206435ebf2346061be97395. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.998617  1796 tablet_bootstrap.cc:654] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.032009  1795 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:34.039979  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 6016a96ce80848be9feac61f7c5bdcee (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:34.041460  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016a96ce80848be9feac61f7c5bdcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.027021  1794 tablet_bootstrap.cc:654] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.080775  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 6195852602da44ef9cbb867e62b07bac (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:34.082984  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6195852602da44ef9cbb867e62b07bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.086951  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 6016a96ce80848be9feac61f7c5bdcee (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:34.088639  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016a96ce80848be9feac61f7c5bdcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.082888  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 6195852602da44ef9cbb867e62b07bac (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:34.092331  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6195852602da44ef9cbb867e62b07bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.095711  1795 tablet_bootstrap.cc:654] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.096455  1797 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:34.083425  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 6016a96ce80848be9feac61f7c5bdcee (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:34.100939  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6016a96ce80848be9feac61f7c5bdcee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.109406  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 6195852602da44ef9cbb867e62b07bac (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:34.110955  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6195852602da44ef9cbb867e62b07bac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.111138  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 70b45057315e4ff09bd85cb63fd64c39 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:34.112883  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b45057315e4ff09bd85cb63fd64c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.113941  1797 tablet_bootstrap.cc:654] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.117133  1794 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:34.120859  1794 ts_tablet_manager.cc:1403] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.000s
I20260709 13:12:34.121621  1796 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:34.122208  1796 ts_tablet_manager.cc:1403] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.170s	user 0.026s	sys 0.014s
I20260709 13:12:34.125826  1796 raft_consensus.cc:359] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.126694  1796 raft_consensus.cc:385] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.127053  1796 raft_consensus.cc:740] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.139515  1796 consensus_queue.cc:260] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.140409  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 70b45057315e4ff09bd85cb63fd64c39 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:34.142890  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b45057315e4ff09bd85cb63fd64c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.144692  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 70b45057315e4ff09bd85cb63fd64c39 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:34.133129  1794 raft_consensus.cc:359] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.147938  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b45057315e4ff09bd85cb63fd64c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.148125  1794 raft_consensus.cc:385] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.148743  1794 raft_consensus.cc:740] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.162325  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 793b9da3cfbe48f7912724719cac2e28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:34.164372  1555 heartbeater.cc:499] Master 127.25.139.190:41051 was elected leader, sending a full tablet report...
I20260709 13:12:34.165772  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 793b9da3cfbe48f7912724719cac2e28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:34.167646  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b9da3cfbe48f7912724719cac2e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.174441  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b9da3cfbe48f7912724719cac2e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.178603  1704 heartbeater.cc:499] Master 127.25.139.190:41051 was elected leader, sending a full tablet report...
I20260709 13:12:34.179651  1796 ts_tablet_manager.cc:1434] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.057s	user 0.011s	sys 0.011s
I20260709 13:12:34.180871  1796 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:34.190548  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 793b9da3cfbe48f7912724719cac2e28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:34.192044  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793b9da3cfbe48f7912724719cac2e28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.194686  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 10d2a7145e324ea3a64b9ae40643e923 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:34.196027  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d2a7145e324ea3a64b9ae40643e923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.200237  1795 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:34.200835  1795 ts_tablet_manager.cc:1403] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.169s	user 0.010s	sys 0.005s
I20260709 13:12:34.205866  1515 tablet_service.cc:1511] Processing CreateTablet for tablet d4ae70b3df284d3faf8022535886954e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:34.209444  1592 tablet_service.cc:1511] Processing CreateTablet for tablet d4ae70b3df284d3faf8022535886954e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:34.210839  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ae70b3df284d3faf8022535886954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.211488  1665 tablet_service.cc:1511] Processing CreateTablet for tablet 10d2a7145e324ea3a64b9ae40643e923 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:34.150246  1794 consensus_queue.cc:260] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.211092  1795 raft_consensus.cc:359] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.212034  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ae70b3df284d3faf8022535886954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.215968  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d2a7145e324ea3a64b9ae40643e923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.220458  1666 tablet_service.cc:1511] Processing CreateTablet for tablet d4ae70b3df284d3faf8022535886954e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:34.221879  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ae70b3df284d3faf8022535886954e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.216714  1795 raft_consensus.cc:385] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.229087  1795 raft_consensus.cc:740] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.232511  1795 consensus_queue.cc:260] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.233208  1797 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:34.233840  1797 ts_tablet_manager.cc:1403] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.138s	user 0.036s	sys 0.049s
I20260709 13:12:34.237378  1797 raft_consensus.cc:359] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.238247  1797 raft_consensus.cc:385] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.238675  1797 raft_consensus.cc:740] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.239768  1797 consensus_queue.cc:260] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.257119  1630 heartbeater.cc:499] Master 127.25.139.190:41051 was elected leader, sending a full tablet report...
I20260709 13:12:34.259234  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 5160521b61c64b3197aeb0a169fecff3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:34.261300  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5160521b61c64b3197aeb0a169fecff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.261752  1589 tablet_service.cc:1511] Processing CreateTablet for tablet d7dfeb0bf60e419a808cb054b8a99ebe (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:34.263024  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dfeb0bf60e419a808cb054b8a99ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.265769  1794 ts_tablet_manager.cc:1434] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.007s
I20260709 13:12:34.238240  1796 tablet_bootstrap.cc:654] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.255412  1736 tablet_service.cc:1511] Processing CreateTablet for tablet d7dfeb0bf60e419a808cb054b8a99ebe (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:34.259243  1797 ts_tablet_manager.cc:1434] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.002s
I20260709 13:12:34.274614  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 5160521b61c64b3197aeb0a169fecff3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:34.277482  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dfeb0bf60e419a808cb054b8a99ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.277696  1806 raft_consensus.cc:493] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.278332  1806 raft_consensus.cc:515] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.272951  1794 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:34.281461  1806 leader_election.cc:290] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:34.294363  1795 ts_tablet_manager.cc:1434] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.093s	user 0.011s	sys 0.008s
I20260709 13:12:34.295382  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5160521b61c64b3197aeb0a169fecff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.296811  1795 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:34.294453  1778 heartbeater.cc:499] Master 127.25.139.190:41051 was elected leader, sending a full tablet report...
I20260709 13:12:34.273306  1519 tablet_service.cc:1511] Processing CreateTablet for tablet d7dfeb0bf60e419a808cb054b8a99ebe (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:34.311841  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7dfeb0bf60e419a808cb054b8a99ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.272387  1743 tablet_service.cc:1511] Processing CreateTablet for tablet 10d2a7145e324ea3a64b9ae40643e923 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:34.322261  1743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d2a7145e324ea3a64b9ae40643e923. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.324115  1797 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:34.333550  1797 tablet_bootstrap.cc:654] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:34.341446  1705 tablet.cc:2406] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:34.347764  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 356632bab23f4101862a3ce673ca5d8c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:34.349303  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356632bab23f4101862a3ce673ca5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.357132  1794 tablet_bootstrap.cc:654] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.364873  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 356632bab23f4101862a3ce673ca5d8c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:34.366292  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356632bab23f4101862a3ce673ca5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.364919  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 356632bab23f4101862a3ce673ca5d8c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:34.374097  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 356632bab23f4101862a3ce673ca5d8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.387931  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce7af2981b948d384465e8ee576e78e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:34.389436  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce7af2981b948d384465e8ee576e78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.393338  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce7af2981b948d384465e8ee576e78e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:34.394160  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 5160521b61c64b3197aeb0a169fecff3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:34.394802  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce7af2981b948d384465e8ee576e78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.395514  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5160521b61c64b3197aeb0a169fecff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.407027  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 6ce7af2981b948d384465e8ee576e78e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:34.411239  1591 tablet_service.cc:1511] Processing CreateTablet for tablet ea539e73baec42e2bf45e9ca296219aa (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:34.412681  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea539e73baec42e2bf45e9ca296219aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.415246  1795 tablet_bootstrap.cc:654] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.416658  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ce7af2981b948d384465e8ee576e78e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.417248  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:34.422000  1665 tablet_service.cc:1511] Processing CreateTablet for tablet a92c0d0759d14171ae0df1638e73c740 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:34.423455  1665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92c0d0759d14171ae0df1638e73c740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.429320  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:34.430174  1679 raft_consensus.cc:2468] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:34.430713  1743 tablet_service.cc:1511] Processing CreateTablet for tablet a92c0d0759d14171ae0df1638e73c740 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:12:34.431748  1495 leader_election.cc:343] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.432258  1743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92c0d0759d14171ae0df1638e73c740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.433180  1516 tablet_service.cc:1511] Processing CreateTablet for tablet a92c0d0759d14171ae0df1638e73c740 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:34.434499  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92c0d0759d14171ae0df1638e73c740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.435714  1494 leader_election.cc:304] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:34.437667  1804 raft_consensus.cc:2804] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.438130  1804 raft_consensus.cc:493] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.438529  1804 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.441076  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 75086307353648738b0658d935e444c6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:34.428892  1514 tablet_service.cc:1511] Processing CreateTablet for tablet ea539e73baec42e2bf45e9ca296219aa (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:34.441751  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 75086307353648738b0658d935e444c6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:34.442544  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75086307353648738b0658d935e444c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.443006  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75086307353648738b0658d935e444c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.442574  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea539e73baec42e2bf45e9ca296219aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.438534  1739 tablet_service.cc:1511] Processing CreateTablet for tablet ea539e73baec42e2bf45e9ca296219aa (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:34.450237  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea539e73baec42e2bf45e9ca296219aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.461161  1805 raft_consensus.cc:493] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.460973  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 75086307353648738b0658d935e444c6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:34.461701  1805 raft_consensus.cc:515] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.462349  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75086307353648738b0658d935e444c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.470304  1796 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:34.470865  1796 ts_tablet_manager.cc:1403] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.290s	user 0.007s	sys 0.012s
I20260709 13:12:34.475244  1519 tablet_service.cc:1511] Processing CreateTablet for tablet c77a28753d4848a3880e7b8e19c7c253 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:34.476720  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77a28753d4848a3880e7b8e19c7c253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.477644  1805 leader_election.cc:290] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:34.490322  1794 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:34.491583  1667 tablet_service.cc:1511] Processing CreateTablet for tablet c77a28753d4848a3880e7b8e19c7c253 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:34.494165  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77a28753d4848a3880e7b8e19c7c253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.497076  1796 raft_consensus.cc:359] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.497913  1796 raft_consensus.cc:385] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.498214  1796 raft_consensus.cc:740] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.503988  1794 ts_tablet_manager.cc:1403] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.231s	user 0.022s	sys 0.010s
I20260709 13:12:34.504681  1592 tablet_service.cc:1511] Processing CreateTablet for tablet c77a28753d4848a3880e7b8e19c7c253 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:34.506021  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77a28753d4848a3880e7b8e19c7c253. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.507318  1794 raft_consensus.cc:359] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.508157  1794 raft_consensus.cc:385] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.508520  1794 raft_consensus.cc:740] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.509356  1794 consensus_queue.cc:260] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.513648  1794 ts_tablet_manager.cc:1434] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:34.513795  1804 raft_consensus.cc:515] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.516602  1797 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:34.517145  1797 ts_tablet_manager.cc:1403] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.008s
I20260709 13:12:34.517381  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:34.518023  1605 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.524444  1797 raft_consensus.cc:359] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.525281  1797 raft_consensus.cc:385] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.525377  1605 raft_consensus.cc:2468] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:34.526321  1795 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:34.526880  1795 ts_tablet_manager.cc:1403] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.007s
I20260709 13:12:34.527468  1495 leader_election.cc:304] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:34.528643  1806 raft_consensus.cc:2804] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.525619  1797 raft_consensus.cc:740] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.526358  1804 leader_election.cc:290] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:34.532562  1794 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:34.539268  1796 consensus_queue.cc:260] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.552059  1796 ts_tablet_manager.cc:1434] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.001s
I20260709 13:12:34.553608  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb98195cf34f6baea8c9209c1621e7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:34.561208  1663 tablet_service.cc:1511] Processing CreateTablet for tablet f3239aa727f34be3b22879bece578a0c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:34.562564  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3239aa727f34be3b22879bece578a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.563995  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb98195cf34f6baea8c9209c1621e7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:34.564788  1796 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:34.565564  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb98195cf34f6baea8c9209c1621e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.565812  1795 raft_consensus.cc:359] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.566614  1795 raft_consensus.cc:385] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.568601  1743 tablet_service.cc:1511] Processing CreateTablet for tablet f3239aa727f34be3b22879bece578a0c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:34.570034  1743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3239aa727f34be3b22879bece578a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.572022  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb98195cf34f6baea8c9209c1621e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.566927  1795 raft_consensus.cc:740] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.556293  1806 raft_consensus.cc:697] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:34.580436  1803 raft_consensus.cc:493] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.581807  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3d4b647afe44848c02525fceeb81a7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:34.591501  1803 raft_consensus.cc:515] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.592113  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3d4b647afe44848c02525fceeb81a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.592283  1795 consensus_queue.cc:260] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.592974  1667 tablet_service.cc:1511] Processing CreateTablet for tablet 25c304781e4047a3aa43c42385c174da (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:34.594444  1803 leader_election.cc:290] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:34.594810  1795 ts_tablet_manager.cc:1434] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:12:34.586779  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:34.587764  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 25c304781e4047a3aa43c42385c174da (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:34.588169  1517 tablet_service.cc:1511] Processing CreateTablet for tablet f3239aa727f34be3b22879bece578a0c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:34.589743  1515 tablet_service.cc:1511] Processing CreateTablet for tablet 25c304781e4047a3aa43c42385c174da (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:34.589862  1592 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3d4b647afe44848c02525fceeb81a7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:34.581848  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 0b3d4b647afe44848c02525fceeb81a7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:34.602797  1806 consensus_queue.cc:237] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.604151  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c304781e4047a3aa43c42385c174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.603746  1516 tablet_service.cc:1511] Processing CreateTablet for tablet 53fb98195cf34f6baea8c9209c1621e7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:34.604875  1679 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.613384  1667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c304781e4047a3aa43c42385c174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.623939  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3d4b647afe44848c02525fceeb81a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.577375  1797 consensus_queue.cc:260] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.636371  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56487f97c81348d18d1336ca6b5a08e2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:34.637120  1678 raft_consensus.cc:2468] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:34.637336  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 0379b5784a684643b7f6abcd1a99e91f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:34.631472  1794 tablet_bootstrap.cc:654] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.638474  1717 leader_election.cc:304] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:34.631956  1805 raft_consensus.cc:493] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.639415  1805 raft_consensus.cc:515] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.638727  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0379b5784a684643b7f6abcd1a99e91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.643594  1796 tablet_bootstrap.cc:654] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.646487  1515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c304781e4047a3aa43c42385c174da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.650978  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 50ee3a20a0274ce9b86ef729e86f8669 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:34.654942  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fb98195cf34f6baea8c9209c1621e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.666802  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3239aa727f34be3b22879bece578a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.643071  1805 leader_election.cc:290] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:34.667956  1805 raft_consensus.cc:2804] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.668321  1805 raft_consensus.cc:493] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.668659  1805 raft_consensus.cc:3060] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.666867  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ee3a20a0274ce9b86ef729e86f8669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.673647  1592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b3d4b647afe44848c02525fceeb81a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.638724  1795 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:34.682441  1797 ts_tablet_manager.cc:1434] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.165s	user 0.008s	sys 0.003s
I20260709 13:12:34.683063  1805 raft_consensus.cc:515] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.683677  1797 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:34.685230  1679 raft_consensus.cc:2468] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:34.705888  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 50ee3a20a0274ce9b86ef729e86f8669 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:34.706477  1797 tablet_bootstrap.cc:654] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.707357  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ee3a20a0274ce9b86ef729e86f8669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.730644  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56487f97c81348d18d1336ca6b5a08e2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:34.731269  1520 tablet_service.cc:1511] Processing CreateTablet for tablet 0379b5784a684643b7f6abcd1a99e91f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:34.732614  1520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0379b5784a684643b7f6abcd1a99e91f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.736022  1716 leader_election.cc:343] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.736232  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 25c161302a6f43a2a5815562dd376bb7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:34.736750  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:34.736809  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7ea292ba4c446baa780c385e973388 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:34.738421  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7ea292ba4c446baa780c385e973388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.739624  1805 leader_election.cc:290] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:34.740417  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c161302a6f43a2a5815562dd376bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.736241  1518 tablet_service.cc:1511] Processing CreateTablet for tablet 25c161302a6f43a2a5815562dd376bb7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:34.744599  1518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c161302a6f43a2a5815562dd376bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.755731  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:34.761143  1594 tablet_service.cc:1511] Processing CreateTablet for tablet 50ee3a20a0274ce9b86ef729e86f8669 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:34.761193  1588 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7ea292ba4c446baa780c385e973388 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:34.762872  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ee3a20a0274ce9b86ef729e86f8669. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.763669  1716 leader_election.cc:343] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.764407  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56487f97c81348d18d1336ca6b5a08e2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:34.761873  1794 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
W20260709 13:12:34.768673  1569 leader_election.cc:343] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.767979  1794 ts_tablet_manager.cc:1403] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.236s	user 0.014s	sys 0.006s
W20260709 13:12:34.774036  1716 leader_election.cc:343] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:34.693300  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 54566.9us
I20260709 13:12:34.790587  1588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7ea292ba4c446baa780c385e973388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.800638  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:34.804457  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56487f97c81348d18d1336ca6b5a08e2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:34.805105  1679 raft_consensus.cc:3060] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.805639  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 25c161302a6f43a2a5815562dd376bb7 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:34.806957  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25c161302a6f43a2a5815562dd376bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.808629  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:34.809994  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.805130  1589 tablet_service.cc:1511] Processing CreateTablet for tablet c7892b317e15474e89775b9d69f7fe66 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:34.804347  1795 tablet_bootstrap.cc:654] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:34.813787  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7892b317e15474e89775b9d69f7fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.818126  1797 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:34.820912  1797 ts_tablet_manager.cc:1403] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.137s	user 0.006s	sys 0.018s
I20260709 13:12:34.824630  1797 raft_consensus.cc:359] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.825361  1797 raft_consensus.cc:385] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.825657  1797 raft_consensus.cc:740] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.828550  1740 tablet_service.cc:1511] Processing CreateTablet for tablet 9f7ea292ba4c446baa780c385e973388 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:34.829945  1740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f7ea292ba4c446baa780c385e973388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.832224  1738 tablet_service.cc:1511] Processing CreateTablet for tablet c7892b317e15474e89775b9d69f7fe66 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:34.833475  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7892b317e15474e89775b9d69f7fe66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.834981  1717 leader_election.cc:343] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.835700  1717 leader_election.cc:304] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:34.839406  1805 raft_consensus.cc:2749] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:34.845144  1794 raft_consensus.cc:359] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.846016  1794 raft_consensus.cc:385] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.846324  1794 raft_consensus.cc:740] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.847317  1797 consensus_queue.cc:260] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.850010  1797 ts_tablet_manager.cc:1434] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:12:34.847549  1426 catalog_manager.cc:5697] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.851351  1517 tablet_service.cc:1511] Processing CreateTablet for tablet c7892b317e15474e89775b9d69f7fe66 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:34.852559  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:34.852945  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7892b317e15474e89775b9d69f7fe66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.853277  1753 raft_consensus.cc:2468] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:34.853638  1593 tablet_service.cc:1511] Processing CreateTablet for tablet cdbab434e7b64cfb957c2d17d7ba0efc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:34.855039  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbab434e7b64cfb957c2d17d7ba0efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.855381  1806 raft_consensus.cc:493] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:34.856000  1806 raft_consensus.cc:515] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.857954  1679 raft_consensus.cc:2468] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:34.859935  1796 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:34.860512  1796 ts_tablet_manager.cc:1403] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.296s	user 0.009s	sys 0.031s
I20260709 13:12:34.865226  1806 leader_election.cc:290] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:34.847096  1794 consensus_queue.cc:260] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.865908  1797 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:34.870609  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:34.873312  1605 raft_consensus.cc:2468] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:34.875334  1794 ts_tablet_manager.cc:1434] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 13:12:34.876034  1495 leader_election.cc:304] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:34.876441  1794 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:34.877915  1663 tablet_service.cc:1511] Processing CreateTablet for tablet cdbab434e7b64cfb957c2d17d7ba0efc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:34.878899  1806 raft_consensus.cc:2804] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.879408  1806 raft_consensus.cc:493] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.879809  1806 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.879724  1568 leader_election.cc:304] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:34.880864  1803 raft_consensus.cc:2804] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:34.881251  1803 raft_consensus.cc:493] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:34.881589  1803 raft_consensus.cc:3060] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.888741  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:34.890213  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.894122  1803 raft_consensus.cc:515] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:34.897114  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:34.897740  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbab434e7b64cfb957c2d17d7ba0efc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.898415  1569 leader_election.cc:343] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:34.902871  1717 leader_election.cc:304] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:34.903846  1805 raft_consensus.cc:2804] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:34.903643  1736 tablet_service.cc:1511] Processing CreateTablet for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:34.904464  1805 raft_consensus.cc:697] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:34.905095  1736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062b7dfb8c3f4c0498cd8d10a1d2dd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.905512  1805 consensus_queue.cc:237] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.918823  1796 raft_consensus.cc:359] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.919770  1796 raft_consensus.cc:385] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:34.920109  1796 raft_consensus.cc:740] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:34.921317  1796 consensus_queue.cc:260] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:34.928164  1803 leader_election.cc:290] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:34.930531  1796 ts_tablet_manager.cc:1434] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:12:34.931653  1796 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:34.932721  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 66c508d13a2e4137b001068a1d1a3a28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:34.934063  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c508d13a2e4137b001068a1d1a3a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.934615  1743 tablet_service.cc:1511] Processing CreateTablet for tablet cdbab434e7b64cfb957c2d17d7ba0efc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:34.935932  1743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdbab434e7b64cfb957c2d17d7ba0efc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.951335  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 66c508d13a2e4137b001068a1d1a3a28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:34.952766  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c508d13a2e4137b001068a1d1a3a28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.956003  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:34.957273  1806 raft_consensus.cc:515] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:34.957479  1742 tablet_service.cc:1511] Processing CreateTablet for tablet e94725900d8046968b81fad5677b14a6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:34.958915  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94725900d8046968b81fad5677b14a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.908223  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 0379b5784a684643b7f6abcd1a99e91f (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:34.960270  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:34.960866  1753 raft_consensus.cc:3060] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.961218  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:34.961818  1605 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:34.973379  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 66c508d13a2e4137b001068a1d1a3a28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:34.974738  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c508d13a2e4137b001068a1d1a3a28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.979537  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0379b5784a684643b7f6abcd1a99e91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.968628  1806 leader_election.cc:290] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:34.984179  1753 raft_consensus.cc:2468] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:34.987082  1794 tablet_bootstrap.cc:654] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.008417  1568 leader_election.cc:304] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:35.009163  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.009704  1803 raft_consensus.cc:2804] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.010646  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:35.012662  1605 raft_consensus.cc:2468] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:35.012466  1516 tablet_service.cc:1511] Processing CreateTablet for tablet e94725900d8046968b81fad5677b14a6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:35.013767  1797 tablet_bootstrap.cc:654] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.013875  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94725900d8046968b81fad5677b14a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.015517  1495 leader_election.cc:304] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
W20260709 13:12:35.012530  1493 leader_election.cc:343] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.017436  1493 leader_election.cc:343] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.010435  1425 catalog_manager.cc:5697] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.024151  1806 raft_consensus.cc:2804] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.025012  1806 raft_consensus.cc:697] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:35.026098  1589 tablet_service.cc:1511] Processing CreateTablet for tablet e94725900d8046968b81fad5677b14a6 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:35.028097  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e94725900d8046968b81fad5677b14a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.025969  1806 consensus_queue.cc:237] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.028946  1796 tablet_bootstrap.cc:654] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.037782  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 3b14405810174b1da9026bec4dfa5110 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:35.039206  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b14405810174b1da9026bec4dfa5110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.042433  1795 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:35.042974  1795 ts_tablet_manager.cc:1403] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.404s	user 0.011s	sys 0.011s
I20260709 13:12:35.043936  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 3b14405810174b1da9026bec4dfa5110 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:35.045297  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b14405810174b1da9026bec4dfa5110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.046301  1795 raft_consensus.cc:359] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.047086  1795 raft_consensus.cc:385] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.048795  1795 raft_consensus.cc:740] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.085824  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 3b14405810174b1da9026bec4dfa5110 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:35.087299  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b14405810174b1da9026bec4dfa5110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.098820  1795 consensus_queue.cc:260] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.100035  1591 tablet_service.cc:1511] Processing CreateTablet for tablet 10e8d04de04d4aaba701d3d54a96ba95 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:35.101493  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e8d04de04d4aaba701d3d54a96ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.096125  1803 raft_consensus.cc:697] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:35.112795  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 10e8d04de04d4aaba701d3d54a96ba95 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:35.114370  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e8d04de04d4aaba701d3d54a96ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.113950  1803 consensus_queue.cc:237] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.114532  1664 tablet_service.cc:1511] Processing CreateTablet for tablet 10e8d04de04d4aaba701d3d54a96ba95 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:35.115959  1664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e8d04de04d4aaba701d3d54a96ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.116665  1795 ts_tablet_manager.cc:1434] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:12:35.118814  1802 raft_consensus.cc:493] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.119398  1802 raft_consensus.cc:515] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:35.120260  1517 tablet_service.cc:1511] Processing CreateTablet for tablet f6c73b2826d849cb95d78247681a3fc2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:35.121572  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c73b2826d849cb95d78247681a3fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.122386  1802 leader_election.cc:290] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:35.128322  1818 consensus_queue.cc:1048] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.140758  1794 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:35.141121  1795 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:35.152882  1589 tablet_service.cc:1511] Processing CreateTablet for tablet f6c73b2826d849cb95d78247681a3fc2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:35.154580  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c73b2826d849cb95d78247681a3fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.151913  1794 ts_tablet_manager.cc:1403] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.276s	user 0.029s	sys 0.003s
I20260709 13:12:35.157917  1795 tablet_bootstrap.cc:654] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.158457  1666 tablet_service.cc:1511] Processing CreateTablet for tablet f6c73b2826d849cb95d78247681a3fc2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:35.160164  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c73b2826d849cb95d78247681a3fc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.158087  1796 tablet_bootstrap.cc:492] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:35.162186  1796 ts_tablet_manager.cc:1403] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.231s	user 0.027s	sys 0.017s
I20260709 13:12:35.166138  1519 tablet_service.cc:1511] Processing CreateTablet for tablet da5ca4158645483daecbd41331823b28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:35.166611  1593 tablet_service.cc:1511] Processing CreateTablet for tablet da5ca4158645483daecbd41331823b28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:35.167928  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ca4158645483daecbd41331823b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.172233  1668 tablet_service.cc:1511] Processing CreateTablet for tablet cb08ccac0eca4cd2af937e0c1cb87ce2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:35.171588  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ca4158645483daecbd41331823b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.173512  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb08ccac0eca4cd2af937e0c1cb87ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.170583  1794 raft_consensus.cc:359] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.191388  1794 raft_consensus.cc:385] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.195403  1794 raft_consensus.cc:740] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.196163  1794 consensus_queue.cc:260] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.200585  1796 raft_consensus.cc:359] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.201875  1796 raft_consensus.cc:385] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.202479  1796 raft_consensus.cc:740] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.207274  1590 tablet_service.cc:1511] Processing CreateTablet for tablet 7246ca069aee46739528e2ba5e72e40c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:35.208755  1590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7246ca069aee46739528e2ba5e72e40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.201486  1794 ts_tablet_manager.cc:1434] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:12:35.225478  1739 tablet_service.cc:1511] Processing CreateTablet for tablet cb08ccac0eca4cd2af937e0c1cb87ce2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:35.191975  1742 tablet_service.cc:1511] Processing CreateTablet for tablet da5ca4158645483daecbd41331823b28 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:35.226907  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb08ccac0eca4cd2af937e0c1cb87ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.229990  1797 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:35.230582  1797 ts_tablet_manager.cc:1403] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.380s	user 0.012s	sys 0.012s
I20260709 13:12:35.233877  1797 raft_consensus.cc:359] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.234658  1797 raft_consensus.cc:385] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.229579  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 7246ca069aee46739528e2ba5e72e40c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:35.238104  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7246ca069aee46739528e2ba5e72e40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.246804  1794 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:35.247546  1806 consensus_queue.cc:1048] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.254067  1794 tablet_bootstrap.cc:654] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.234954  1797 raft_consensus.cc:740] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.240444  1517 tablet_service.cc:1511] Processing CreateTablet for tablet cb08ccac0eca4cd2af937e0c1cb87ce2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:35.261142  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5ca4158645483daecbd41331823b28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.220929  1796 consensus_queue.cc:260] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.275034  1802 raft_consensus.cc:493] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.275571  1802 raft_consensus.cc:515] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.272929  1425 catalog_manager.cc:5697] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.280239  1427 catalog_manager.cc:5697] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:35.281919  1802 leader_election.cc:290] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:35.285501  1796 ts_tablet_manager.cc:1434] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.123s	user 0.004s	sys 0.005s
I20260709 13:12:35.286659  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb08ccac0eca4cd2af937e0c1cb87ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.295832  1738 tablet_service.cc:1511] Processing CreateTablet for tablet 7246ca069aee46739528e2ba5e72e40c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:35.286671  1796 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:35.309105  1738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7246ca069aee46739528e2ba5e72e40c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.311834  1795 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:35.312407  1795 ts_tablet_manager.cc:1403] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.195s	user 0.015s	sys 0.004s
I20260709 13:12:35.312923  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.314162  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.315013  1751 raft_consensus.cc:2393] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
W20260709 13:12:35.316494  1642 leader_election.cc:343] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.318194  1519 tablet_service.cc:1511] Processing CreateTablet for tablet c413246a168d46a28a09378837a4453e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:35.319416  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413246a168d46a28a09378837a4453e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.268829  1797 consensus_queue.cc:260] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.331439  1797 ts_tablet_manager.cc:1434] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.101s	user 0.002s	sys 0.007s
I20260709 13:12:35.332566  1797 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:35.332823  1593 tablet_service.cc:1511] Processing CreateTablet for tablet c413246a168d46a28a09378837a4453e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:35.332593  1795 raft_consensus.cc:359] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:35.334134  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413246a168d46a28a09378837a4453e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.334329  1795 raft_consensus.cc:385] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.334722  1795 raft_consensus.cc:740] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.335527  1795 consensus_queue.cc:260] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:35.338316  1795 ts_tablet_manager.cc:1434] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:12:35.339461  1795 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:35.346240  1795 tablet_bootstrap.cc:654] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.357249  1668 tablet_service.cc:1511] Processing CreateTablet for tablet c413246a168d46a28a09378837a4453e (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:35.358768  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c413246a168d46a28a09378837a4453e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.374411  1737 tablet_service.cc:1511] Processing CreateTablet for tablet c76ddc05f4da4c84b448ea837803e27c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:35.375838  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76ddc05f4da4c84b448ea837803e27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.377148  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:35.379099  1642 leader_election.cc:343] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.379678  1642 leader_election.cc:304] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:35.381187  1846 raft_consensus.cc:2749] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.388288  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52c0b8276e87458183fa270edf8307f3" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:35.390069  1644 leader_election.cc:304] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:35.391057  1846 raft_consensus.cc:3060] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.391700  1803 raft_consensus.cc:493] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.392237  1803 raft_consensus.cc:515] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.395073  1513 tablet_service.cc:1511] Processing CreateTablet for tablet c76ddc05f4da4c84b448ea837803e27c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:35.396785  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76ddc05f4da4c84b448ea837803e27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.398298  1803 leader_election.cc:290] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:35.398783  1846 raft_consensus.cc:2749] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.408015  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.414690  1751 raft_consensus.cc:2468] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:35.423952  1568 leader_election.cc:304] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:35.425034  1805 consensus_queue.cc:1048] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.428419  1591 tablet_service.cc:1511] Processing CreateTablet for tablet c76ddc05f4da4c84b448ea837803e27c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:35.425097  1803 raft_consensus.cc:2804] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.430255  1803 raft_consensus.cc:493] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.430764  1803 raft_consensus.cc:3060] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.448671  1662 tablet_service.cc:1511] Processing CreateTablet for tablet bc6e4900b0f8471a9e011ad8e7b4883c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:35.450071  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6e4900b0f8471a9e011ad8e7b4883c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.450824  1794 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:35.446836  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c76ddc05f4da4c84b448ea837803e27c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.451385  1794 ts_tablet_manager.cc:1403] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.205s	user 0.016s	sys 0.014s
I20260709 13:12:35.451594  1796 tablet_bootstrap.cc:654] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.455303  1797 tablet_bootstrap.cc:654] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.454442  1794 raft_consensus.cc:359] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.466595  1794 raft_consensus.cc:385] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.466956  1794 raft_consensus.cc:740] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.459332  1742 tablet_service.cc:1511] Processing CreateTablet for tablet bc6e4900b0f8471a9e011ad8e7b4883c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:35.468233  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6e4900b0f8471a9e011ad8e7b4883c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.460783  1519 tablet_service.cc:1511] Processing CreateTablet for tablet bc6e4900b0f8471a9e011ad8e7b4883c (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:35.462975  1795 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:35.460052  1589 tablet_service.cc:1511] Processing CreateTablet for tablet e5cbb2cdb27143549a19371a87196764 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:35.469445  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5cbb2cdb27143549a19371a87196764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.467800  1794 consensus_queue.cc:260] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.470206  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc6e4900b0f8471a9e011ad8e7b4883c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.475618  1803 raft_consensus.cc:515] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.475852  1666 tablet_service.cc:1511] Processing CreateTablet for tablet e5cbb2cdb27143549a19371a87196764 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:35.476315  1529 raft_consensus.cc:3060] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.477190  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5cbb2cdb27143549a19371a87196764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.478619  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:35.479256  1751 raft_consensus.cc:3060] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.485580  1818 consensus_queue.cc:1048] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.486362  1805 consensus_queue.cc:1048] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:35.492774  1794 ts_tablet_manager.cc:1434] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:12:35.493024  1739 tablet_service.cc:1511] Processing CreateTablet for tablet e5cbb2cdb27143549a19371a87196764 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:35.494360  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5cbb2cdb27143549a19371a87196764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.497426  1751 raft_consensus.cc:2468] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:35.487782  1795 ts_tablet_manager.cc:1403] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.044s
I20260709 13:12:35.511890  1794 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:35.515152  1568 leader_election.cc:304] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:35.530220  1516 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8234639df4f6cb6d73f59b3a8fffc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:35.531690  1833 raft_consensus.cc:2804] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:35.531862  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8234639df4f6cb6d73f59b3a8fffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.543638  1818 raft_consensus.cc:493] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.550591  1818 raft_consensus.cc:515] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.552175  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:35.552867  1530 raft_consensus.cc:2468] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:35.534432  1803 leader_election.cc:290] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:35.555958  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.556823  1753 raft_consensus.cc:2393] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:35.558053  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:35.559115  1591 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8234639df4f6cb6d73f59b3a8fffc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:35.560051  1796 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:35.556360  1795 raft_consensus.cc:359] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.560475  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8234639df4f6cb6d73f59b3a8fffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.566241  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43dc0ea5206435ebf2346061be97395" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:35.566929  1530 raft_consensus.cc:3060] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.567109  1663 tablet_service.cc:1511] Processing CreateTablet for tablet bfa8234639df4f6cb6d73f59b3a8fffc (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:35.552863  1818 leader_election.cc:290] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:35.571800  1493 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e -> Peer 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975): Couldn't send request to peer 81b721300bd34373862d7937c3bf394a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.575459  1530 raft_consensus.cc:2468] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:35.576051  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfa8234639df4f6cb6d73f59b3a8fffc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.563354  1795 raft_consensus.cc:385] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.591478  1795 raft_consensus.cc:740] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.593047  1795 consensus_queue.cc:260] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.593336  1803 consensus_queue.cc:1048] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.598407  1795 ts_tablet_manager.cc:1434] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.095s	user 0.005s	sys 0.002s
I20260709 13:12:35.560639  1796 ts_tablet_manager.cc:1403] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.274s	user 0.007s	sys 0.012s
I20260709 13:12:35.608971  1739 tablet_service.cc:1511] Processing CreateTablet for tablet a7f777d8fcda4822b72ea2ff86629dad (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:35.610765  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f777d8fcda4822b72ea2ff86629dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.628226  1513 tablet_service.cc:1511] Processing CreateTablet for tablet a7f777d8fcda4822b72ea2ff86629dad (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:35.629733  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f777d8fcda4822b72ea2ff86629dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.630182  1591 tablet_service.cc:1511] Processing CreateTablet for tablet a7f777d8fcda4822b72ea2ff86629dad (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:35.631906  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7f777d8fcda4822b72ea2ff86629dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.603551  1833 raft_consensus.cc:697] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:35.640512  1833 consensus_queue.cc:237] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.643219  1860 consensus_queue.cc:1048] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:35.644380  1668 tablet_service.cc:1511] Processing CreateTablet for tablet 08fc8c696d1441de9afedcc0a96f0908 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:35.652819  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fc8c696d1441de9afedcc0a96f0908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.657572  1517 tablet_service.cc:1511] Processing CreateTablet for tablet 08fc8c696d1441de9afedcc0a96f0908 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:35.662853  1794 tablet_bootstrap.cc:654] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.659137  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fc8c696d1441de9afedcc0a96f0908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.665596  1795 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:35.680599  1797 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:35.681231  1797 ts_tablet_manager.cc:1403] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.349s	user 0.024s	sys 0.029s
I20260709 13:12:35.660871  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 08fc8c696d1441de9afedcc0a96f0908 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:35.696203  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fc8c696d1441de9afedcc0a96f0908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.699841  1796 raft_consensus.cc:359] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.700743  1796 raft_consensus.cc:385] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.701116  1796 raft_consensus.cc:740] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.701921  1796 consensus_queue.cc:260] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.703713  1742 tablet_service.cc:1511] Processing CreateTablet for tablet d03b372e29b64b72a97eedf387abc386 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:35.705526  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03b372e29b64b72a97eedf387abc386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.706521  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 978d44de9b6f410a9c94c0898667c8f1 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:35.707811  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978d44de9b6f410a9c94c0898667c8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.677358  1666 tablet_service.cc:1511] Processing CreateTablet for tablet d03b372e29b64b72a97eedf387abc386 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:35.709800  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03b372e29b64b72a97eedf387abc386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.713220  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 978d44de9b6f410a9c94c0898667c8f1 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:35.714656  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978d44de9b6f410a9c94c0898667c8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.723150  1796 ts_tablet_manager.cc:1434] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.001s
I20260709 13:12:35.724429  1796 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:35.700745  1797 raft_consensus.cc:359] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.730865  1797 raft_consensus.cc:385] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.734378  1591 tablet_service.cc:1511] Processing CreateTablet for tablet d03b372e29b64b72a97eedf387abc386 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:35.735817  1591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d03b372e29b64b72a97eedf387abc386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.737613  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 978d44de9b6f410a9c94c0898667c8f1 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:35.731249  1797 raft_consensus.cc:740] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.743830  1593 tablet_service.cc:1511] Processing CreateTablet for tablet adb3694e79904863a5bcb3e9f2985ad0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:35.750535  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb3694e79904863a5bcb3e9f2985ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.751375  1797 consensus_queue.cc:260] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.755030  1495 leader_election.cc:304] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:35.756276  1806 raft_consensus.cc:2749] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.757889  1739 tablet_service.cc:1511] Processing CreateTablet for tablet adb3694e79904863a5bcb3e9f2985ad0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:35.759054  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb3694e79904863a5bcb3e9f2985ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.759590  1795 tablet_bootstrap.cc:654] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.766647  1797 ts_tablet_manager.cc:1434] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.085s	user 0.004s	sys 0.005s
I20260709 13:12:35.768399  1797 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:35.770211  1516 tablet_service.cc:1511] Processing CreateTablet for tablet adb3694e79904863a5bcb3e9f2985ad0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:35.773270  1427 catalog_manager.cc:5697] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.776825  1662 tablet_service.cc:1511] Processing CreateTablet for tablet 64bfde6140f041d3835174d6009e02d2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:35.778296  1662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bfde6140f041d3835174d6009e02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.781498  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978d44de9b6f410a9c94c0898667c8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.789487  1794 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:35.790114  1794 ts_tablet_manager.cc:1403] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.002s
I20260709 13:12:35.794169  1794 raft_consensus.cc:359] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.795131  1794 raft_consensus.cc:385] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.795503  1794 raft_consensus.cc:740] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.807901  1796 tablet_bootstrap.cc:654] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.814873  1739 tablet_service.cc:1511] Processing CreateTablet for tablet 64bfde6140f041d3835174d6009e02d2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:35.816242  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bfde6140f041d3835174d6009e02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.837960  1516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb3694e79904863a5bcb3e9f2985ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.850598  1803 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.851145  1803 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.851833  1797 tablet_bootstrap.cc:654] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.853238  1803 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:35.853044  1589 tablet_service.cc:1511] Processing CreateTablet for tablet eecf06b378aa48e987bc3e69cad1acd0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:35.854312  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecf06b378aa48e987bc3e69cad1acd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.855700  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:35.856357  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
W20260709 13:12:35.857170  1568 leader_election.cc:343] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:35.857935  1569 leader_election.cc:343] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.858390  1569 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:35.843359  1794 consensus_queue.cc:260] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.859470  1860 raft_consensus.cc:2749] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:35.854005  1519 tablet_service.cc:1511] Processing CreateTablet for tablet 64bfde6140f041d3835174d6009e02d2 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:35.860584  1794 ts_tablet_manager.cc:1434] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.000s
I20260709 13:12:35.861438  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64bfde6140f041d3835174d6009e02d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.867035  1668 tablet_service.cc:1511] Processing CreateTablet for tablet eecf06b378aa48e987bc3e69cad1acd0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:35.869323  1668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecf06b378aa48e987bc3e69cad1acd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.873349  1513 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0691a4d3494313af304064070cf2e4 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:35.886842  1846 raft_consensus.cc:493] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:35.888345  1846 raft_consensus.cc:515] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.890468  1846 leader_election.cc:290] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:35.869344  1742 tablet_service.cc:1511] Processing CreateTablet for tablet eecf06b378aa48e987bc3e69cad1acd0 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:35.893451  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:35.894098  1751 raft_consensus.cc:2468] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:35.895802  1794 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:35.895756  1642 leader_election.cc:304] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:35.896930  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:35.898438  1644 leader_election.cc:343] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:35.899585  1846 raft_consensus.cc:2804] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:35.900038  1846 raft_consensus.cc:493] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:35.900383  1846 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:35.902662  1742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecf06b378aa48e987bc3e69cad1acd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.905596  1796 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:35.906186  1796 ts_tablet_manager.cc:1403] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.182s	user 0.023s	sys 0.016s
I20260709 13:12:35.906374  1795 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:35.906890  1795 ts_tablet_manager.cc:1403] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.256s	user 0.015s	sys 0.011s
I20260709 13:12:35.909380  1796 raft_consensus.cc:359] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.909878  1795 raft_consensus.cc:359] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.910210  1796 raft_consensus.cc:385] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.910930  1795 raft_consensus.cc:385] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.910919  1796 raft_consensus.cc:740] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.911518  1795 raft_consensus.cc:740] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.912259  1796 consensus_queue.cc:260] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.912535  1795 consensus_queue.cc:260] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:35.910111  1846 raft_consensus.cc:515] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:35.914237  1797 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:35.914443  1795 ts_tablet_manager.cc:1434] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:35.914810  1797 ts_tablet_manager.cc:1403] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.013s
I20260709 13:12:35.915398  1795 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:35.915513  1846 leader_election.cc:290] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:35.916294  1794 tablet_bootstrap.cc:654] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:35.918574  1797 raft_consensus.cc:359] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.919653  1797 raft_consensus.cc:385] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:35.920006  1797 raft_consensus.cc:740] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:35.920765  1797 consensus_queue.cc:260] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:35.921525  1796 ts_tablet_manager.cc:1434] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:12:35.922627  1796 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:35.923401  1797 ts_tablet_manager.cc:1434] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.005s
I20260709 13:12:35.924474  1797 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:35.951665  1513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0691a4d3494313af304064070cf2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.973563  1517 tablet_service.cc:1511] Processing CreateTablet for tablet c105f80f46794d4c918b5380fdd165b3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:35.979624  1589 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0691a4d3494313af304064070cf2e4 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:35.982066  1589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0691a4d3494313af304064070cf2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.983604  1593 tablet_service.cc:1511] Processing CreateTablet for tablet c105f80f46794d4c918b5380fdd165b3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:35.984484  1663 tablet_service.cc:1511] Processing CreateTablet for tablet 0a0691a4d3494313af304064070cf2e4 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:35.987728  1666 tablet_service.cc:1511] Processing CreateTablet for tablet 827bdde8c8124516a8bf5558f04c5749 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:35.990653  1593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c105f80f46794d4c918b5380fdd165b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:35.992228  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:35.993491  1666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bdde8c8124516a8bf5558f04c5749. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:35.993835  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:35.994966  1644 leader_election.cc:343] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.001068  1663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a0691a4d3494313af304064070cf2e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.011221  1739 tablet_service.cc:1511] Processing CreateTablet for tablet c105f80f46794d4c918b5380fdd165b3 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:36.012863  1739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c105f80f46794d4c918b5380fdd165b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.013721  1514 tablet_service.cc:1511] Processing CreateTablet for tablet 827bdde8c8124516a8bf5558f04c5749 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:35.996865  1517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c105f80f46794d4c918b5380fdd165b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.015797  1514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bdde8c8124516a8bf5558f04c5749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.009168  1737 tablet_service.cc:1511] Processing CreateTablet for tablet 827bdde8c8124516a8bf5558f04c5749 (DEFAULT_TABLE table=test-workload [id=4bdb634bbf66485797cd521892ed19df]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:36.019855  1737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bdde8c8124516a8bf5558f04c5749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:36.048105  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.048925  1753 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.065111  1818 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.066313  1795 tablet_bootstrap.cc:654] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.065847  1818 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.066437  1753 raft_consensus.cc:2468] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:36.074378  1642 leader_election.cc:304] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:36.075675  1846 raft_consensus.cc:2804] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.078956  1875 raft_consensus.cc:493] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.079701  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:36.082481  1495 leader_election.cc:343] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.082726  1794 tablet_bootstrap.cc:492] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.079589  1875 raft_consensus.cc:515] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.083469  1794 ts_tablet_manager.cc:1403] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.188s	user 0.009s	sys 0.005s
I20260709 13:12:36.084367  1796 tablet_bootstrap.cc:654] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.085065  1875 leader_election.cc:290] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.086243  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.086738  1818 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.087014  1605 raft_consensus.cc:2468] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.088728  1644 leader_election.cc:304] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:36.090055  1875 raft_consensus.cc:2804] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.090409  1875 raft_consensus.cc:493] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.090767  1875 raft_consensus.cc:3060] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.100643  1797 tablet_bootstrap.cc:654] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.104290  1794 raft_consensus.cc:359] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.105227  1794 raft_consensus.cc:385] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.105587  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:36.108479  1642 leader_election.cc:343] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.108441  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.112614  1753 raft_consensus.cc:2468] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:36.110291  1846 raft_consensus.cc:697] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:36.113828  1795 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.114589  1795 ts_tablet_manager.cc:1403] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.199s	user 0.009s	sys 0.008s
I20260709 13:12:36.114615  1493 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:36.116466  1877 raft_consensus.cc:2804] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.116868  1877 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.117213  1877 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.118362  1860 consensus_queue.cc:1048] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.105576  1794 raft_consensus.cc:740] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.117218  1846 consensus_queue.cc:237] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.122952  1795 raft_consensus.cc:359] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.123265  1860 consensus_queue.cc:1048] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.123977  1795 raft_consensus.cc:385] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.123782  1794 consensus_queue.cc:260] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.124423  1795 raft_consensus.cc:740] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.125324  1795 consensus_queue.cc:260] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.130489  1795 ts_tablet_manager.cc:1434] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 13:12:36.132128  1795 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.132719  1794 ts_tablet_manager.cc:1434] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:12:36.146160  1794 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.156296  1796 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.157058  1796 ts_tablet_manager.cc:1403] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.235s	user 0.018s	sys 0.003s
I20260709 13:12:36.163884  1795 tablet_bootstrap.cc:654] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.165637  1796 raft_consensus.cc:359] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.163684  1875 raft_consensus.cc:515] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.171808  1877 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.172847  1875 leader_election.cc:290] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.175366  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.176044  1605 raft_consensus.cc:3060] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.166615  1796 raft_consensus.cc:385] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.181226  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.181885  1753 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.179414  1796 raft_consensus.cc:740] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.190747  1877 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.193331  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:36.194036  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
W20260709 13:12:36.196813  1495 leader_election.cc:343] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:36.197616  1642 leader_election.cc:343] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.199965  1794 tablet_bootstrap.cc:654] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.206818  1797 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.207517  1797 ts_tablet_manager.cc:1403] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.015s
I20260709 13:12:36.209213  1877 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.209625  1753 raft_consensus.cc:2468] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:36.191251  1796 consensus_queue.cc:260] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.210000  1877 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.210985  1493 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:36.212145  1875 raft_consensus.cc:493] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.212728  1875 raft_consensus.cc:515] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.214149  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.214676  1875 leader_election.cc:290] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.212278  1796 ts_tablet_manager.cc:1434] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:12:36.215354  1818 raft_consensus.cc:2804] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.215296  1604 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:36.216691  1818 raft_consensus.cc:697] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:36.217728  1818 consensus_queue.cc:237] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.218706  1795 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.219237  1795 ts_tablet_manager.cc:1403] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.003s
I20260709 13:12:36.220196  1495 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:36.220767  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.221547  1753 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.221657  1806 raft_consensus.cc:2804] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.222405  1806 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.222959  1806 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.223219  1642 leader_election.cc:304] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.224535  1846 raft_consensus.cc:2804] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.225056  1846 raft_consensus.cc:493] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.225320  1877 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.225531  1846 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.215461  1605 raft_consensus.cc:2468] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:36.221580  1796 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.227988  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.228628  1644 leader_election.cc:304] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:36.229566  1494 leader_election.cc:343] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.230587  1875 raft_consensus.cc:2804] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.231545  1875 raft_consensus.cc:697] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:36.232838  1875 consensus_queue.cc:237] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.238178  1795 raft_consensus.cc:359] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.238914  1795 raft_consensus.cc:385] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.221055  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:36.239203  1795 raft_consensus.cc:740] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.239457  1529 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.236747  1425 catalog_manager.cc:5697] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.244040  1795 consensus_queue.cc:260] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.225855  1797 raft_consensus.cc:359] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.245529  1797 raft_consensus.cc:385] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.245896  1797 raft_consensus.cc:740] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.246866  1797 consensus_queue.cc:260] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.249699  1795 ts_tablet_manager.cc:1434] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:12:36.251036  1795 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.251091  1796 tablet_bootstrap.cc:654] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.257488  1806 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.261101  1797 ts_tablet_manager.cc:1434] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.005s
I20260709 13:12:36.261389  1794 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.261478  1846 raft_consensus.cc:515] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.263495  1794 ts_tablet_manager.cc:1403] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.118s	user 0.007s	sys 0.022s
I20260709 13:12:36.267818  1797 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.277027  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.277384  1794 raft_consensus.cc:359] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.279350  1794 raft_consensus.cc:385] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.279640  1794 raft_consensus.cc:740] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.283270  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.284207  1753 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.285619  1795 tablet_bootstrap.cc:654] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.286598  1605 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.293823  1797 tablet_bootstrap.cc:654] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.298655  1753 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:36.301651  1642 leader_election.cc:304] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.302510  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:36.303134  1806 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.303095  1875 raft_consensus.cc:2804] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.305833  1875 raft_consensus.cc:697] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:36.305905  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:36.306960  1875 consensus_queue.cc:237] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:36.307561  1494 leader_election.cc:343] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.307829  1795 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.308440  1795 ts_tablet_manager.cc:1403] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.004s
I20260709 13:12:36.302654  1794 consensus_queue.cc:260] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.304677  1428 catalog_manager.cc:5697] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.313228  1794 ts_tablet_manager.cc:1434] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:12:36.314239  1794 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.305074  1529 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.304376  1846 leader_election.cc:290] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.320883  1794 tablet_bootstrap.cc:654] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.303720  1605 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:36.329011  1495 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:36.330943  1806 raft_consensus.cc:2804] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.331697  1806 raft_consensus.cc:697] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:36.331952  1426 catalog_manager.cc:5697] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.333165  1806 consensus_queue.cc:237] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.333985  1426 catalog_manager.cc:5697] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.337575  1795 raft_consensus.cc:359] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.338327  1795 raft_consensus.cc:385] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.338596  1795 raft_consensus.cc:740] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.342567  1795 consensus_queue.cc:260] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.335673  1529 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:36.346326  1795 ts_tablet_manager.cc:1434] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:12:36.347570  1795 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.351333  1797 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.352238  1797 ts_tablet_manager.cc:1403] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.000s
I20260709 13:12:36.353935  1795 tablet_bootstrap.cc:654] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.357180  1794 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.357827  1794 ts_tablet_manager.cc:1403] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.023s
I20260709 13:12:36.358177  1818 raft_consensus.cc:493] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.358789  1818 raft_consensus.cc:515] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.359344  1796 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.360034  1796 ts_tablet_manager.cc:1403] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.015s
I20260709 13:12:36.361274  1818 leader_election.cc:290] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.361042  1794 raft_consensus.cc:359] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.361845  1794 raft_consensus.cc:385] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.362161  1794 raft_consensus.cc:740] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.362895  1794 consensus_queue.cc:260] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.364041  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.364319  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b158c68a91e44e46bc65d09542c6ef0d" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.365136  1605 raft_consensus.cc:2393] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:36.366601  1494 leader_election.cc:304] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:36.366729  1797 raft_consensus.cc:359] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.367645  1797 raft_consensus.cc:385] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.368046  1797 raft_consensus.cc:740] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.368641  1794 ts_tablet_manager.cc:1434] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:36.368033  1796 raft_consensus.cc:359] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.369087  1796 raft_consensus.cc:385] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.369410  1796 raft_consensus.cc:740] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.369554  1797 consensus_queue.cc:260] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.370249  1796 consensus_queue.cc:260] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.372449  1796 ts_tablet_manager.cc:1434] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:36.372561  1797 ts_tablet_manager.cc:1434] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:36.373687  1796 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.373987  1797 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.376106  1794 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.381317  1797 tablet_bootstrap.cc:654] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.382413  1794 tablet_bootstrap.cc:654] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.367592  1806 raft_consensus.cc:3060] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.392231  1796 tablet_bootstrap.cc:654] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.395479  1806 raft_consensus.cc:2749] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.398571  1795 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.399101  1795 ts_tablet_manager.cc:1403] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.052s	user 0.005s	sys 0.015s
I20260709 13:12:36.399789  1797 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.400173  1797 ts_tablet_manager.cc:1403] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:12:36.402083  1795 raft_consensus.cc:359] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.402697  1795 raft_consensus.cc:385] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.402941  1795 raft_consensus.cc:740] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.403013  1797 raft_consensus.cc:359] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.403795  1797 raft_consensus.cc:385] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.404052  1797 raft_consensus.cc:740] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.404045  1795 consensus_queue.cc:260] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.404801  1794 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.405416  1794 ts_tablet_manager.cc:1403] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.004s
I20260709 13:12:36.405148  1797 consensus_queue.cc:260] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.406616  1795 ts_tablet_manager.cc:1434] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:36.407838  1795 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.408233  1794 raft_consensus.cc:359] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.408905  1794 raft_consensus.cc:385] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.409404  1794 raft_consensus.cc:740] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.408862  1428 catalog_manager.cc:5697] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.410104  1794 consensus_queue.cc:260] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.414748  1794 ts_tablet_manager.cc:1434] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:12:36.416373  1794 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.418799  1797 ts_tablet_manager.cc:1434] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:12:36.425642  1795 tablet_bootstrap.cc:654] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.429021  1794 tablet_bootstrap.cc:654] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.429728  1797 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.430369  1796 tablet_bootstrap.cc:492] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.430918  1796 ts_tablet_manager.cc:1403] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.001s
I20260709 13:12:36.435652  1796 raft_consensus.cc:359] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.436249  1796 raft_consensus.cc:385] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.436487  1796 raft_consensus.cc:740] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.437186  1796 consensus_queue.cc:260] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.439074  1796 ts_tablet_manager.cc:1434] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.001s
I20260709 13:12:36.440709  1796 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.441015  1794 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.441529  1794 ts_tablet_manager.cc:1403] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 13:12:36.438051  1797 tablet_bootstrap.cc:654] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.443960  1794 raft_consensus.cc:359] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.444653  1794 raft_consensus.cc:385] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.444940  1794 raft_consensus.cc:740] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.445633  1794 consensus_queue.cc:260] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.446923  1796 tablet_bootstrap.cc:654] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.448921  1795 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.450311  1794 ts_tablet_manager.cc:1434] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:36.451483  1794 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.458194  1795 ts_tablet_manager.cc:1403] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 13:12:36.458773  1796 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.459374  1796 ts_tablet_manager.cc:1403] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:12:36.462337  1794 tablet_bootstrap.cc:654] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.462304  1796 raft_consensus.cc:359] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.463292  1796 raft_consensus.cc:385] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.463635  1796 raft_consensus.cc:740] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.465111  1797 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.464656  1796 consensus_queue.cc:260] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.466600  1795 raft_consensus.cc:359] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.467581  1796 ts_tablet_manager.cc:1434] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:36.467937  1795 raft_consensus.cc:385] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.468386  1795 raft_consensus.cc:740] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.469301  1796 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.465818  1797 ts_tablet_manager.cc:1403] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.003s
I20260709 13:12:36.469187  1795 consensus_queue.cc:260] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.474650  1803 raft_consensus.cc:493] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.475268  1803 raft_consensus.cc:515] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.480111  1803 leader_election.cc:290] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.480139  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6195852602da44ef9cbb867e62b07bac" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:36.481010  1529 raft_consensus.cc:2468] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:36.481282  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6195852602da44ef9cbb867e62b07bac" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.481953  1678 raft_consensus.cc:2468] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:36.483146  1569 leader_election.cc:304] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:36.484052  1803 raft_consensus.cc:2804] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.484432  1803 raft_consensus.cc:493] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.484619  1796 tablet_bootstrap.cc:654] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.484794  1803 raft_consensus.cc:3060] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.490453  1797 raft_consensus.cc:359] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.491345  1797 raft_consensus.cc:385] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.491683  1797 raft_consensus.cc:740] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.492525  1797 consensus_queue.cc:260] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.492905  1803 raft_consensus.cc:515] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.495808  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6195852602da44ef9cbb867e62b07bac" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:36.496425  1529 raft_consensus.cc:3060] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.496296  1860 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.498610  1860 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.502048  1860 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.502974  1797 ts_tablet_manager.cc:1434] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.006s
I20260709 13:12:36.504477  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:36.504822  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.506098  1753 raft_consensus.cc:2393] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:36.507767  1794 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.508307  1794 ts_tablet_manager.cc:1403] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.004s
I20260709 13:12:36.509168  1568 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:36.512423  1529 raft_consensus.cc:2468] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:36.512729  1797 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.514708  1794 raft_consensus.cc:359] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.515414  1794 raft_consensus.cc:385] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.515678  1794 raft_consensus.cc:740] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.516383  1794 consensus_queue.cc:260] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.517511  1833 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.519901  1797 tablet_bootstrap.cc:654] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.525825  1875 consensus_queue.cc:1048] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.529096  1568 leader_election.cc:304] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:36.534137  1860 raft_consensus.cc:2804] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.546056  1803 leader_election.cc:290] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.548905  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6195852602da44ef9cbb867e62b07bac" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:36.549723  1679 raft_consensus.cc:3060] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.550273  1794 ts_tablet_manager.cc:1434] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:12:36.551499  1794 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.526943  1833 raft_consensus.cc:2749] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.558005  1795 ts_tablet_manager.cc:1434] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.099s	user 0.012s	sys 0.000s
I20260709 13:12:36.559424  1795 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.565465  1795 tablet_bootstrap.cc:654] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.565517  1833 raft_consensus.cc:493] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.566110  1833 raft_consensus.cc:515] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.569367  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.569655  1833 leader_election.cc:290] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.570856  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.572666  1568 leader_election.cc:304] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:36.574324  1833 raft_consensus.cc:2749] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.575232  1860 raft_consensus.cc:697] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:36.576658  1797 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.576290  1860 consensus_queue.cc:237] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.577212  1797 ts_tablet_manager.cc:1403] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.023s
I20260709 13:12:36.578708  1805 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.579248  1805 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.580449  1797 raft_consensus.cc:359] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.581259  1797 raft_consensus.cc:385] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.581563  1797 raft_consensus.cc:740] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.582067  1805 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.582657  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.582518  1797 consensus_queue.cc:260] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.583380  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:36.584267  1717 leader_election.cc:343] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:36.585073  1716 leader_election.cc:343] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.585384  1797 ts_tablet_manager.cc:1434] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:12:36.585587  1716 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:36.586674  1797 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.586565  1805 raft_consensus.cc:2749] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.573884  1679 raft_consensus.cc:2468] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:36.592931  1796 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.593457  1796 ts_tablet_manager.cc:1403] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.124s	user 0.031s	sys 0.028s
I20260709 13:12:36.593811  1797 tablet_bootstrap.cc:654] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.595732  1794 tablet_bootstrap.cc:654] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.595788  1795 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.597687  1795 ts_tablet_manager.cc:1403] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.001s
I20260709 13:12:36.604080  1795 raft_consensus.cc:359] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.604879  1795 raft_consensus.cc:385] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.605216  1795 raft_consensus.cc:740] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.605598  1605 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.605966  1795 consensus_queue.cc:260] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.608108  1796 raft_consensus.cc:359] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.609237  1796 raft_consensus.cc:385] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.610767  1751 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.613262  1797 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.609545  1796 raft_consensus.cc:740] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.613828  1797 ts_tablet_manager.cc:1403] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:12:36.619683  1796 consensus_queue.cc:260] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.621541  1878 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.622022  1878 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.618266  1797 raft_consensus.cc:359] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.622803  1797 raft_consensus.cc:385] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.623268  1797 raft_consensus.cc:740] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.624164  1878 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.624281  1797 consensus_queue.cc:260] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.625968  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.626194  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:36.626526  1796 ts_tablet_manager.cc:1434] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:12:36.626832  1604 raft_consensus.cc:2393] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:36.620370  1875 raft_consensus.cc:493] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.628280  1796 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.628298  1875 raft_consensus.cc:515] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.628239  1644 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:36.614545  1428 catalog_manager.cc:5697] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.631495  1846 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.632416  1860 raft_consensus.cc:493] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.633170  1860 raft_consensus.cc:515] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.636279  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.637006  1753 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.638166  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.638046  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.639041  1604 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.639274  1860 leader_election.cc:290] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.639005  1752 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:36.640528  1644 leader_election.cc:304] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:36.641112  1568 leader_election.cc:304] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.638044  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.642097  1679 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:36.642488  1860 raft_consensus.cc:2804] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.643595  1795 ts_tablet_manager.cc:1434] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:12:36.642932  1860 raft_consensus.cc:493] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.645831  1860 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.652561  1860 raft_consensus.cc:515] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.656013  1795 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.656536  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.657245  1752 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:36.657680  1910 log.cc:927] Time spent T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:12:36.656848  1878 raft_consensus.cc:2804] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.662266  1846 raft_consensus.cc:2749] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.662992  1860 leader_election.cc:290] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.630955  1875 leader_election.cc:290] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.663990  1797 ts_tablet_manager.cc:1434] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:12:36.665086  1795 tablet_bootstrap.cc:654] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.663262  1846 consensus_queue.cc:1048] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.663219  1878 raft_consensus.cc:493] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.670104  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:36.672452  1797 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.678246  1875 consensus_queue.cc:1048] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.677852  1796 tablet_bootstrap.cc:654] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.680253  1794 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:36.680830  1794 ts_tablet_manager.cc:1403] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.013s
I20260709 13:12:36.668855  1878 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.688517  1752 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:36.690096  1568 leader_election.cc:304] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.691020  1860 raft_consensus.cc:2804] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.691902  1860 raft_consensus.cc:697] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:36.692694  1846 consensus_queue.cc:1048] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.692937  1860 consensus_queue.cc:237] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.700703  1797 tablet_bootstrap.cc:654] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.706980  1794 raft_consensus.cc:359] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.707917  1794 raft_consensus.cc:385] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.708230  1794 raft_consensus.cc:740] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.708451  1818 consensus_queue.cc:1048] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.708971  1794 consensus_queue.cc:260] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.712108  1794 ts_tablet_manager.cc:1434] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:12:36.714566  1805 raft_consensus.cc:493] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.717586  1805 raft_consensus.cc:515] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.723851  1805 leader_election.cc:290] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.725418  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:36.726356  1530 raft_consensus.cc:2468] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:36.725540  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.727618  1678 raft_consensus.cc:2468] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:36.729210  1717 leader_election.cc:304] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.740597  1794 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:36.733856  1805 raft_consensus.cc:2804] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.742933  1805 raft_consensus.cc:493] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.743484  1805 raft_consensus.cc:3060] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.748355  1794 tablet_bootstrap.cc:654] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.748211  1806 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.748921  1806 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.750074  1796 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:36.750901  1796 ts_tablet_manager.cc:1403] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.123s	user 0.027s	sys 0.013s
I20260709 13:12:36.734074  1878 raft_consensus.cc:515] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.750742  1818 consensus_queue.cc:1048] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:36.765496  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.767624  1751 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:36.768440  1805 raft_consensus.cc:515] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.769371  1493 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:36.770839  1805 leader_election.cc:290] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:36.775575  1796 raft_consensus.cc:359] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.779726  1796 raft_consensus.cc:385] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.780154  1796 raft_consensus.cc:740] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.782972  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:36.783679  1529 raft_consensus.cc:3060] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.783408  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec3c6f8fd494b03a01e4794bf69e59f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:36.784411  1677 raft_consensus.cc:3060] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.784932  1796 consensus_queue.cc:260] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.787403  1796 ts_tablet_manager.cc:1434] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:12:36.788496  1796 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:36.788712  1878 leader_election.cc:290] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.790565  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.784430  1795 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:36.791533  1751 raft_consensus.cc:2393] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:36.791712  1795 ts_tablet_manager.cc:1403] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.005s
I20260709 13:12:36.777040  1806 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.793115  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.795152  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.795889  1604 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:36.797582  1679 raft_consensus.cc:2393] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:36.797005  1795 raft_consensus.cc:359] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.798280  1795 raft_consensus.cc:385] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.798750  1795 raft_consensus.cc:740] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.799998  1795 consensus_queue.cc:260] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:36.798859  1644 leader_election.cc:304] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:36.808970  1529 raft_consensus.cc:2468] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:36.811154  1716 leader_election.cc:304] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:36.812682  1868 raft_consensus.cc:2804] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.814589  1806 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.815326  1806 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.824607  1806 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.824539  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.826185  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:36.826509  1494 leader_election.cc:343] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.826992  1602 raft_consensus.cc:2468] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:36.776551  1877 raft_consensus.cc:2804] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.837672  1495 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:36.829670  1878 raft_consensus.cc:2749] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:36.830178  1877 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.854635  1923 raft_consensus.cc:2804] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.855274  1923 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.855682  1923 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.852012  1877 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.862828  1795 ts_tablet_manager.cc:1434] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.004s
I20260709 13:12:36.863554  1868 raft_consensus.cc:697] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:36.874325  1868 consensus_queue.cc:237] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:36.865520  1493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 95669.3us
I20260709 13:12:36.879971  1797 tablet_bootstrap.cc:492] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.880196  1677 raft_consensus.cc:2468] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:36.880511  1797 ts_tablet_manager.cc:1403] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.208s	user 0.039s	sys 0.042s
I20260709 13:12:36.883682  1797 raft_consensus.cc:359] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.884424  1797 raft_consensus.cc:385] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.884737  1797 raft_consensus.cc:740] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.885128  1877 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.887682  1877 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:36.888304  1797 consensus_queue.cc:260] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.890093  1796 tablet_bootstrap.cc:654] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.890473  1797 ts_tablet_manager.cc:1434] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:36.892822  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.893739  1604 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.896057  1806 consensus_queue.cc:1048] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:36.896284  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:36.897040  1751 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.899562  1878 raft_consensus.cc:493] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.900210  1878 raft_consensus.cc:515] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.896054  1797 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.902426  1806 consensus_queue.cc:1048] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.903111  1878 leader_election.cc:290] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:36.905380  1878 consensus_queue.cc:1048] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.906427  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:36.907366  1753 raft_consensus.cc:2468] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.908998  1642 leader_election.cc:304] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:36.909288  1797 tablet_bootstrap.cc:654] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.910053  1846 raft_consensus.cc:2804] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:36.910526  1846 raft_consensus.cc:493] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:36.910959  1846 raft_consensus.cc:3060] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.911895  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:36.912906  1603 raft_consensus.cc:2468] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:36.921670  1797 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:36.922309  1797 ts_tablet_manager.cc:1403] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:12:36.894729  1923 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:36.927748  1913 consensus_queue.cc:1048] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:36.929302  1927 raft_consensus.cc:493] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:36.930287  1927 raft_consensus.cc:515] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.931751  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.936465  1603 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.937274  1797 raft_consensus.cc:359] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.938253  1797 raft_consensus.cc:385] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:36.938562  1797 raft_consensus.cc:740] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:36.934048  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
W20260709 13:12:36.941774  1494 leader_election.cc:343] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:36.939337  1797 consensus_queue.cc:260] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:36.941743  1795 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:36.945564  1797 ts_tablet_manager.cc:1434] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:12:36.946913  1797 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:36.948490  1846 raft_consensus.cc:515] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:36.931128  1751 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:36.953714  1493 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:36.954826  1877 raft_consensus.cc:2804] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:36.965860  1923 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.979912  1795 tablet_bootstrap.cc:654] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:36.982750  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:36.983625  1601 raft_consensus.cc:3060] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:36.990568  1425 catalog_manager.cc:5697] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:36.993037  1927 leader_election.cc:290] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:36.994452  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:36.995438  1677 raft_consensus.cc:2393] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81b721300bd34373862d7937c3bf394a in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:36.996990  1601 raft_consensus.cc:2468] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:36.997656  1604 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:36.976128  1877 raft_consensus.cc:697] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:37.011365  1644 leader_election.cc:304] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:37.012617  1878 raft_consensus.cc:2804] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.013159  1878 raft_consensus.cc:697] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:37.013394  1797 tablet_bootstrap.cc:654] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.014119  1878 consensus_queue.cc:237] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.020581  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:37.021394  1751 raft_consensus.cc:3060] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.023281  1818 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.023852  1818 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.028803  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.029599  1750 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:37.029893  1818 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.006361  1846 leader_election.cc:290] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.036847  1751 raft_consensus.cc:2468] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:37.030830  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.042268  1493 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.045526  1877 consensus_queue.cc:237] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.042601  1677 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:37.048836  1806 raft_consensus.cc:2804] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.050029  1806 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.053596  1806 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.061088  1795 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.061781  1795 ts_tablet_manager.cc:1403] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.005s
I20260709 13:12:37.065264  1795 raft_consensus.cc:359] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.067255  1795 raft_consensus.cc:385] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.067927  1795 raft_consensus.cc:740] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.072013  1806 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.073243  1794 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:37.076051  1794 ts_tablet_manager.cc:1403] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.345s	user 0.020s	sys 0.017s
I20260709 13:12:37.083555  1795 consensus_queue.cc:260] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.086833  1907 consensus_queue.cc:1048] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:37.108249  1795 ts_tablet_manager.cc:1434] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:12:37.112577  1933 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.113196  1933 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:37.115447  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:37.116626  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.117975  1796 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:37.118517  1796 ts_tablet_manager.cc:1403] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.330s	user 0.011s	sys 0.011s
W20260709 13:12:37.118618  1717 leader_election.cc:343] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.124419  1833 consensus_queue.cc:1048] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.135076  1795 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.135866  1933 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:37.142640  1806 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.138540  1796 raft_consensus.cc:359] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.144332  1796 raft_consensus.cc:385] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.144690  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:37.153613  1603 raft_consensus.cc:2468] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
W20260709 13:12:37.156574  1716 leader_election.cc:343] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.158181  1797 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:37.158730  1797 ts_tablet_manager.cc:1403] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.028s
I20260709 13:12:37.160784  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:37.161459  1679 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.161906  1797 raft_consensus.cc:359] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.162660  1797 raft_consensus.cc:385] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.144781  1796 raft_consensus.cc:740] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.157456  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:37.163314  1795 tablet_bootstrap.cc:654] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.163602  1751 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.162937  1797 raft_consensus.cc:740] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.166762  1796 consensus_queue.cc:260] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.167889  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d2a7145e324ea3a64b9ae40643e923" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.168040  1797 consensus_queue.cc:260] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.168926  1933 raft_consensus.cc:493] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.172668  1797 ts_tablet_manager.cc:1434] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:12:37.177232  1933 raft_consensus.cc:515] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.182430  1933 leader_election.cc:290] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:37.183020  1603 raft_consensus.cc:2393] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81b721300bd34373862d7937c3bf394a in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:37.168030  1495 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:37.184477  1877 raft_consensus.cc:2804] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.185017  1877 raft_consensus.cc:697] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:37.189245  1797 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:37.189096  1877 consensus_queue.cc:237] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.185231  1718 leader_election.cc:304] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:37.196755  1794 raft_consensus.cc:359] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.197567  1794 raft_consensus.cc:385] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.197903  1794 raft_consensus.cc:740] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.198670  1794 consensus_queue.cc:260] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.199525  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dfeb0bf60e419a808cb054b8a99ebe" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.200023  1833 consensus_queue.cc:1048] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.158193  1716 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:37.200757  1796 ts_tablet_manager.cc:1434] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.005s
W20260709 13:12:37.201260  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 44752.2us
I20260709 13:12:37.203008  1936 raft_consensus.cc:2749] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.197139  1933 raft_consensus.cc:2749] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.203408  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dfeb0bf60e419a808cb054b8a99ebe" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:37.204133  1528 raft_consensus.cc:2468] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:37.200275  1603 raft_consensus.cc:2468] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:37.205853  1716 leader_election.cc:304] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.202134  1796 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:37.207334  1927 raft_consensus.cc:2804] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.215499  1927 raft_consensus.cc:493] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.217065  1927 raft_consensus.cc:3060] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.217489  1794 ts_tablet_manager.cc:1434] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.002s
I20260709 13:12:37.225625  1679 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:37.242982  1426 catalog_manager.cc:5697] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.244623  1425 catalog_manager.cc:5697] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.258984  1794 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:37.262653  1795 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.263293  1795 ts_tablet_manager.cc:1403] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.000s
I20260709 13:12:37.264669  1794 tablet_bootstrap.cc:654] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.265133  1797 tablet_bootstrap.cc:654] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.268808  1795 raft_consensus.cc:359] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.269654  1796 tablet_bootstrap.cc:654] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.269608  1795 raft_consensus.cc:385] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.270117  1795 raft_consensus.cc:740] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.270880  1795 consensus_queue.cc:260] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.273154  1795 ts_tablet_manager.cc:1434] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:37.274557  1795 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.277602  1494 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.278594  1877 raft_consensus.cc:2804] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.279101  1877 raft_consensus.cc:697] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:37.280133  1751 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:37.291761  1877 consensus_queue.cc:237] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.311506  1933 consensus_queue.cc:1048] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:37.315074  1927 raft_consensus.cc:515] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.324360  1927 leader_election.cc:290] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:37.324888  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dfeb0bf60e419a808cb054b8a99ebe" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:37.325367  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7dfeb0bf60e419a808cb054b8a99ebe" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:37.325567  1529 raft_consensus.cc:3060] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.325958  1603 raft_consensus.cc:3060] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.329437  1833 consensus_queue.cc:1048] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.332844  1529 raft_consensus.cc:2468] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:37.334877  1716 leader_election.cc:304] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.339989  1927 raft_consensus.cc:2804] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.340435  1794 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:37.341420  1794 ts_tablet_manager.cc:1403] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.004s
I20260709 13:12:37.341768  1927 raft_consensus.cc:697] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:37.332875  1603 raft_consensus.cc:2468] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:37.343881  1795 tablet_bootstrap.cc:654] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.347731  1794 raft_consensus.cc:359] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.349936  1794 raft_consensus.cc:385] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.350337  1794 raft_consensus.cc:740] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.352969  1796 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:37.353751  1796 ts_tablet_manager.cc:1403] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.152s	user 0.035s	sys 0.037s
I20260709 13:12:37.342708  1927 consensus_queue.cc:237] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:37.349334  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 96401.6us
I20260709 13:12:37.358204  1925 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.358955  1925 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.361686  1925 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.362958  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.365024  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.365805  1752 raft_consensus.cc:2468] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
W20260709 13:12:37.367089  1494 leader_election.cc:343] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.367767  1796 raft_consensus.cc:359] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.368155  1493 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:37.369098  1877 raft_consensus.cc:2804] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.369556  1877 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.369148  1794 consensus_queue.cc:260] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.369871  1877 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.368520  1796 raft_consensus.cc:385] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.373639  1796 raft_consensus.cc:740] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.379698  1877 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.377352  1428 catalog_manager.cc:5697] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.383709  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:37.384871  1877 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.386577  1797 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:37.387122  1797 ts_tablet_manager.cc:1403] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.008s
I20260709 13:12:37.389571  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:37.389905  1794 ts_tablet_manager.cc:1434] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.003s
I20260709 13:12:37.390311  1752 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.391073  1794 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:37.381003  1796 consensus_queue.cc:260] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.394121  1796 ts_tablet_manager.cc:1434] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:12:37.395081  1805 consensus_queue.cc:1048] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.395355  1797 raft_consensus.cc:359] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.396148  1797 raft_consensus.cc:385] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.396450  1797 raft_consensus.cc:740] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.397286  1797 consensus_queue.cc:260] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.399324  1679 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.407053  1797 ts_tablet_manager.cc:1434] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:37.407058  1752 raft_consensus.cc:2468] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:37.395104  1796 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:37.408447  1797 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:37.413722  1426 catalog_manager.cc:5697] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.418445  1426 catalog_manager.cc:5697] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.420118  1796 tablet_bootstrap.cc:654] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.400282  1794 tablet_bootstrap.cc:654] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.430882  1493 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.432158  1877 raft_consensus.cc:2804] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.432685  1877 raft_consensus.cc:697] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:37.433527  1877 consensus_queue.cc:237] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.437997  1878 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.438649  1878 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.439507  1795 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.440048  1795 ts_tablet_manager.cc:1403] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.011s
I20260709 13:12:37.441103  1878 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:37.443480  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.444722  1603 raft_consensus.cc:2393] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:37.447551  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:37.444984  1795 raft_consensus.cc:359] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.452497  1795 raft_consensus.cc:385] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.452791  1795 raft_consensus.cc:740] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.451754  1846 consensus_queue.cc:1048] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:37.450912  1642 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:37.455540  1795 consensus_queue.cc:260] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.468605  1797 tablet_bootstrap.cc:654] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.464370  1846 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.472808  1795 ts_tablet_manager.cc:1434] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:12:37.457530  1679 raft_consensus.cc:2468] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:37.484323  1796 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:37.484874  1796 ts_tablet_manager.cc:1403] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.001s
I20260709 13:12:37.488469  1796 raft_consensus.cc:359] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.489151  1796 raft_consensus.cc:385] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.489428  1796 raft_consensus.cc:740] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.489770  1846 raft_consensus.cc:2749] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.492133  1795 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.491132  1796 consensus_queue.cc:260] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.498708  1795 tablet_bootstrap.cc:654] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.499987  1426 catalog_manager.cc:5697] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.508746  1794 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:37.509363  1794 ts_tablet_manager.cc:1403] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.012s
I20260709 13:12:37.512362  1794 raft_consensus.cc:359] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.513207  1794 raft_consensus.cc:385] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.513576  1794 raft_consensus.cc:740] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.515352  1796 ts_tablet_manager.cc:1434] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:12:37.515014  1846 consensus_queue.cc:1048] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.501899  1425 catalog_manager.cc:5697] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.515875  1794 consensus_queue.cc:260] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.519852  1794 ts_tablet_manager.cc:1434] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:12:37.527421  1794 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:37.528321  1796 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:37.538628  1797 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:37.539294  1794 tablet_bootstrap.cc:654] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.539232  1797 ts_tablet_manager.cc:1403] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.014s
I20260709 13:12:37.545634  1797 raft_consensus.cc:359] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.546350  1797 raft_consensus.cc:385] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.546614  1797 raft_consensus.cc:740] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.547412  1797 consensus_queue.cc:260] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.549755  1797 ts_tablet_manager.cc:1434] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:37.551004  1797 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:37.552739  1795 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.553257  1795 ts_tablet_manager.cc:1403] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.012s
I20260709 13:12:37.555984  1795 raft_consensus.cc:359] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.556632  1795 raft_consensus.cc:385] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.556903  1795 raft_consensus.cc:740] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.560431  1877 consensus_queue.cc:1048] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.560490  1795 consensus_queue.cc:260] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.561415  1797 tablet_bootstrap.cc:654] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.562857  1795 ts_tablet_manager.cc:1434] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:12:37.564324  1795 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.566562  1796 tablet_bootstrap.cc:654] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.568560  1927 raft_consensus.cc:493] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.569064  1927 raft_consensus.cc:515] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.570755  1795 tablet_bootstrap.cc:654] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.575955  1806 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.576429  1797 tablet_bootstrap.cc:492] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:37.576921  1797 ts_tablet_manager.cc:1403] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.008s
I20260709 13:12:37.576642  1806 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.580018  1927 leader_election.cc:290] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:37.581221  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.581924  1605 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:37.582352  1796 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:37.583058  1796 ts_tablet_manager.cc:1403] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.006s
I20260709 13:12:37.584275  1495 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:37.585319  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.585772  1796 raft_consensus.cc:359] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.586447  1796 raft_consensus.cc:385] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.586709  1796 raft_consensus.cc:740] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.587661  1877 raft_consensus.cc:2804] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.588207  1877 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.588618  1877 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.590657  1796 consensus_queue.cc:260] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.591859  1679 raft_consensus.cc:2468] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:37.592806  1797 raft_consensus.cc:359] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.593312  1846 raft_consensus.cc:493] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.593647  1717 leader_election.cc:304] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:37.594056  1846 raft_consensus.cc:515] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.594569  1927 raft_consensus.cc:2804] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.593509  1797 raft_consensus.cc:385] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.594952  1927 raft_consensus.cc:493] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.595047  1797 raft_consensus.cc:740] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.595468  1927 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.597281  1796 ts_tablet_manager.cc:1434] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:37.597252  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356632bab23f4101862a3ce673ca5d8c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.598064  1605 raft_consensus.cc:2468] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:37.599064  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356632bab23f4101862a3ce673ca5d8c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.596169  1846 leader_election.cc:290] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.600090  1644 leader_election.cc:304] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:37.600929  1846 raft_consensus.cc:2804] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.601302  1846 raft_consensus.cc:493] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.601347  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.601790  1846 raft_consensus.cc:3060] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.601598  1925 consensus_queue.cc:1048] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.602806  1796 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
W20260709 13:12:37.604565  1494 leader_election.cc:343] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.605216  1806 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:37.605875  1795 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.606454  1795 ts_tablet_manager.cc:1403] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.019s
I20260709 13:12:37.609426  1795 raft_consensus.cc:359] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.610088  1795 raft_consensus.cc:385] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.610348  1795 raft_consensus.cc:740] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.611006  1795 consensus_queue.cc:260] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.612222  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:37.615263  1718 leader_election.cc:343] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.602744  1927 raft_consensus.cc:515] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.612622  1938 consensus_queue.cc:1048] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.612640  1795 ts_tablet_manager.cc:1434] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:37.617988  1795 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.619728  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:37.620524  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:37.621033  1927 leader_election.cc:290] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:37.621170  1679 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.622848  1718 leader_election.cc:343] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.624110  1795 tablet_bootstrap.cc:654] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.645037  1806 raft_consensus.cc:493] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.646006  1806 raft_consensus.cc:515] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.646008  1679 raft_consensus.cc:2468] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:37.645303  1796 tablet_bootstrap.cc:654] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.655603  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.595985  1797 consensus_queue.cc:260] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.660528  1751 raft_consensus.cc:2468] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
W20260709 13:12:37.661444  1495 leader_election.cc:343] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.663793  1797 ts_tablet_manager.cc:1434] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.004s
I20260709 13:12:37.670264  1797 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:37.674039  1806 leader_election.cc:290] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:37.674356  1794 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:37.688194  1925 consensus_queue.cc:1048] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.688576  1794 ts_tablet_manager.cc:1403] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.005s
I20260709 13:12:37.692775  1794 raft_consensus.cc:359] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.693773  1794 raft_consensus.cc:385] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.694149  1794 raft_consensus.cc:740] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.695290  1794 consensus_queue.cc:260] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.700125  1794 ts_tablet_manager.cc:1434] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:12:37.701223  1717 leader_election.cc:304] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:37.702338  1794 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:37.702885  1927 raft_consensus.cc:2804] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.703716  1927 raft_consensus.cc:697] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:37.704890  1927 consensus_queue.cc:237] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.712244  1797 tablet_bootstrap.cc:654] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.681174  1877 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.682225  1981 consensus_queue.cc:1048] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.683950  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.684698  1846 raft_consensus.cc:515] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.717667  1846 leader_election.cc:290] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.721212  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356632bab23f4101862a3ce673ca5d8c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:37.721545  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "356632bab23f4101862a3ce673ca5d8c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:37.722098  1605 raft_consensus.cc:3060] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.721925  1494 leader_election.cc:343] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.721946  1751 raft_consensus.cc:3060] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.723040  1494 leader_election.cc:304] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:37.739125  1751 raft_consensus.cc:2468] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:37.752914  1833 raft_consensus.cc:493] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.753064  1982 raft_consensus.cc:2749] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:37.753728  1833 raft_consensus.cc:515] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.758549  1794 tablet_bootstrap.cc:654] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.762812  1796 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:37.763440  1796 ts_tablet_manager.cc:1403] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.161s	user 0.012s	sys 0.000s
I20260709 13:12:37.763880  1797 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:37.764561  1797 ts_tablet_manager.cc:1403] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.011s
I20260709 13:12:37.766003  1796 raft_consensus.cc:359] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.766707  1796 raft_consensus.cc:385] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.766973  1796 raft_consensus.cc:740] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.768335  1796 consensus_queue.cc:260] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.768347  1797 raft_consensus.cc:359] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.776535  1797 raft_consensus.cc:385] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.777065  1797 raft_consensus.cc:740] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.778440  1797 consensus_queue.cc:260] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.758306  1642 leader_election.cc:304] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:37.783113  1796 ts_tablet_manager.cc:1434] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:12:37.768589  1982 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.811939  1982 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.803751  1797 ts_tablet_manager.cc:1434] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 13:12:37.790356  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:37.770243  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:37.808252  1805 consensus_queue.cc:1048] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.787768  1833 leader_election.cc:290] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:37.788385  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.825222  1806 consensus_queue.cc:1048] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:37.836621  1751 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:37.822845  1982 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.814683  1877 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:37.821692  1875 raft_consensus.cc:2804] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.839638  1875 raft_consensus.cc:697] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
W20260709 13:12:37.841845  1985 log.cc:927] Time spent T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:37.841084  1875 consensus_queue.cc:237] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:37.786957  1605 raft_consensus.cc:2468] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:37.845954  1796 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:37.826721  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.847307  1795 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.847527  1750 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:37.847849  1795 ts_tablet_manager.cc:1403] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.230s	user 0.059s	sys 0.068s
I20260709 13:12:37.829712  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.821732  1602 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.833091  1568 leader_election.cc:343] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.850867  1795 raft_consensus.cc:359] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.851267  1568 leader_election.cc:304] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:37.851728  1795 raft_consensus.cc:385] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.852110  1795 raft_consensus.cc:740] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.835539  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
W20260709 13:12:37.820935  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 65629us
I20260709 13:12:37.853101  1833 raft_consensus.cc:2804] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.853515  1833 raft_consensus.cc:493] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.853863  1833 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:37.853963  1494 leader_election.cc:343] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:37.854796  1494 leader_election.cc:343] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.855506  1868 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.856143  1868 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.859372  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:37.860018  1795 consensus_queue.cc:260] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:37.861156  1717 leader_election.cc:343] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.862159  1493 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:37.863734  1938 raft_consensus.cc:2804] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:37.859289  1868 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:37.864122  1795 ts_tablet_manager.cc:1434] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:37.865675  1795 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:37.867604  1797 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:37.868362  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:37.864197  1938 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:37.869493  1938 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.888185  1795 tablet_bootstrap.cc:654] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.910032  1794 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:37.910526  1794 ts_tablet_manager.cc:1403] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.209s	user 0.023s	sys 0.007s
I20260709 13:12:37.911401  1796 tablet_bootstrap.cc:654] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.914062  1833 raft_consensus.cc:515] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.919869  1602 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:37.922843  1794 raft_consensus.cc:359] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.923620  1794 raft_consensus.cc:385] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:37.923907  1794 raft_consensus.cc:740] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:37.924563  1495 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:37.925537  1794 consensus_queue.cc:260] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.927282  1982 raft_consensus.cc:2804] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:37.927804  1982 raft_consensus.cc:697] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:37.928711  1982 consensus_queue.cc:237] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:37.930836  1988 raft_consensus.cc:493] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:37.931600  1988 raft_consensus.cc:515] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:37.936208  1988 leader_election.cc:290] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:37.941596  1833 leader_election.cc:290] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:37.942993  1797 tablet_bootstrap.cc:654] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:37.931586  1938 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:37.947299  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:37.954012  1603 raft_consensus.cc:2393] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:37.947299  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:37.958346  1750 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:37.959860  1493 leader_election.cc:304] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:37.957785  1425 catalog_manager.cc:5697] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.961560  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:37.962502  1528 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.967849  1795 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:37.968391  1795 ts_tablet_manager.cc:1403] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.000s
I20260709 13:12:37.964797  1529 raft_consensus.cc:2393] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 81b721300bd34373862d7937c3bf394a in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:37.976219  1428 catalog_manager.cc:5697] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:37.982203  1794 ts_tablet_manager.cc:1434] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.004s
I20260709 13:12:37.983779  1868 consensus_queue.cc:1048] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.986752  1716 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:37.988554  1936 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:37.991431  1981 consensus_queue.cc:1048] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:37.993235  1938 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:37.995962  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
W20260709 13:12:38.002135  1494 leader_election.cc:343] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:37.984869  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:38.005152  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:38.004580  1750 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.009912  1528 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:38.010664  1988 raft_consensus.cc:2764] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:38.011725  1568 leader_election.cc:304] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:38.011690  1795 raft_consensus.cc:359] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.012692  1795 raft_consensus.cc:385] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.013074  1795 raft_consensus.cc:740] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.013378  1996 raft_consensus.cc:2804] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.013926  1996 raft_consensus.cc:697] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:38.014056  1795 consensus_queue.cc:260] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.018448  1936 raft_consensus.cc:2749] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.014784  1996 consensus_queue.cc:237] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.024950  1794 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:38.036721  1425 catalog_manager.cc:5697] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.040412  1795 ts_tablet_manager.cc:1434] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.000s
I20260709 13:12:38.038098  1833 raft_consensus.cc:493] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.042555  1833 raft_consensus.cc:515] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.044097  1796 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:38.044625  1796 ts_tablet_manager.cc:1403] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.006s
I20260709 13:12:38.047519  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:38.048794  1677 raft_consensus.cc:2468] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:38.050621  1794 tablet_bootstrap.cc:654] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.051254  1797 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:38.052032  1797 ts_tablet_manager.cc:1403] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.185s	user 0.019s	sys 0.006s
I20260709 13:12:38.053012  1796 raft_consensus.cc:359] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.053539  1796 raft_consensus.cc:385] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.053754  1796 raft_consensus.cc:740] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.047102  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:38.038336  1988 consensus_queue.cc:1048] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:12:38.056977  1795 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:38.048375  1833 leader_election.cc:290] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:38.056077  1569 leader_election.cc:304] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:38.060705  1833 raft_consensus.cc:2804] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.061548  1833 raft_consensus.cc:493] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.061928  1833 raft_consensus.cc:3060] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.064630  1750 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:38.066804  1528 raft_consensus.cc:2468] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:38.057935  1796 consensus_queue.cc:260] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.080232  1797 raft_consensus.cc:359] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.082564  1797 raft_consensus.cc:385] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.082830  1797 raft_consensus.cc:740] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.083465  1797 consensus_queue.cc:260] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.085806  1797 ts_tablet_manager.cc:1434] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:12:38.086194  1751 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:38.086848  1797 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:38.087343  1833 raft_consensus.cc:515] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.090629  1493 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:38.094322  1796 ts_tablet_manager.cc:1434] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:38.094970  1938 raft_consensus.cc:2804] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.095546  1796 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:38.095604  1938 raft_consensus.cc:697] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:38.096647  1938 consensus_queue.cc:237] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.111442  1797 tablet_bootstrap.cc:654] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.113175  1936 consensus_queue.cc:1048] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.118044  1795 tablet_bootstrap.cc:654] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.121799  1833 leader_election.cc:290] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:38.123915  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:38.124662  1528 raft_consensus.cc:3060] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.129616  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77a28753d4848a3880e7b8e19c7c253" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:38.130442  1676 raft_consensus.cc:3060] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.145155  1796 tablet_bootstrap.cc:654] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.144730  1428 catalog_manager.cc:5697] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.153203  1676 raft_consensus.cc:2468] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
W20260709 13:12:38.154655  1718 consensus_peers.cc:597] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:38.154615  1569 leader_election.cc:304] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:38.151037  1528 raft_consensus.cc:2468] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:38.155973  1996 raft_consensus.cc:2804] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.156689  1996 raft_consensus.cc:697] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:38.157652  1996 consensus_queue.cc:237] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.169305  1875 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.170049  1875 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.177382  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:38.178615  1602 raft_consensus.cc:2393] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:38.181318  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:38.183241  1875 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:38.191890  1644 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:38.199466  1875 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.214238  1875 raft_consensus.cc:2749] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.256388  1868 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.257120  1868 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.260959  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:38.263157  1716 leader_election.cc:343] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.265595  1868 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:38.265930  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:38.267959  1718 leader_election.cc:343] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.268640  1718 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:38.271005  1868 raft_consensus.cc:2749] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.289024  1794 tablet_bootstrap.cc:492] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:38.289546  1794 ts_tablet_manager.cc:1403] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.265s	user 0.024s	sys 0.034s
I20260709 13:12:38.292184  1795 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:38.291790  1428 catalog_manager.cc:5697] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.292300  1794 raft_consensus.cc:359] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.292825  1795 ts_tablet_manager.cc:1403] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.046s
I20260709 13:12:38.293015  1794 raft_consensus.cc:385] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.293361  1794 raft_consensus.cc:740] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.296070  1795 raft_consensus.cc:359] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.297287  1794 consensus_queue.cc:260] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.297884  1795 raft_consensus.cc:385] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.298288  1795 raft_consensus.cc:740] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.299150  1795 consensus_queue.cc:260] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.300957  1794 ts_tablet_manager.cc:1434] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:12:38.301481  1795 ts_tablet_manager.cc:1434] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:38.301570  1425 catalog_manager.cc:5697] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.307034  1797 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:38.305676  1875 consensus_queue.cc:1048] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:38.309777  1796 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:38.313274  1796 ts_tablet_manager.cc:1403] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.218s	user 0.025s	sys 0.034s
I20260709 13:12:38.316004  1796 raft_consensus.cc:359] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.316679  1796 raft_consensus.cc:385] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.316951  1796 raft_consensus.cc:740] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.312740  1797 ts_tablet_manager.cc:1403] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.226s	user 0.021s	sys 0.040s
I20260709 13:12:38.304543  1794 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:38.321424  1797 raft_consensus.cc:359] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.322175  1797 raft_consensus.cc:385] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.322454  1797 raft_consensus.cc:740] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.325975  1913 consensus_queue.cc:1048] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.326422  1797 consensus_queue.cc:260] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.328882  1797 ts_tablet_manager.cc:1434] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:38.330011  1797 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:38.331427  1796 consensus_queue.cc:260] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.342907  1796 ts_tablet_manager.cc:1434] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:38.344003  1796 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:38.349824  1794 tablet_bootstrap.cc:654] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.351199  1795 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:38.353824  1797 tablet_bootstrap.cc:654] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:38.359930  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:38.361966  1796 tablet_bootstrap.cc:654] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.365743  1795 tablet_bootstrap.cc:654] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.371253  1797 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:38.371907  1797 ts_tablet_manager.cc:1403] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 13:12:38.374856  1797 raft_consensus.cc:359] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.375705  1797 raft_consensus.cc:385] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.378098  1797 raft_consensus.cc:740] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.377817  1796 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:38.379061  1796 ts_tablet_manager.cc:1403] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.003s
I20260709 13:12:38.388361  1797 consensus_queue.cc:260] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.392077  1797 ts_tablet_manager.cc:1434] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:38.395126  1797 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:38.395932  1794 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:38.396698  1794 ts_tablet_manager.cc:1403] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.013s
I20260709 13:12:38.389720  1796 raft_consensus.cc:359] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.397209  1796 raft_consensus.cc:385] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.397557  1796 raft_consensus.cc:740] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.400484  1796 consensus_queue.cc:260] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.402904  1796 ts_tablet_manager.cc:1434] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 13:12:38.408164  1796 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:38.409677  1794 raft_consensus.cc:359] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.410439  1794 raft_consensus.cc:385] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.410713  1794 raft_consensus.cc:740] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.411427  1794 consensus_queue.cc:260] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.420221  1794 ts_tablet_manager.cc:1434] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.008s
I20260709 13:12:38.423039  1797 tablet_bootstrap.cc:654] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.423641  1794 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:38.421867  1795 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:38.426657  1795 ts_tablet_manager.cc:1403] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.008s
I20260709 13:12:38.429863  1795 raft_consensus.cc:359] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.430747  1795 raft_consensus.cc:385] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.431268  1795 raft_consensus.cc:740] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.431762  1982 raft_consensus.cc:493] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.431991  1796 tablet_bootstrap.cc:654] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.433787  1982 raft_consensus.cc:515] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.432591  1794 tablet_bootstrap.cc:654] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.441063  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:38.441849  1752 raft_consensus.cc:2468] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:38.443192  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:38.444341  1796 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:38.445166  1982 leader_election.cc:290] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
W20260709 13:12:38.449115  1494 leader_election.cc:343] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.450901  1493 leader_election.cc:304] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:38.453656  1794 tablet_bootstrap.cc:492] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:38.454493  1794 ts_tablet_manager.cc:1403] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.005s
I20260709 13:12:38.445158  1796 ts_tablet_manager.cc:1403] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 13:12:38.463384  1988 raft_consensus.cc:2804] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.463881  1988 raft_consensus.cc:493] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.464262  1988 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.465750  1795 consensus_queue.cc:260] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.467996  1795 ts_tablet_manager.cc:1434] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:12:38.469795  1795 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:38.472246  1982 consensus_queue.cc:1048] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.474653  1868 raft_consensus.cc:493] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.475248  1868 raft_consensus.cc:515] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.477494  1868 leader_election.cc:290] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:38.479538  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:38.480235  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
W20260709 13:12:38.481029  1718 leader_election.cc:343] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.481313  1794 raft_consensus.cc:359] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.482021  1794 raft_consensus.cc:385] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.482307  1794 raft_consensus.cc:740] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.482978  1794 consensus_queue.cc:260] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.463037  1796 raft_consensus.cc:359] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.489482  1797 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:38.490072  1797 ts_tablet_manager.cc:1403] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.095s	user 0.031s	sys 0.016s
I20260709 13:12:38.491991  1794 ts_tablet_manager.cc:1434] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:12:38.484105  1796 raft_consensus.cc:385] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.493525  1796 raft_consensus.cc:740] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.497277  1794 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:38.499673  1795 tablet_bootstrap.cc:654] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.494632  1796 consensus_queue.cc:260] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.500237  1958 raft_consensus.cc:493] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.505923  1958 raft_consensus.cc:515] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.509037  1797 raft_consensus.cc:359] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.509857  1797 raft_consensus.cc:385] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.509822  1794 tablet_bootstrap.cc:654] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.510465  1797 raft_consensus.cc:740] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.511113  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:38.512004  1797 consensus_queue.cc:260] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.515123  1797 ts_tablet_manager.cc:1434] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:12:38.515863  1958 leader_election.cc:290] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:38.516419  1797 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:38.516705  1678 raft_consensus.cc:2468] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:38.519516  1796 ts_tablet_manager.cc:1434] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 13:12:38.502005  1988 raft_consensus.cc:515] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.518786  1717 leader_election.cc:304] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:38.521175  1868 raft_consensus.cc:2804] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.521642  1868 raft_consensus.cc:493] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.522032  1868 raft_consensus.cc:3060] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.522058  1913 raft_consensus.cc:493] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.522668  1913 raft_consensus.cc:515] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.525283  1913 leader_election.cc:290] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:38.527051  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:38.527802  1528 raft_consensus.cc:2468] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:38.530185  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:38.533577  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:38.534674  1642 leader_election.cc:304] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:38.536473  1568 leader_election.cc:304] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:38.543345  1995 raft_consensus.cc:2749] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.543738  1797 tablet_bootstrap.cc:654] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:38.544307  1644 leader_election.cc:343] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.551081  1982 consensus_queue.cc:1048] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.541551  1678 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.521185  1796 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:38.563783  1958 consensus_queue.cc:1048] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.554378  1913 raft_consensus.cc:2804] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:38.567857  1913 raft_consensus.cc:493] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:38.568478  1913 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.587795  1797 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:38.588665  1797 ts_tablet_manager.cc:1403] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.006s
I20260709 13:12:38.592584  1797 raft_consensus.cc:359] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.611418  1797 raft_consensus.cc:385] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.544099  1868 raft_consensus.cc:515] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.613574  1797 raft_consensus.cc:740] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.614818  1797 consensus_queue.cc:260] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.607612  1988 leader_election.cc:290] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:38.621747  1936 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.622412  1797 ts_tablet_manager.cc:1434] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:12:38.622242  1936 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.607712  1796 tablet_bootstrap.cc:654] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.586592  1938 consensus_queue.cc:1048] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.619518  1995 raft_consensus.cc:493] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.625427  1936 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:38.625106  1995 raft_consensus.cc:515] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.597841  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:38.629626  1751 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.630860  1995 leader_election.cc:290] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:38.633003  1833 consensus_queue.cc:1048] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.633515  1795 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:38.634223  1795 ts_tablet_manager.cc:1403] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.165s	user 0.014s	sys 0.000s
I20260709 13:12:38.627383  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:38.626715  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:38.636031  1676 raft_consensus.cc:3060] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:38.636570  1717 leader_election.cc:343] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.628412  1605 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.638103  1795 raft_consensus.cc:359] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.618808  1913 raft_consensus.cc:515] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:38.639106  1795 raft_consensus.cc:385] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.645030  1795 raft_consensus.cc:740] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.646063  1795 consensus_queue.cc:260] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.644158  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:38.650362  1529 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.651585  1868 leader_election.cc:290] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:38.653079  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:38.653820  1602 raft_consensus.cc:3060] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:38.656188  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:38.668406  1794 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:38.672924  1794 ts_tablet_manager.cc:1403] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.176s	user 0.062s	sys 0.097s
I20260709 13:12:38.671684  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:38.672184  1494 leader_election.cc:343] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.682507  1751 raft_consensus.cc:2468] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:38.683667  1938 consensus_queue.cc:1048] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:38.668612  1797 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:38.689087  1833 consensus_queue.cc:1048] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:38.689459  1716 leader_election.cc:343] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.690256  1716 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:38.690708  1913 leader_election.cc:290] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:38.693696  1795 ts_tablet_manager.cc:1434] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:12:38.694664  1936 raft_consensus.cc:2749] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.703127  1794 raft_consensus.cc:359] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.704295  1794 raft_consensus.cc:385] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:38.704643  1794 raft_consensus.cc:740] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:38.695452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:38.713614  1795 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:38.717669  1794 consensus_queue.cc:260] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.722446  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:38.723483  1752 raft_consensus.cc:2393] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate 81b721300bd34373862d7937c3bf394a in this term.
I20260709 13:12:38.723623  1794 ts_tablet_manager.cc:1434] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:12:38.724788  1794 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:38.715724  1493 leader_election.cc:304] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:38.725767  1925 raft_consensus.cc:2804] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.726286  1925 raft_consensus.cc:697] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:38.715358  1913 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.727085  1913 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.727193  1925 consensus_queue.cc:237] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:38.729180  1913 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:38.730477  1644 leader_election.cc:343] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:38.731139  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:38.734320  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:38.735719  1958 consensus_queue.cc:1048] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:38.737720  1794 tablet_bootstrap.cc:654] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.711989  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b3d4b647afe44848c02525fceeb81a7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:38.758256  1642 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:38.780038  1602 raft_consensus.cc:2468] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:38.789610  1796 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:38.792811  1796 ts_tablet_manager.cc:1403] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.272s	user 0.030s	sys 0.024s
I20260709 13:12:38.796041  1982 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.787873  1569 leader_election.cc:304] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:38.806258  1797 tablet_bootstrap.cc:654] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.802888  1846 raft_consensus.cc:2749] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:38.814270  1958 raft_consensus.cc:2749] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:38.805852  1718 leader_election.cc:304] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:38.816232  2026 raft_consensus.cc:2804] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:38.807328  1982 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:38.821798  2026 raft_consensus.cc:697] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:38.828871  1529 raft_consensus.cc:2468] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:38.860432  2026 consensus_queue.cc:237] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:38.861153  1676 raft_consensus.cc:2468] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:38.880616  1794 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:38.881405  1794 ts_tablet_manager.cc:1403] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.031s
W20260709 13:12:38.879189  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 44345.6us
I20260709 13:12:38.985802  1795 tablet_bootstrap.cc:654] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:38.885988  1995 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.996918  1958 raft_consensus.cc:493] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.005507  1982 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.002936  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.019538  1982 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.014644  1936 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:38.999182  1995 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.019749  1927 raft_consensus.cc:493] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.011554  1958 raft_consensus.cc:515] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.048382  1796 raft_consensus.cc:359] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.027421  1749 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.050424  1796 raft_consensus.cc:385] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.050981  1796 raft_consensus.cc:740] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.051928  1796 consensus_queue.cc:260] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.040198  1936 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:39.057368  2033 log.cc:927] Time spent T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:12:39.058094  2035 log.cc:927] Time spent T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:39.062455  1958 leader_election.cc:290] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:39.032426  1982 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.065807  1796 ts_tablet_manager.cc:1434] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.273s	user 0.006s	sys 0.002s
I20260709 13:12:39.066702  1794 raft_consensus.cc:359] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.067328  1794 raft_consensus.cc:385] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:39.042927  1495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 128558us
I20260709 13:12:39.067631  1794 raft_consensus.cc:740] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.045833  1927 raft_consensus.cc:515] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.045364  1642 leader_election.cc:304] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:39.075855  1794 consensus_queue.cc:260] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.086789  1913 raft_consensus.cc:2804] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.087410  1913 raft_consensus.cc:697] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:39.087517  1493 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.088186  1995 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:39.088346  1913 consensus_queue.cc:237] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.089705  1982 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.090323  1982 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.090699  1982 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.096513  1797 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.097285  1797 ts_tablet_manager.cc:1403] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.433s	user 0.029s	sys 0.013s
I20260709 13:12:39.102362  1794 ts_tablet_manager.cc:1434] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.221s	user 0.005s	sys 0.005s
I20260709 13:12:39.094697  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.104483  1752 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
W20260709 13:12:39.112540  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 51103.1us
I20260709 13:12:39.113605  1796 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:39.091081  1982 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.127801  1794 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
W20260709 13:12:39.116704  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 79059.3us
W20260709 13:12:39.124508  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 95156.6us
I20260709 13:12:39.148061  1927 leader_election.cc:290] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:39.154261  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.150924  1797 raft_consensus.cc:359] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.160598  1797 raft_consensus.cc:385] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.160918  1797 raft_consensus.cc:740] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.161592  1797 consensus_queue.cc:260] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.164526  1797 ts_tablet_manager.cc:1434] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.001s
I20260709 13:12:39.164390  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.169292  1603 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.175333  1936 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.178128  1493 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.178596  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.179376  1528 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:39.181656  2040 raft_consensus.cc:2804] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.182106  2040 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.181517  1426 catalog_manager.cc:5697] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.184959  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.185854  1753 raft_consensus.cc:2468] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:39.189500  1678 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.193044  2048 log.cc:927] Time spent T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:12:39.193429  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.195070  1796 tablet_bootstrap.cc:654] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:39.198972  1717 leader_election.cc:343] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.199961  1925 consensus_queue.cc:1048] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.202340  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.203056  1602 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:39.204146  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.204881  1603 raft_consensus.cc:2468] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:39.182422  2040 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.207754  1797 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.206700  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:39.212603  1569 leader_election.cc:343] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.213155  1716 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.219939  1605 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.221586  2046 raft_consensus.cc:2804] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.221990  2046 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.222350  2046 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.224802  1718 leader_election.cc:304] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:39.226415  2051 raft_consensus.cc:2804] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.226812  2051 raft_consensus.cc:493] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.227133  2051 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.228295  1877 consensus_queue.cc:1048] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.235669  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.236671  1751 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:39.237087  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.212730  1794 tablet_bootstrap.cc:654] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.234650  2046 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.252362  1795 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:39.252884  1795 ts_tablet_manager.cc:1403] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.543s	user 0.013s	sys 0.015s
I20260709 13:12:39.254447  2040 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.262306  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:39.262121  1795 raft_consensus.cc:359] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.263827  1795 raft_consensus.cc:385] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.264145  1795 raft_consensus.cc:740] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.263275  1749 raft_consensus.cc:2393] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 81b721300bd34373862d7937c3bf394a in this term.
I20260709 13:12:39.267513  2040 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.270972  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.271768  1605 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.276692  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.277916  1797 tablet_bootstrap.cc:654] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.278999  1796 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:39.279584  1796 ts_tablet_manager.cc:1403] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.000s
I20260709 13:12:39.264875  1795 consensus_queue.cc:260] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.283056  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:39.284125  1527 raft_consensus.cc:2393] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81b721300bd34373862d7937c3bf394a in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:39.283713  2051 raft_consensus.cc:515] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.286230  1716 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.286957  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.287704  1603 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.287645  1568 leader_election.cc:304] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:39.289418  1795 ts_tablet_manager.cc:1434] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 13:12:39.291198  1795 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:39.291337  1868 raft_consensus.cc:2749] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.307077  1797 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.294596  1568 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:39.307683  1797 ts_tablet_manager.cc:1403] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.140s	user 0.008s	sys 0.027s
I20260709 13:12:39.308874  1996 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.309357  1996 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.309734  1996 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.283286  2046 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.312794  1795 tablet_bootstrap.cc:654] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.314248  1797 raft_consensus.cc:359] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.315032  1797 raft_consensus.cc:385] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.315949  1797 raft_consensus.cc:740] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.316953  1797 consensus_queue.cc:260] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.299744  1603 raft_consensus.cc:2468] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:39.319636  2044 raft_consensus.cc:2764] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:39.319744  1718 leader_election.cc:304] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:39.300784  2051 leader_election.cc:290] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:39.320889  2046 raft_consensus.cc:2804] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.321475  2046 raft_consensus.cc:697] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:39.322404  2046 consensus_queue.cc:237] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.315471  1605 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:39.302012  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
W20260709 13:12:39.327003  1717 leader_election.cc:343] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.327613  1797 ts_tablet_manager.cc:1434] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:12:39.328217  1495 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 81b721300bd34373862d7937c3bf394a
I20260709 13:12:39.329627  1877 raft_consensus.cc:2804] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.297166  1982 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.330181  1877 raft_consensus.cc:697] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:39.330510  1797 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.331113  1529 raft_consensus.cc:2393] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:39.333006  1877 consensus_queue.cc:237] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.327029  1794 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:39.336197  1794 ts_tablet_manager.cc:1403] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.011s
I20260709 13:12:39.346446  1797 tablet_bootstrap.cc:654] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.355970  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.337240  1982 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.336984  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:39.346621  1794 raft_consensus.cc:359] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.342178  1996 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.358978  1753 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.359596  1797 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.360160  1797 ts_tablet_manager.cc:1403] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 13:12:39.361088  1996 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:39.302706  1796 raft_consensus.cc:359] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.363536  1796 raft_consensus.cc:385] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.363889  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:39.363976  1796 raft_consensus.cc:740] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.367404  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:39.368594  1529 raft_consensus.cc:2393] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:39.368430  1796 consensus_queue.cc:260] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.370570  1796 ts_tablet_manager.cc:1434] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:12:39.371541  1603 raft_consensus.cc:2393] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:39.375066  1568 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.376785  1996 raft_consensus.cc:2749] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.378901  1425 catalog_manager.cc:5697] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.358958  1794 raft_consensus.cc:385] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.383751  1794 raft_consensus.cc:740] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.387666  1794 consensus_queue.cc:260] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.390127  1794 ts_tablet_manager.cc:1434] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.001s
I20260709 13:12:39.391289  1797 raft_consensus.cc:359] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.394851  1797 raft_consensus.cc:385] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.395216  1797 raft_consensus.cc:740] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.395915  1797 consensus_queue.cc:260] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.399947  1797 ts_tablet_manager.cc:1434] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:12:39.411212  1797 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.401805  1753 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:39.402798  1796 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
W20260709 13:12:39.415778  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:39.416932  1797 tablet_bootstrap.cc:654] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.416705  1493 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:39.417829  1877 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.418609  1877 raft_consensus.cc:697] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:39.406169  1794 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:39.419552  1877 consensus_queue.cc:237] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.421411  1427 catalog_manager.cc:5697] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.409561  1795 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:39.427577  1795 ts_tablet_manager.cc:1403] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.002s
I20260709 13:12:39.431629  1795 raft_consensus.cc:359] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.432390  1795 raft_consensus.cc:385] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.432686  1795 raft_consensus.cc:740] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.435312  1795 consensus_queue.cc:260] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.428305  1796 tablet_bootstrap.cc:654] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.427093  1794 tablet_bootstrap.cc:654] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.434558  1797 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.441767  1795 ts_tablet_manager.cc:1434] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:39.442397  1797 ts_tablet_manager.cc:1403] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.005s
I20260709 13:12:39.442996  1795 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:39.445686  1797 raft_consensus.cc:359] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.446434  1797 raft_consensus.cc:385] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.446755  1797 raft_consensus.cc:740] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.447101  2046 consensus_queue.cc:1048] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.447810  1796 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:39.447440  1797 consensus_queue.cc:260] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.448340  1796 ts_tablet_manager.cc:1403] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:12:39.449237  1797 ts_tablet_manager.cc:1434] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:39.449604  1795 tablet_bootstrap.cc:654] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.450492  1797 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.452652  1794 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:39.452620  1796 raft_consensus.cc:359] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.466421  1796 raft_consensus.cc:385] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.466786  1796 raft_consensus.cc:740] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.456326  1426 catalog_manager.cc:5697] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.468106  1796 consensus_queue.cc:260] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.466580  1794 ts_tablet_manager.cc:1403] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.003s
I20260709 13:12:39.470616  1796 ts_tablet_manager.cc:1434] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:12:39.480962  1796 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:39.482318  1794 raft_consensus.cc:359] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.484411  1794 raft_consensus.cc:385] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.485795  1794 raft_consensus.cc:740] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.484710  1428 catalog_manager.cc:5697] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.489248  1796 tablet_bootstrap.cc:654] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.490027  1794 consensus_queue.cc:260] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.490899  2051 raft_consensus.cc:493] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.492905  2051 raft_consensus.cc:515] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.494535  1794 ts_tablet_manager.cc:1434] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:12:39.495033  1797 tablet_bootstrap.cc:654] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.495428  2051 leader_election.cc:290] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.495816  1794 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:39.504779  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.505697  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.506490  1605 raft_consensus.cc:2468] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
W20260709 13:12:39.507587  1716 leader_election.cc:343] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.512871  1718 leader_election.cc:304] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.517920  2051 raft_consensus.cc:2804] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.518415  2051 raft_consensus.cc:493] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.518800  2051 raft_consensus.cc:3060] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.519366  1875 consensus_queue.cc:1048] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.530021  1936 consensus_queue.cc:1048] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.529968  1428 catalog_manager.cc:5697] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.538743  1795 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:39.539374  1795 ts_tablet_manager.cc:1403] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.097s	user 0.041s	sys 0.017s
I20260709 13:12:39.542546  1936 raft_consensus.cc:493] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.543133  1936 raft_consensus.cc:515] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.556198  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.563076  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:39.564851  1718 leader_election.cc:343] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.561470  1936 leader_election.cc:290] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
W20260709 13:12:39.571919  1717 leader_election.cc:343] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.582515  1795 raft_consensus.cc:359] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.583137  1795 raft_consensus.cc:385] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.583420  1795 raft_consensus.cc:740] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.584053  1795 consensus_queue.cc:260] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.586460  1795 ts_tablet_manager.cc:1434] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.002s
I20260709 13:12:39.587630  1795 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:39.589536  1717 leader_election.cc:304] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:39.590793  2026 raft_consensus.cc:2749] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.595983  1796 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:39.596727  1796 ts_tablet_manager.cc:1403] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.019s
I20260709 13:12:39.608181  1794 tablet_bootstrap.cc:654] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:39.611137  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 46093.2us
I20260709 13:12:39.612773  1797 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.613317  1797 ts_tablet_manager.cc:1403] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.163s	user 0.027s	sys 0.029s
I20260709 13:12:39.616051  1936 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.619871  1796 raft_consensus.cc:359] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.620815  1796 raft_consensus.cc:385] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.619858  1936 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.621114  1796 raft_consensus.cc:740] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.622030  1796 consensus_queue.cc:260] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.623126  1936 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:39.623674  1605 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.624711  1796 ts_tablet_manager.cc:1434] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:12:39.625005  1797 raft_consensus.cc:359] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.625303  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.633917  1797 raft_consensus.cc:385] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.634709  1797 raft_consensus.cc:740] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.636339  1796 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
W20260709 13:12:39.636638  1718 leader_election.cc:343] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.637677  2051 raft_consensus.cc:515] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.641330  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.641868  1602 raft_consensus.cc:3060] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.648063  1797 consensus_queue.cc:260] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.648507  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:39.648156  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.650359  2051 leader_election.cc:290] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:39.657212  1716 leader_election.cc:343] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:39.657975  1716 leader_election.cc:343] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.658396  1716 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.659144  2026 raft_consensus.cc:2749] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.660295  1797 ts_tablet_manager.cc:1434] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:12:39.661375  1797 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.675529  1602 raft_consensus.cc:2468] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:39.679349  1796 tablet_bootstrap.cc:654] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.679121  1718 leader_election.cc:304] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.681102  2026 raft_consensus.cc:2804] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.682037  2026 raft_consensus.cc:697] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:39.682374  1797 tablet_bootstrap.cc:654] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.684365  2026 consensus_queue.cc:237] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.695500  1795 tablet_bootstrap.cc:654] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.705911  1794 tablet_bootstrap.cc:492] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:39.706562  1794 ts_tablet_manager.cc:1403] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.211s	user 0.016s	sys 0.004s
I20260709 13:12:39.709398  1794 raft_consensus.cc:359] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.710062  1794 raft_consensus.cc:385] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.710351  1794 raft_consensus.cc:740] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.716172  1796 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:39.711047  1794 consensus_queue.cc:260] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.719444  1796 ts_tablet_manager.cc:1403] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.021s
I20260709 13:12:39.721560  1794 ts_tablet_manager.cc:1434] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:12:39.722229  1796 raft_consensus.cc:359] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.722990  1796 raft_consensus.cc:385] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.723297  1796 raft_consensus.cc:740] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.724140  1796 consensus_queue.cc:260] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.734331  1982 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.735180  1982 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.754755  1938 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.755388  1938 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:39.755923  1717 consensus_peers.cc:597] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:39.757599  1938 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:39.769443  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.760004  1796 ts_tablet_manager.cc:1434] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:12:39.770140  1673 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.771250  1796 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:39.771286  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.772439  1494 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.774545  1938 raft_consensus.cc:2804] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.775022  1938 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.775470  1938 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.777415  1678 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.778872  1494 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.761706  1982 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:39.760926  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.781261  1925 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.756958  1428 catalog_manager.cc:5697] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.763422  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:39.781631  1753 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:39.780583  1796 tablet_bootstrap.cc:654] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.781621  1925 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.784611  1925 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:39.787467  1495 leader_election.cc:343] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.789739  1982 consensus_queue.cc:1048] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.792030  2043 consensus_queue.cc:1048] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.824455  1938 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.826685  2026 raft_consensus.cc:493] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.827324  2026 raft_consensus.cc:515] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.828070  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:39.828725  1678 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.830451  2026 leader_election.cc:290] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:39.835341  2047 raft_consensus.cc:493] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.835999  2047 raft_consensus.cc:515] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.838614  2047 leader_election.cc:290] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:39.839344  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0379b5784a684643b7f6abcd1a99e91f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.840173  1673 raft_consensus.cc:2468] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:39.841122  1982 consensus_queue.cc:1048] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:39.841784  1717 leader_election.cc:304] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:39.842940  2026 raft_consensus.cc:2804] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.843426  2026 raft_consensus.cc:493] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.843833  2026 raft_consensus.cc:3060] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.848279  1678 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:39.850310  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:39.865902  1749 raft_consensus.cc:2468] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:39.854435  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0379b5784a684643b7f6abcd1a99e91f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.867369  1529 raft_consensus.cc:2468] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:39.859040  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.868789  1673 raft_consensus.cc:2468] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:39.864264  2047 raft_consensus.cc:493] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.869654  2047 raft_consensus.cc:515] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.870437  1569 leader_election.cc:304] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:39.870874  1875 consensus_queue.cc:1048] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.872277  2047 leader_election.cc:290] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:39.872908  2047 raft_consensus.cc:2804] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:39.873622  2047 raft_consensus.cc:493] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:39.873994  2047 raft_consensus.cc:3060] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.867180  1982 consensus_queue.cc:1048] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.874831  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.885041  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.897846  1925 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:39.894703  1494 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:39.902415  2026 raft_consensus.cc:515] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.932085  2026 leader_election.cc:290] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:39.903609  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:39.933418  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0379b5784a684643b7f6abcd1a99e91f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:39.933380  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0379b5784a684643b7f6abcd1a99e91f" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:39.934283  1675 raft_consensus.cc:3060] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.908177  1797 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:39.908779  1982 raft_consensus.cc:2804] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.935406  1797 ts_tablet_manager.cc:1403] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.274s	user 0.036s	sys 0.031s
I20260709 13:12:39.935428  1982 raft_consensus.cc:697] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:39.910604  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:39.911790  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:39.936589  1982 consensus_queue.cc:237] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.937453  1753 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.938484  1797 raft_consensus.cc:359] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.939191  1797 raft_consensus.cc:385] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.939452  1797 raft_consensus.cc:740] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.912041  2051 consensus_queue.cc:1048] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:39.940680  1797 consensus_queue.cc:260] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.914925  1795 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:39.941777  1795 ts_tablet_manager.cc:1403] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.354s	user 0.011s	sys 0.057s
I20260709 13:12:39.943393  1675 raft_consensus.cc:2468] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:39.913054  1938 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:39.944656  1717 leader_election.cc:304] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:39.919281  1925 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:39.926836  1796 tablet_bootstrap.cc:492] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:39.945618  2051 raft_consensus.cc:2804] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.934123  1673 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.934621  1529 raft_consensus.cc:3060] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.946334  2051 raft_consensus.cc:697] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:39.947239  2051 consensus_queue.cc:237] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.947813  1753 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:39.949184  1796 ts_tablet_manager.cc:1403] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.178s	user 0.050s	sys 0.011s
I20260709 13:12:39.865310  1794 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:39.906193  1568 leader_election.cc:304] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.954156  1996 raft_consensus.cc:2749] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:39.954346  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 48294.2us
I20260709 13:12:39.941133  2026 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:39.956703  2026 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:39.944582  1795 raft_consensus.cc:359] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.958650  1795 raft_consensus.cc:385] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.958941  1795 raft_consensus.cc:740] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.959635  1795 consensus_queue.cc:260] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:39.961791  1795 ts_tablet_manager.cc:1434] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:12:39.962868  1795 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:39.964365  1796 raft_consensus.cc:359] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.965122  1796 raft_consensus.cc:385] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:39.965404  1796 raft_consensus.cc:740] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:39.965492  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:39.918965  2047 raft_consensus.cc:515] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
W20260709 13:12:39.966863  1717 leader_election.cc:343] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:39.965497  1495 leader_election.cc:343] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.968464  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:39.968909  2047 leader_election.cc:290] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:39.969336  1678 raft_consensus.cc:3060] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.969516  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdbab434e7b64cfb957c2d17d7ba0efc" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:39.970242  1749 raft_consensus.cc:3060] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:39.971273  1796 consensus_queue.cc:260] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:39.970721  1797 ts_tablet_manager.cc:1434] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:12:39.973728  1797 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:39.976940  1796 ts_tablet_manager.cc:1434] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:12:39.981729  1678 raft_consensus.cc:2468] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:39.982981  1569 leader_election.cc:304] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:39.984012  2047 raft_consensus.cc:2804] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.984494  2047 raft_consensus.cc:697] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:39.984656  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:39.984993  1673 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:39.985426  2047 consensus_queue.cc:237] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
W20260709 13:12:39.986198  1716 leader_election.cc:343] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:39.986620  1796 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:39.986690  1716 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:39.987761  2051 raft_consensus.cc:2749] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:39.988456  2026 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:39.989246  1494 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:39.990630  1529 raft_consensus.cc:2468] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:39.962957  1794 tablet_bootstrap.cc:654] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:39.994241  2043 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:39.994756  2043 raft_consensus.cc:697] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:39.995615  2043 consensus_queue.cc:237] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.006494  1795 tablet_bootstrap.cc:654] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.009805  1797 tablet_bootstrap.cc:654] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.015089  1796 tablet_bootstrap.cc:654] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.022637  1749 raft_consensus.cc:2468] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:40.029342  1428 catalog_manager.cc:5697] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:40.037120  1794 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:40.037670  1794 ts_tablet_manager.cc:1403] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.173s	user 0.007s	sys 0.005s
I20260709 13:12:40.040668  1797 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:40.041304  1797 ts_tablet_manager.cc:1403] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.000s
I20260709 13:12:40.047583  1795 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:40.048450  1795 ts_tablet_manager.cc:1403] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.001s
I20260709 13:12:40.040830  1426 catalog_manager.cc:5697] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.059593  1795 raft_consensus.cc:359] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.069824  1795 raft_consensus.cc:385] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.070214  1795 raft_consensus.cc:740] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.070981  1795 consensus_queue.cc:260] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.072011  1796 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:40.072613  1796 ts_tablet_manager.cc:1403] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.086s	user 0.031s	sys 0.016s
I20260709 13:12:40.072350  1794 raft_consensus.cc:359] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.073079  1794 raft_consensus.cc:385] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.073402  1794 raft_consensus.cc:740] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.075639  1796 raft_consensus.cc:359] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.074515  1794 consensus_queue.cc:260] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.076419  1796 raft_consensus.cc:385] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.076743  1796 raft_consensus.cc:740] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.077558  1795 ts_tablet_manager.cc:1434] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:12:40.077497  1796 consensus_queue.cc:260] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.078727  1795 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:40.074872  1424 catalog_manager.cc:5697] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.080027  1796 ts_tablet_manager.cc:1434] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:40.081256  1796 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:40.066589  1797 raft_consensus.cc:359] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.085704  1797 raft_consensus.cc:385] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.086050  1797 raft_consensus.cc:740] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.086798  1797 consensus_queue.cc:260] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.087821  1796 tablet_bootstrap.cc:654] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.090317  1794 ts_tablet_manager.cc:1434] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:12:40.091650  1794 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:40.099255  1796 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:40.099872  1796 ts_tablet_manager.cc:1403] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:12:40.102509  1796 raft_consensus.cc:359] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.103354  1796 raft_consensus.cc:385] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.103686  1796 raft_consensus.cc:740] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.104499  1796 consensus_queue.cc:260] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.106863  1796 ts_tablet_manager.cc:1434] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:12:40.107033  1428 catalog_manager.cc:5697] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.108636  1796 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:40.110064  1797 ts_tablet_manager.cc:1434] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:12:40.111191  1797 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:40.115140  1796 tablet_bootstrap.cc:654] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.117599  1794 tablet_bootstrap.cc:654] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.128173  1795 tablet_bootstrap.cc:654] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.139278  1797 tablet_bootstrap.cc:654] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.147213  1794 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:40.147883  1794 ts_tablet_manager.cc:1403] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 13:12:40.152397  1794 raft_consensus.cc:359] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.152757  1795 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:40.153106  1794 raft_consensus.cc:385] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.153331  1795 ts_tablet_manager.cc:1403] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.000s
I20260709 13:12:40.153414  1794 raft_consensus.cc:740] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.154287  1794 consensus_queue.cc:260] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.156271  1795 raft_consensus.cc:359] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.159047  1796 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:40.159651  1796 ts_tablet_manager.cc:1403] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.020s
I20260709 13:12:40.161484  1797 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:40.161976  1797 ts_tablet_manager.cc:1403] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.000s
I20260709 13:12:40.162352  1796 raft_consensus.cc:359] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.156424  1794 ts_tablet_manager.cc:1434] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:40.163118  1796 raft_consensus.cc:385] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.163483  1796 raft_consensus.cc:740] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.163726  1875 raft_consensus.cc:493] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.164288  1795 raft_consensus.cc:385] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.164216  1875 raft_consensus.cc:515] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.164646  1795 raft_consensus.cc:740] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.164744  1797 raft_consensus.cc:359] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.165416  1797 raft_consensus.cc:385] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.165808  1797 raft_consensus.cc:740] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.165369  1795 consensus_queue.cc:260] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.166347  1875 leader_election.cc:290] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:40.166464  1797 consensus_queue.cc:260] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.168044  1794 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:40.168685  1797 ts_tablet_manager.cc:1434] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:40.170176  1797 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:40.169407  1795 ts_tablet_manager.cc:1434] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:40.172681  1795 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:40.175078  1794 tablet_bootstrap.cc:654] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.175899  1797 tablet_bootstrap.cc:654] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.179777  2047 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.180583  2047 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.168454  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:40.184298  1913 raft_consensus.cc:493] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.184908  1913 raft_consensus.cc:515] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
W20260709 13:12:40.186283  1644 leader_election.cc:343] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.179821  2050 consensus_queue.cc:1048] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:40.187680  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:40.191385  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:40.192111  1749 raft_consensus.cc:2468] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:40.192693  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:40.193701  2047 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:40.169404  1796 consensus_queue.cc:260] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.201967  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:40.187300  1913 leader_election.cc:290] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:40.202690  1642 leader_election.cc:304] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:40.219769  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:40.220423  1875 raft_consensus.cc:2804] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.221110  1678 raft_consensus.cc:2393] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:40.221306  1875 raft_consensus.cc:493] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.222255  1875 raft_consensus.cc:3060] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.226574  1644 leader_election.cc:304] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:40.228127  1913 raft_consensus.cc:2749] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.231329  1569 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.232820  1996 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.235044  1982 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.234645  1875 raft_consensus.cc:515] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.236212  2050 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.237181  2043 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.237473  2050 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.238039  2043 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.240823  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:40.241947  2043 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
W20260709 13:12:40.242928  1716 leader_election.cc:343] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.243903  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:40.244304  2051 raft_consensus.cc:493] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.244652  2050 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:40.245275  2051 raft_consensus.cc:515] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.246896  1875 leader_election.cc:290] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:40.249006  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:40.250165  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:40.250401  1495 leader_election.cc:343] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:40.261179  1718 leader_election.cc:343] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.261720  1718 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.263373  2050 raft_consensus.cc:2749] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:40.265870  1644 leader_election.cc:343] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.251278  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:40.254055  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:40.254288  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:40.268419  1527 raft_consensus.cc:3060] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:40.268940  1717 leader_election.cc:343] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.270042  1749 raft_consensus.cc:3060] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:40.272266  1716 leader_election.cc:343] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.273051  1716 leader_election.cc:304] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.274066  2050 raft_consensus.cc:2749] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.255218  2051 leader_election.cc:290] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:40.236007  1982 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.277204  1996 raft_consensus.cc:2749] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.281354  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:40.282377  1753 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:40.284171  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:40.284812  1493 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:40.285145  1602 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:40.285982  1938 raft_consensus.cc:2804] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.286549  1938 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.286996  1938 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.296723  1875 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.297614  1875 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.243592  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:40.299536  1678 raft_consensus.cc:2468] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:40.301532  1494 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:40.301941  1875 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:40.304131  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:40.305160  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
W20260709 13:12:40.305958  1642 leader_election.cc:343] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.308280  1753 raft_consensus.cc:2468] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:40.309994  1642 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.312644  1913 raft_consensus.cc:2804] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.313071  1913 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.312944  1982 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:40.313586  1913 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.306241  1925 raft_consensus.cc:2804] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:40.319630  1925 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:40.320305  1925 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.320638  1938 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.324303  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:40.325052  1602 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.328781  2051 consensus_queue.cc:1048] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:40.331533  2105 log.cc:927] Time spent T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:12:40.333894  1913 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.335580  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:40.340255  1753 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.346547  1795 tablet_bootstrap.cc:654] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.350829  1675 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.355830  1749 raft_consensus.cc:2468] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:40.356478  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:40.358367  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:40.359550  1752 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.362169  1642 leader_election.cc:304] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
W20260709 13:12:40.363641  1642 leader_election.cc:343] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.364388  1875 raft_consensus.cc:2804] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.365198  1875 raft_consensus.cc:697] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:40.366155  1875 consensus_queue.cc:237] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.368937  1925 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.354828  1913 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:40.377753  1753 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:40.380191  1602 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:40.389880  1796 ts_tablet_manager.cc:1434] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.230s	user 0.007s	sys 0.000s
I20260709 13:12:40.390430  2047 consensus_queue.cc:1048] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.391177  1796 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:40.396067  2050 consensus_queue.cc:1048] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.397780  1495 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:40.399771  2043 raft_consensus.cc:2804] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.400254  2043 raft_consensus.cc:697] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:40.401198  2043 consensus_queue.cc:237] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.413672  1877 consensus_queue.cc:1048] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.423384  1877 raft_consensus.cc:493] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.424243  1877 raft_consensus.cc:515] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:40.428058  1877 leader_election.cc:290] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:40.380563  1795 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:40.382097  1938 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:40.384296  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:40.436206  1925 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:40.440675  1795 ts_tablet_manager.cc:1403] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.268s	user 0.011s	sys 0.003s
I20260709 13:12:40.440260  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:40.441373  1678 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.439875  1925 consensus_queue.cc:1048] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:12:40.436714  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 82502.7us
I20260709 13:12:40.521689  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:40.562085  1996 consensus_queue.cc:1048] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.606840  1795 raft_consensus.cc:359] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.607909  1795 raft_consensus.cc:385] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.642153  1795 raft_consensus.cc:740] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.647483  1795 consensus_queue.cc:260] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.628754  1752 raft_consensus.cc:2468] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
W20260709 13:12:40.608446  1495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 187111us
I20260709 13:12:40.673928  1795 ts_tablet_manager.cc:1434] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.233s	user 0.016s	sys 0.012s
I20260709 13:12:40.679255  1796 tablet_bootstrap.cc:654] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.651409  2050 consensus_queue.cc:1048] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:12:40.683215  1795 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:40.692317  1678 raft_consensus.cc:2468] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:40.700790  1428 catalog_manager.cc:5697] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.710983  1797 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:40.711810  1797 ts_tablet_manager.cc:1403] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.542s	user 0.028s	sys 0.104s
I20260709 13:12:40.712320  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7892b317e15474e89775b9d69f7fe66" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:40.715018  1925 consensus_queue.cc:1048] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.721962  1797 raft_consensus.cc:359] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:40.722851  1797 raft_consensus.cc:385] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.723191  1797 raft_consensus.cc:740] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
W20260709 13:12:40.723374  1794 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.117s	sys 0.216s
W20260709 13:12:40.723763  1794 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.117s	sys 0.216s
I20260709 13:12:40.723937  1797 consensus_queue.cc:260] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
W20260709 13:12:40.726466  1495 leader_election.cc:343] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:40.730242  1642 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.731377  1875 raft_consensus.cc:2804] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.731909  1875 raft_consensus.cc:697] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:40.732743  1875 consensus_queue.cc:237] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.736393  1494 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:40.750453  1797 ts_tablet_manager.cc:1434] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:12:40.747670  1877 raft_consensus.cc:2804] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:40.758953  1877 raft_consensus.cc:697] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:40.759924  1877 consensus_queue.cc:237] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.798931  1794 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:40.799656  1794 ts_tablet_manager.cc:1403] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.632s	user 0.127s	sys 0.216s
I20260709 13:12:40.805799  1794 raft_consensus.cc:359] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.806584  1794 raft_consensus.cc:385] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.806916  1794 raft_consensus.cc:740] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.806897  1795 tablet_bootstrap.cc:654] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.821523  1794 consensus_queue.cc:260] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.840901  1794 ts_tablet_manager.cc:1434] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:12:40.842065  1794 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:40.849433  2123 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:40.868186  2123 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.871498  2123 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:40.753026  1495 leader_election.cc:304] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:40.887365  2126 raft_consensus.cc:2749] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:40.887604  1495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 147227us
I20260709 13:12:40.890576  1794 tablet_bootstrap.cc:654] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.893571  1796 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:40.894639  1796 ts_tablet_manager.cc:1403] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.504s	user 0.026s	sys 0.010s
I20260709 13:12:40.901798  1796 raft_consensus.cc:359] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.902552  1796 raft_consensus.cc:385] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.902858  1796 raft_consensus.cc:740] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.902763  1982 consensus_queue.cc:1048] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:40.904000  1796 consensus_queue.cc:260] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:40.910506  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:40.916152  1796 ts_tablet_manager.cc:1434] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:40.917371  1796 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:40.919466  1938 consensus_queue.cc:1048] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:40.920323  1795 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:40.920920  1795 ts_tablet_manager.cc:1403] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.240s	user 0.009s	sys 0.005s
I20260709 13:12:40.923640  1796 tablet_bootstrap.cc:654] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.928934  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:40.930017  1676 raft_consensus.cc:2393] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:40.929734  1795 raft_consensus.cc:359] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.933384  1569 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:40.935025  2061 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:40.930755  1795 raft_consensus.cc:385] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.959820  1795 raft_consensus.cc:740] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.964147  1795 consensus_queue.cc:260] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.957326  2061 raft_consensus.cc:2749] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:40.963559  1794 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:40.968008  1794 ts_tablet_manager.cc:1403] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.001s
I20260709 13:12:40.972313  1795 ts_tablet_manager.cc:1434] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
I20260709 13:12:40.973078  1796 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:40.973408  1795 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:40.973572  1796 ts_tablet_manager.cc:1403] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260709 13:12:40.974522  1794 raft_consensus.cc:359] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.975597  1794 raft_consensus.cc:385] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.975881  1794 raft_consensus.cc:740] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.976552  1794 consensus_queue.cc:260] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.977473  1796 raft_consensus.cc:359] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.978226  1796 raft_consensus.cc:385] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:40.978492  1796 raft_consensus.cc:740] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:40.979235  1796 consensus_queue.cc:260] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:40.981302  1796 ts_tablet_manager.cc:1434] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:40.982307  1796 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:40.983698  1795 tablet_bootstrap.cc:654] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:40.990686  1794 ts_tablet_manager.cc:1434] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:12:40.992172  1794 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:41.009567  1796 tablet_bootstrap.cc:654] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.016654  1794 tablet_bootstrap.cc:654] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.136759  1936 raft_consensus.cc:493] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.137457  1936 raft_consensus.cc:515] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.140048  1936 leader_election.cc:290] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.195988  2114 consensus_queue.cc:1048] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.200301  1425 catalog_manager.cc:5697] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.203622  2061 raft_consensus.cc:493] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.204250  2061 raft_consensus.cc:515] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.206470  2061 leader_election.cc:290] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.207139  1797 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:41.208425  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.209153  1528 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:41.210415  1568 leader_election.cc:304] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:41.211784  1996 raft_consensus.cc:2804] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.212558  1996 raft_consensus.cc:493] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.213964  1797 tablet_bootstrap.cc:654] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.212915  1996 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.224538  1996 raft_consensus.cc:515] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.226315  1797 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:41.226964  1797 ts_tablet_manager.cc:1403] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:12:41.227771  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:41.228494  1528 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.230095  1797 raft_consensus.cc:359] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.230885  1797 raft_consensus.cc:385] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.231276  1797 raft_consensus.cc:740] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.232003  1797 consensus_queue.cc:260] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.234319  1797 ts_tablet_manager.cc:1434] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:12:41.235407  1797 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:41.237172  1528 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
W20260709 13:12:41.240201  1494 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 487879us
I20260709 13:12:41.242229  1797 tablet_bootstrap.cc:654] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.244411  1982 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.245033  1982 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.247999  1996 leader_election.cc:290] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.250622  1568 leader_election.cc:304] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:41.251924  1996 raft_consensus.cc:2804] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.253686  1996 raft_consensus.cc:697] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:41.254769  1996 consensus_queue.cc:237] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.263300  1527 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.291175  1795 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:41.291983  1795 ts_tablet_manager.cc:1403] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.319s	user 0.018s	sys 0.037s
I20260709 13:12:41.322088  1982 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:41.330687  2114 raft_consensus.cc:493] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.331290  2114 raft_consensus.cc:515] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.332999  1875 consensus_queue.cc:1048] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.333369  2114 leader_election.cc:290] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:41.335115  1796 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:41.335753  1796 ts_tablet_manager.cc:1403] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.354s	user 0.024s	sys 0.017s
I20260709 13:12:41.337308  1938 consensus_queue.cc:1048] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.345378  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:41.348686  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:41.349592  1750 raft_consensus.cc:2393] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:41.352847  1796 raft_consensus.cc:359] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.353688  1796 raft_consensus.cc:385] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.353984  1796 raft_consensus.cc:740] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.354699  1796 consensus_queue.cc:260] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.359901  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:41.360708  1678 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:41.363341  1493 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:41.365960  1938 raft_consensus.cc:2749] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.372563  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:41.374385  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:41.374423  1795 raft_consensus.cc:359] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.375233  1677 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.375470  1795 raft_consensus.cc:385] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.375798  1795 raft_consensus.cc:740] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.393095  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:41.393910  1673 raft_consensus.cc:2468] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
W20260709 13:12:41.401518  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:41.400432  1795 consensus_queue.cc:260] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.403658  1877 consensus_queue.cc:1048] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.406888  1795 ts_tablet_manager.cc:1434] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.000s
I20260709 13:12:41.410825  1795 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:41.414232  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 83408.8us
I20260709 13:12:41.419284  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.420131  1530 raft_consensus.cc:2393] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:41.421110  2111 raft_consensus.cc:493] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.421715  2111 raft_consensus.cc:515] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.422569  1797 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:41.423076  1797 ts_tablet_manager.cc:1403] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.188s	user 0.034s	sys 0.025s
I20260709 13:12:41.423755  2111 leader_election.cc:290] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:41.359993  1796 ts_tablet_manager.cc:1434] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:12:41.426134  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.426016  1797 raft_consensus.cc:359] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.427644  1797 raft_consensus.cc:385] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.427954  1797 raft_consensus.cc:740] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.428282  1796 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:41.428615  1797 consensus_queue.cc:260] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.431272  1797 ts_tablet_manager.cc:1434] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
W20260709 13:12:41.431507  1642 leader_election.cc:343] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.433718  1795 tablet_bootstrap.cc:654] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.436364  1677 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:41.437480  2135 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.457841  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:41.471266  1794 tablet_bootstrap.cc:492] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:41.475337  1794 ts_tablet_manager.cc:1403] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.483s	user 0.018s	sys 0.002s
I20260709 13:12:41.476619  2135 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.484033  2135 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:41.481407  1644 consensus_peers.cc:597] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.453825  1424 catalog_manager.cc:5697] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:41.503336  1718 leader_election.cc:343] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.507521  1797 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:41.508809  1794 raft_consensus.cc:359] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.509868  1794 raft_consensus.cc:385] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.510246  1794 raft_consensus.cc:740] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.511314  1794 consensus_queue.cc:260] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.512584  1717 leader_election.cc:304] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:41.513743  2050 raft_consensus.cc:2804] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.514133  2050 raft_consensus.cc:493] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.515066  2050 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.517875  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:41.518656  1748 raft_consensus.cc:2468] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:41.523834  1794 ts_tablet_manager.cc:1434] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:12:41.524494  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:41.532744  1495 leader_election.cc:343] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.535723  1794 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:41.536548  1982 consensus_queue.cc:1048] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.558838  1796 tablet_bootstrap.cc:654] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.578331  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:41.579140  1748 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:41.579694  1795 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:41.580403  1795 ts_tablet_manager.cc:1403] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.170s	user 0.043s	sys 0.026s
I20260709 13:12:41.582638  1493 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:41.585819  1925 raft_consensus.cc:2804] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.586244  1925 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.586613  1925 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:41.555466  1718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 51139.9us
I20260709 13:12:41.587883  1797 tablet_bootstrap.cc:654] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.594036  1925 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.557963  1875 consensus_queue.cc:1048] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:12:41.595577  1644 leader_election.cc:304] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:41.597604  1794 tablet_bootstrap.cc:654] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.597566  2115 raft_consensus.cc:2749] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.610553  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:41.611310  1748 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.615342  2050 raft_consensus.cc:515] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.618788  2050 leader_election.cc:290] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.619292  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:41.619361  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:41.620299  1677 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.619956  1795 raft_consensus.cc:359] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.620894  1795 raft_consensus.cc:385] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.621227  1795 raft_consensus.cc:740] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.622591  1795 consensus_queue.cc:260] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
W20260709 13:12:41.624929  1718 leader_election.cc:343] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.627296  1795 ts_tablet_manager.cc:1434] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:12:41.630219  1748 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:41.631821  1493 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:41.632961  1795 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:41.633159  1982 raft_consensus.cc:2804] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.633776  1982 raft_consensus.cc:697] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:41.634397  1427 catalog_manager.cc:5697] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.638381  1677 raft_consensus.cc:2468] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:41.634606  1982 consensus_queue.cc:237] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.643863  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:41.647749  1717 leader_election.cc:304] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:41.648583  1797 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:41.648680  2050 raft_consensus.cc:2804] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:41.649226  1797 ts_tablet_manager.cc:1403] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.158s	user 0.019s	sys 0.011s
I20260709 13:12:41.649366  2050 raft_consensus.cc:697] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:41.650341  2050 consensus_queue.cc:237] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.652963  1797 raft_consensus.cc:359] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.653757  1797 raft_consensus.cc:385] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.654042  1797 raft_consensus.cc:740] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.654881  1797 consensus_queue.cc:260] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.657204  1797 ts_tablet_manager.cc:1434] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:41.658339  1797 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
W20260709 13:12:41.645397  1495 leader_election.cc:343] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.665527  1795 tablet_bootstrap.cc:654] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.663009  1642 leader_election.cc:304] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:41.666141  1925 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:41.669613  1875 raft_consensus.cc:2804] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.670102  1875 raft_consensus.cc:493] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.670457  1875 raft_consensus.cc:3060] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.693526  1797 tablet_bootstrap.cc:654] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.696192  2050 raft_consensus.cc:493] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.704586  2123 raft_consensus.cc:493] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.705204  2123 raft_consensus.cc:515] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.706676  1604 raft_consensus.cc:3060] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.714984  1794 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:41.715772  1794 ts_tablet_manager.cc:1403] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.180s	user 0.008s	sys 0.009s
I20260709 13:12:41.704185  2050 raft_consensus.cc:515] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.721827  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:41.723527  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:41.732601  1718 leader_election.cc:343] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.737897  1875 raft_consensus.cc:515] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.744831  2123 leader_election.cc:290] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:41.747299  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e8d04de04d4aaba701d3d54a96ba95" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:41.751022  2047 consensus_queue.cc:1048] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:41.753134  1569 leader_election.cc:304] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:41.755002  2123 consensus_queue.cc:1048] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:41.757658  1796 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:41.758554  1796 ts_tablet_manager.cc:1403] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.330s	user 0.026s	sys 0.008s
I20260709 13:12:41.760105  1794 raft_consensus.cc:359] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.761705  1794 raft_consensus.cc:385] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.761966  1794 raft_consensus.cc:740] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.763427  1875 leader_election.cc:290] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:41.764200  1794 consensus_queue.cc:260] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.766153  1794 ts_tablet_manager.cc:1434] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:12:41.775743  1796 raft_consensus.cc:359] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.776526  1796 raft_consensus.cc:385] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.776780  1796 raft_consensus.cc:740] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.777388  1796 consensus_queue.cc:260] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.774581  1427 catalog_manager.cc:5697] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.769618  2050 leader_election.cc:290] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:41.779136  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.804615  1796 ts_tablet_manager.cc:1434] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:12:41.804842  2046 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.804710  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:41.807051  1794 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:41.798869  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:41.817752  1748 raft_consensus.cc:3060] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.829056  1797 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:41.829686  1797 ts_tablet_manager.cc:1403] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.172s	user 0.030s	sys 0.038s
I20260709 13:12:41.836062  1796 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:41.840250  1795 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:41.840812  1795 ts_tablet_manager.cc:1403] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.209s	user 0.041s	sys 0.039s
I20260709 13:12:41.842551  1797 raft_consensus.cc:359] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.854738  1796 tablet_bootstrap.cc:654] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:41.854595  1642 leader_election.cc:343] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.821952  2046 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:41.861725  2050 raft_consensus.cc:493] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.843328  1797 raft_consensus.cc:385] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.875664  1794 tablet_bootstrap.cc:654] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.877522  1797 raft_consensus.cc:740] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.883263  1797 consensus_queue.cc:260] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.882477  2050 raft_consensus.cc:515] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:41.888332  2050 leader_election.cc:290] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.890220  1795 raft_consensus.cc:359] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.890993  1795 raft_consensus.cc:385] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:41.891309  1795 raft_consensus.cc:740] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:41.891952  1795 consensus_queue.cc:260] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.894085  1795 ts_tablet_manager.cc:1434] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.053s	user 0.001s	sys 0.005s
W20260709 13:12:41.896034  1716 leader_election.cc:343] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.896585  1716 leader_election.cc:304] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:41.897755  2050 raft_consensus.cc:2749] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.895057  1795 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:41.904666  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.916268  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:41.922583  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
W20260709 13:12:41.929203  1718 leader_election.cc:343] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.929597  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:41.931258  1718 leader_election.cc:343] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.904112  2046 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:41.932943  1717 leader_election.cc:343] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.926120  1425 catalog_manager.cc:5697] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.933465  1717 leader_election.cc:304] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:41.935619  2046 raft_consensus.cc:2749] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.936654  2050 raft_consensus.cc:493] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.937279  2050 raft_consensus.cc:515] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:41.943611  1797 ts_tablet_manager.cc:1434] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.114s	user 0.009s	sys 0.000s
I20260709 13:12:41.944749  1797 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
W20260709 13:12:41.949162  1716 leader_election.cc:343] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:41.949760  1716 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:41.959663  1428 catalog_manager.cc:5697] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:41.964956  1996 raft_consensus.cc:2749] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.958015  2046 raft_consensus.cc:2749] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:41.947351  1748 raft_consensus.cc:2468] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:41.977524  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:41.985672  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:41.986331  1529 raft_consensus.cc:2468] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:41.987538  1716 leader_election.cc:304] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:41.991493  2166 raft_consensus.cc:2804] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:41.991927  2166 raft_consensus.cc:493] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:41.992254  2166 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:41.990083  1925 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:41.993606  1795 tablet_bootstrap.cc:654] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:41.993429  1925 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:41.995572  1925 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:41.998648  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.002197  1676 raft_consensus.cc:2468] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:41.985960  2050 leader_election.cc:290] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:42.006124  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:42.010717  1494 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:42.014142  2042 raft_consensus.cc:2804] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.014561  2042 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.014926  2042 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.015604  1717 leader_election.cc:343] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.016784  2166 raft_consensus.cc:515] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.020313  1642 leader_election.cc:304] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:42.021657  1796 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:42.022159  2114 raft_consensus.cc:2804] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.022290  2166 leader_election.cc:290] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:42.022818  2114 raft_consensus.cc:697] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:42.023640  2114 consensus_queue.cc:237] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.024262  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:42.024827  1529 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.027760  1495 leader_election.cc:343] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.030720  2042 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.022205  1796 ts_tablet_manager.cc:1403] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.189s	user 0.006s	sys 0.020s
I20260709 13:12:42.037529  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
W20260709 13:12:42.040069  1551 debug-util.cc:398] Leaking SignalData structure 0x7b08001a2c60 after lost signal to thread 26161
W20260709 13:12:42.040498  1495 leader_election.cc:343] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:42.041355  1551 debug-util.cc:398] Leaking SignalData structure 0x7b08000caea0 after lost signal to thread 1462
I20260709 13:12:42.042685  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
W20260709 13:12:42.042735  1551 debug-util.cc:398] Leaking SignalData structure 0x7b0800276dc0 after lost signal to thread 1554
I20260709 13:12:42.042824  1529 raft_consensus.cc:2468] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:42.043459  1676 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.044349  1551 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff9a0 after lost signal to thread 1629
W20260709 13:12:42.045625  1551 debug-util.cc:398] Leaking SignalData structure 0x7b08001539a0 after lost signal to thread 1703
W20260709 13:12:42.046859  1551 debug-util.cc:398] Leaking SignalData structure 0x7b0800273860 after lost signal to thread 1777
W20260709 13:12:42.047595  1551 debug-util.cc:398] Leaking SignalData structure 0x7b0800316780 after lost signal to thread 2062
I20260709 13:12:42.049378  1676 raft_consensus.cc:2468] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:42.050194  2042 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:42.050644  1494 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:42.037777  1796 raft_consensus.cc:359] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.059767  1796 raft_consensus.cc:385] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.060077  1796 raft_consensus.cc:740] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.061586  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:42.054154  1716 leader_election.cc:304] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:42.065096  2042 raft_consensus.cc:2804] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.061076  1796 consensus_queue.cc:260] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.067507  1676 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.065421  2050 raft_consensus.cc:2804] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.026983  1797 tablet_bootstrap.cc:654] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.067490  2042 raft_consensus.cc:697] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:42.081696  2042 consensus_queue.cc:237] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.083318  1925 consensus_queue.cc:1048] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.088594  1794 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:42.089179  1794 ts_tablet_manager.cc:1403] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.287s	user 0.016s	sys 0.016s
I20260709 13:12:42.085045  2050 raft_consensus.cc:697] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:42.092823  1794 raft_consensus.cc:359] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.093357  1794 raft_consensus.cc:385] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.093636  1794 raft_consensus.cc:740] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.093874  1676 raft_consensus.cc:2468] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:42.094326  1794 consensus_queue.cc:260] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.096433  1794 ts_tablet_manager.cc:1434] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:42.097977  1794 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:42.098311  1796 ts_tablet_manager.cc:1434] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 13:12:42.099647  1796 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:42.103874  1794 tablet_bootstrap.cc:654] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.105860  1425 catalog_manager.cc:5697] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.106729  1604 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.131117  1795 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.131798  1795 ts_tablet_manager.cc:1403] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.237s	user 0.021s	sys 0.033s
I20260709 13:12:42.132110  1797 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:42.132627  1797 ts_tablet_manager.cc:1403] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.001s
I20260709 13:12:42.134207  2050 consensus_queue.cc:237] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.136433  1796 tablet_bootstrap.cc:654] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.142280  1795 raft_consensus.cc:359] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.143245  1795 raft_consensus.cc:385] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.143659  1795 raft_consensus.cc:740] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.140133  1797 raft_consensus.cc:359] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.145941  1797 raft_consensus.cc:385] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.146261  1797 raft_consensus.cc:740] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.147325  1797 consensus_queue.cc:260] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.151356  1795 consensus_queue.cc:260] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.161665  1996 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.165979  1996 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:42.167040  1718 consensus_peers.cc:597] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.168704  1996 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:42.171307  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.133520  1925 consensus_queue.cc:1048] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:12:42.180783  1797 ts_tablet_manager.cc:1434] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:12:42.184507  1795 ts_tablet_manager.cc:1434] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:12:42.185624  1795 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:42.182422  1797 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:42.200233  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:42.203739  1568 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:42.189667  1938 raft_consensus.cc:493] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.207552  1996 raft_consensus.cc:2749] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:42.214774  1795 tablet_bootstrap.cc:654] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.207943  1938 raft_consensus.cc:515] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.217968  1938 leader_election.cc:290] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:42.225932  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.228904  1794 tablet_bootstrap.cc:492] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:42.229431  2046 consensus_queue.cc:1048] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.229473  1794 ts_tablet_manager.cc:1403] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.021s
I20260709 13:12:42.241591  1794 raft_consensus.cc:359] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.242268  1794 raft_consensus.cc:385] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.244031  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb08ccac0eca4cd2af937e0c1cb87ce2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.244813  1753 raft_consensus.cc:2393] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f836402fd5410b9deb0c569dbc1a7e in current term 1: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:42.245667  1796 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:42.246236  1796 ts_tablet_manager.cc:1403] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.011s
I20260709 13:12:42.242525  1794 raft_consensus.cc:740] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.248390  1794 consensus_queue.cc:260] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.256820  1794 ts_tablet_manager.cc:1434] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.005s
I20260709 13:12:42.258214  1936 raft_consensus.cc:493] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.259545  1936 raft_consensus.cc:515] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.261694  1936 leader_election.cc:290] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:42.262849  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:42.265048  1718 leader_election.cc:343] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.266199  1428 catalog_manager.cc:5697] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.268117  1493 leader_election.cc:304] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:42.268271  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:42.273499  1716 leader_election.cc:343] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.274718  1716 leader_election.cc:304] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:42.277968  2169 raft_consensus.cc:493] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.275902  1797 tablet_bootstrap.cc:654] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.276197  1794 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:42.270335  2042 raft_consensus.cc:3060] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.277995  2050 raft_consensus.cc:2749] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.278503  2169 raft_consensus.cc:515] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.290087  2169 leader_election.cc:290] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:42.290735  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.291599  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.296577  1796 raft_consensus.cc:359] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.297298  1796 raft_consensus.cc:385] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.297567  1796 raft_consensus.cc:740] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.298334  1796 consensus_queue.cc:260] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.300534  1796 ts_tablet_manager.cc:1434] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.000s
I20260709 13:12:42.301034  1568 leader_election.cc:304] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:42.304195  2169 raft_consensus.cc:2749] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.310734  1795 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.311306  1795 ts_tablet_manager.cc:1403] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.021s
I20260709 13:12:42.320351  1794 tablet_bootstrap.cc:654] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.320829  1795 raft_consensus.cc:359] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.324982  1796 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:42.325857  1795 raft_consensus.cc:385] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.326222  1795 raft_consensus.cc:740] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.327102  1795 consensus_queue.cc:260] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.329676  1795 ts_tablet_manager.cc:1434] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:12:42.330614  1795 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:42.332238  2042 raft_consensus.cc:2749] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.335273  1797 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:42.335743  1797 ts_tablet_manager.cc:1403] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.008s
I20260709 13:12:42.338347  1797 raft_consensus.cc:359] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.338989  1797 raft_consensus.cc:385] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.339653  1797 raft_consensus.cc:740] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.339833  1795 tablet_bootstrap.cc:654] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.340435  1797 consensus_queue.cc:260] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.342692  1797 ts_tablet_manager.cc:1434] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:42.350188  1794 tablet_bootstrap.cc:492] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:42.358939  1794 ts_tablet_manager.cc:1403] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.003s
I20260709 13:12:42.361172  1794 raft_consensus.cc:359] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.361764  1794 raft_consensus.cc:385] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.360551  1424 catalog_manager.cc:5697] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:42.362025  1794 raft_consensus.cc:740] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.362737  1794 consensus_queue.cc:260] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.355973  1795 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.365175  1795 ts_tablet_manager.cc:1403] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:12:42.371668  1796 tablet_bootstrap.cc:654] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.372517  1795 raft_consensus.cc:359] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.373149  1794 ts_tablet_manager.cc:1434] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:12:42.373859  1797 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:42.374215  1794 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:42.373364  1795 raft_consensus.cc:385] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.379721  1795 raft_consensus.cc:740] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.380589  1795 consensus_queue.cc:260] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.387380  1794 tablet_bootstrap.cc:654] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.388159  1795 ts_tablet_manager.cc:1434] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:12:42.389859  1795 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:42.390400  2169 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.390928  2169 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.393036  2169 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:42.393193  1797 tablet_bootstrap.cc:654] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.393797  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:42.395612  1796 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:42.395917  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.396723  1673 raft_consensus.cc:2393] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:42.396137  1796 ts_tablet_manager.cc:1403] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.007s
I20260709 13:12:42.398749  1569 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:42.399968  2169 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.402877  1796 raft_consensus.cc:359] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.416644  1796 raft_consensus.cc:385] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.417027  1796 raft_consensus.cc:740] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.417944  1796 consensus_queue.cc:260] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.418888  1795 tablet_bootstrap.cc:654] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.425832  1796 ts_tablet_manager.cc:1434] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:42.427246  1796 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:42.452924  1795 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.456470  1795 ts_tablet_manager.cc:1403] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.004s
I20260709 13:12:42.459148  2114 raft_consensus.cc:493] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.459858  2114 raft_consensus.cc:515] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.460490  1796 tablet_bootstrap.cc:654] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.466701  1795 raft_consensus.cc:359] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.467648  1795 raft_consensus.cc:385] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.470988  2169 raft_consensus.cc:2749] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:42.467932  1795 raft_consensus.cc:740] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.473115  2114 leader_election.cc:290] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:42.473862  1795 consensus_queue.cc:260] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.474689  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.476878  1750 raft_consensus.cc:2468] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:42.479295  1642 leader_election.cc:304] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:42.481528  1795 ts_tablet_manager.cc:1434] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:12:42.481914  1875 raft_consensus.cc:2804] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.484513  1875 raft_consensus.cc:493] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.484965  1875 raft_consensus.cc:3060] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.485159  1795 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:42.482892  1796 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:42.483592  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:42.488588  1604 raft_consensus.cc:2468] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:42.489866  1796 ts_tablet_manager.cc:1403] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 13:12:42.492416  2113 consensus_queue.cc:1048] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.493906  1794 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:42.494417  1794 ts_tablet_manager.cc:1403] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.015s
I20260709 13:12:42.496593  1796 raft_consensus.cc:359] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.498768  1794 raft_consensus.cc:359] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.499548  1794 raft_consensus.cc:385] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.499863  1794 raft_consensus.cc:740] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.499619  1796 raft_consensus.cc:385] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.501682  1796 raft_consensus.cc:740] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.502377  1796 consensus_queue.cc:260] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.505678  1795 tablet_bootstrap.cc:654] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.509963  1794 consensus_queue.cc:260] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.512161  1794 ts_tablet_manager.cc:1434] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:42.507642  1796 ts_tablet_manager.cc:1434] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:42.513402  1794 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:42.517882  1796 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:42.520433  1877 consensus_queue.cc:1048] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.522060  2113 consensus_queue.cc:1048] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.504580  1875 raft_consensus.cc:515] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.553234  1602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:42.553867  1602 raft_consensus.cc:3060] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.555128  1936 consensus_queue.cc:1048] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:42.562209  2050 consensus_queue.cc:1048] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.565382  1796 tablet_bootstrap.cc:654] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.566270  1795 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.566898  1795 ts_tablet_manager.cc:1403] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.007s
I20260709 13:12:42.568934  1875 leader_election.cc:290] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:42.571481  1602 raft_consensus.cc:2468] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:42.593519  1797 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:42.594306  1797 ts_tablet_manager.cc:1403] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.221s	user 0.025s	sys 0.023s
I20260709 13:12:42.580618  1644 leader_election.cc:304] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:42.608623  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5cbb2cdb27143549a19371a87196764" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:42.610136  1875 raft_consensus.cc:2804] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.610687  1875 raft_consensus.cc:697] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:42.611479  1875 consensus_queue.cc:237] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.609560  1750 raft_consensus.cc:3060] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.624678  1794 tablet_bootstrap.cc:654] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.623467  1936 raft_consensus.cc:493] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.626273  1936 raft_consensus.cc:515] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.628382  1795 raft_consensus.cc:359] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.629101  1795 raft_consensus.cc:385] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.629355  1795 raft_consensus.cc:740] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.629966  1795 consensus_queue.cc:260] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.635955  1936 leader_election.cc:290] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:42.639951  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:42.640774  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.641479  1677 raft_consensus.cc:2468] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
W20260709 13:12:42.643321  1718 leader_election.cc:343] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.644961  1717 leader_election.cc:304] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:42.649955  2046 raft_consensus.cc:2804] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.650511  2046 raft_consensus.cc:493] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.650965  2046 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.656473  2114 raft_consensus.cc:493] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.657060  2114 raft_consensus.cc:515] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.662002  1877 raft_consensus.cc:493] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.662621  1877 raft_consensus.cc:515] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.663450  2114 leader_election.cc:290] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:42.664712  1877 leader_election.cc:290] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:42.665066  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8234639df4f6cb6d73f59b3a8fffc" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:42.666288  1601 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:42.666836  1644 leader_election.cc:343] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.668620  1795 ts_tablet_manager.cc:1434] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.101s	user 0.002s	sys 0.003s
I20260709 13:12:42.674499  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.675731  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8234639df4f6cb6d73f59b3a8fffc" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:42.684338  1529 raft_consensus.cc:2468] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
W20260709 13:12:42.685431  1493 leader_election.cc:343] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.687009  1642 leader_election.cc:304] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:42.677304  1750 raft_consensus.cc:2468] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:42.713475  1795 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:42.721530  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:42.710816  2113 raft_consensus.cc:2804] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.725625  2113 raft_consensus.cc:493] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.726008  2113 raft_consensus.cc:3060] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.729351  1797 raft_consensus.cc:359] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.731509  1797 raft_consensus.cc:385] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.732026  1797 raft_consensus.cc:740] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.732868  1797 consensus_queue.cc:260] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:42.741739  1795 tablet_bootstrap.cc:654] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.753720  2046 raft_consensus.cc:515] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:42.759873  2046 leader_election.cc:290] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:42.762277  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:42.763257  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:42.768844  2043 consensus_queue.cc:1048] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:42.792114  1797 ts_tablet_manager.cc:1434] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.197s	user 0.008s	sys 0.000s
I20260709 13:12:42.820251  1796 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:42.821101  1796 ts_tablet_manager.cc:1403] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.304s	user 0.019s	sys 0.040s
I20260709 13:12:42.799249  1925 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.827306  1797 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
W20260709 13:12:42.791850  1718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 126588us
I20260709 13:12:42.804167  1677 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.829249  1794 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
W20260709 13:12:42.830551  1494 leader_election.cc:343] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:42.830855  1794 ts_tablet_manager.cc:1403] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.318s	user 0.019s	sys 0.012s
I20260709 13:12:42.831045  1494 leader_election.cc:304] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:42.831765  1877 raft_consensus.cc:2749] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:42.830192  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 144730us
I20260709 13:12:42.775066  2113 raft_consensus.cc:515] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.833128  1925 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.877643  1925 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:42.879323  2113 leader_election.cc:290] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:42.917572  1795 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:42.918354  1795 ts_tablet_manager.cc:1403] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.009s
W20260709 13:12:42.920765  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 60743.3us
I20260709 13:12:42.933457  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:42.933192  1794 raft_consensus.cc:359] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.934620  1794 raft_consensus.cc:385] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.934913  1794 raft_consensus.cc:740] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.935510  1794 consensus_queue.cc:260] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.936956  1796 raft_consensus.cc:359] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.934064  1753 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:42.937610  1796 raft_consensus.cc:385] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.938263  1796 raft_consensus.cc:740] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.925506  1925 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.938843  1796 consensus_queue.cc:260] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.945986  1794 ts_tablet_manager.cc:1434] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.115s	user 0.003s	sys 0.003s
I20260709 13:12:42.946949  1493 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:42.930791  2061 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:42.948089  2043 raft_consensus.cc:2804] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:42.948529  2043 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:42.948858  2043 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.949157  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8234639df4f6cb6d73f59b3a8fffc" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:42.949764  1598 raft_consensus.cc:3060] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.947865  2061 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:42.954731  1797 tablet_bootstrap.cc:654] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.973346  1794 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
W20260709 13:12:42.972640  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 194190us
I20260709 13:12:42.978797  1796 ts_tablet_manager.cc:1434] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.002s
I20260709 13:12:42.943354  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:42.982797  1796 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:42.951071  1677 raft_consensus.cc:2468] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:42.945801  1925 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:42.980814  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:42.995129  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfa8234639df4f6cb6d73f59b3a8fffc" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:43.021839  1925 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:43.022181  1598 raft_consensus.cc:2468] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:43.014947  2043 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.026068  1717 leader_election.cc:304] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:43.027491  2202 raft_consensus.cc:2804] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.028021  2202 raft_consensus.cc:697] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:43.017638  2061 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.033998  1794 tablet_bootstrap.cc:654] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.008441  1601 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:43.038691  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:43.039542  1528 raft_consensus.cc:2393] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:43.040449  1795 raft_consensus.cc:359] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.041321  1795 raft_consensus.cc:385] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.041591  1795 raft_consensus.cc:740] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.042227  1795 consensus_queue.cc:260] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.032001  1530 raft_consensus.cc:3060] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.042443  1427 catalog_manager.cc:5697] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.044999  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:43.045570  1753 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.047101  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:43.048678  1750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:43.048862  2202 consensus_queue.cc:237] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.050895  1644 leader_election.cc:304] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:43.054388  2207 raft_consensus.cc:2804] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.055487  1568 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:43.056975  2210 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.057407  1796 tablet_bootstrap.cc:654] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.054904  2207 raft_consensus.cc:697] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:43.058518  2207 consensus_queue.cc:237] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:43.065872  2043 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:43.079465  1495 leader_election.cc:343] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.083256  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:43.084071  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:43.084805  1676 raft_consensus.cc:2468] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:43.079299  1753 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:43.097396  1493 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.102782  1795 ts_tablet_manager.cc:1434] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.184s	user 0.004s	sys 0.004s
I20260709 13:12:43.109042  1795 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:43.115008  1494 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:43.116887  1925 raft_consensus.cc:2804] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.117313  1925 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:43.117660  1718 leader_election.cc:343] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.119323  2145 raft_consensus.cc:2804] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.119889  2145 raft_consensus.cc:697] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:43.120719  2145 consensus_queue.cc:237] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.117688  1925 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.107537  2210 raft_consensus.cc:2749] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.140069  1797 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:43.140587  1797 ts_tablet_manager.cc:1403] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.314s	user 0.013s	sys 0.008s
I20260709 13:12:43.170477  1424 catalog_manager.cc:5697] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.189471  1936 raft_consensus.cc:493] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.189877  1794 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:43.190397  1794 ts_tablet_manager.cc:1403] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.217s	user 0.017s	sys 0.000s
I20260709 13:12:43.190068  1936 raft_consensus.cc:515] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.192416  1936 leader_election.cc:290] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.195190  1528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:43.196218  1528 raft_consensus.cc:2468] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 0.
I20260709 13:12:43.197602  1716 leader_election.cc:304] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.198102  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:43.198566  2212 raft_consensus.cc:2804] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:43.199623  1717 leader_election.cc:343] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.198964  2212 raft_consensus.cc:493] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.200382  2212 raft_consensus.cc:3060] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.201021  1604 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:43.202080  1797 raft_consensus.cc:359] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.203483  1797 raft_consensus.cc:385] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.203742  1797 raft_consensus.cc:740] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.204478  1797 consensus_queue.cc:260] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.196504  1794 raft_consensus.cc:359] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.206117  1794 raft_consensus.cc:385] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.206426  1794 raft_consensus.cc:740] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.207108  1794 consensus_queue.cc:260] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.209553  1794 ts_tablet_manager.cc:1434] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:12:43.212229  2113 consensus_queue.cc:1048] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:43.221963  2114 consensus_queue.cc:1048] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.228370  1795 tablet_bootstrap.cc:654] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.234045  1797 ts_tablet_manager.cc:1434] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.000s
I20260709 13:12:43.237603  1797 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
I20260709 13:12:43.243666  1794 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:43.251189  1797 tablet_bootstrap.cc:654] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.252000  1530 raft_consensus.cc:2468] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:43.263067  1428 catalog_manager.cc:5697] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.272223  2208 raft_consensus.cc:493] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.265476  2212 raft_consensus.cc:515] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.281947  2208 raft_consensus.cc:515] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.283834  2212 leader_election.cc:290] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.285655  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:43.286381  1530 raft_consensus.cc:3060] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.277086  1925 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:43.294220  1674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:43.294935  1674 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.290897  1925 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:43.301405  1796 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:43.302580  1796 ts_tablet_manager.cc:1403] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.320s	user 0.033s	sys 0.014s
I20260709 13:12:43.304337  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:43.305032  1753 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:43.306671  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
W20260709 13:12:43.308228  1495 leader_election.cc:343] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.311349  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:43.311976  1529 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:43.313519  1568 leader_election.cc:304] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.314514  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fc8c696d1441de9afedcc0a96f0908" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:43.317090  2210 raft_consensus.cc:2804] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.317567  2210 raft_consensus.cc:493] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.317909  2210 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.334642  1794 tablet_bootstrap.cc:654] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.341291  2210 raft_consensus.cc:515] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.344446  2210 leader_election.cc:290] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.346602  1530 raft_consensus.cc:2468] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:43.346827  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:43.347761  1529 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.355012  1716 leader_election.cc:304] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.301828  2208 leader_election.cc:290] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.373543  2212 raft_consensus.cc:2804] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.381319  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:43.382670  1753 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.390424  1796 raft_consensus.cc:359] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.391589  1796 raft_consensus.cc:385] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.392172  1796 raft_consensus.cc:740] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.393193  1753 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:43.403191  1796 consensus_queue.cc:260] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.404911  1529 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:43.406945  1568 leader_election.cc:304] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.411870  2213 raft_consensus.cc:2804] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.412400  2213 raft_consensus.cc:697] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:43.413204  2213 consensus_queue.cc:237] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.419761  1795 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:43.420297  1795 ts_tablet_manager.cc:1403] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.312s	user 0.015s	sys 0.031s
I20260709 13:12:43.420828  1797 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:43.421478  1797 ts_tablet_manager.cc:1403] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.187s	user 0.014s	sys 0.018s
I20260709 13:12:43.422935  1795 raft_consensus.cc:359] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.429433  1795 raft_consensus.cc:385] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.429757  1795 raft_consensus.cc:740] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.431279  1795 consensus_queue.cc:260] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.394343  2212 raft_consensus.cc:697] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:43.428074  1677 raft_consensus.cc:3060] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.443533  1877 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.444072  1877 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.446249  1877 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:43.447779  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:43.448480  1748 raft_consensus.cc:2468] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:43.451706  1493 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:43.453397  2043 raft_consensus.cc:2804] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.453776  2043 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.454120  2043 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.462471  1795 ts_tablet_manager.cc:1434] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:12:43.455981  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:43.468238  1795 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:43.470054  1794 tablet_bootstrap.cc:492] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:43.468993  1797 raft_consensus.cc:359] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.471308  1797 raft_consensus.cc:385] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.471596  1797 raft_consensus.cc:740] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.473562  1797 consensus_queue.cc:260] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.477051  2212 consensus_queue.cc:237] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.479383  1794 ts_tablet_manager.cc:1403] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.236s	user 0.024s	sys 0.028s
W20260709 13:12:43.482867  1494 leader_election.cc:343] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.486599  2050 consensus_queue.cc:1048] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.470410  1796 ts_tablet_manager.cc:1434] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.167s	user 0.011s	sys 0.000s
I20260709 13:12:43.576390  1796 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:43.580029  1674 raft_consensus.cc:2468] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:43.581454  1677 raft_consensus.cc:2468] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:43.584841  1797 ts_tablet_manager.cc:1434] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.163s	user 0.008s	sys 0.004s
I20260709 13:12:43.590449  1494 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:43.591691  1794 raft_consensus.cc:359] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.592345  1794 raft_consensus.cc:385] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.592588  1794 raft_consensus.cc:740] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.595559  1794 consensus_queue.cc:260] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.607800  1794 ts_tablet_manager.cc:1434] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.118s	user 0.002s	sys 0.006s
I20260709 13:12:43.597093  2135 raft_consensus.cc:2804] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.616338  2114 consensus_queue.cc:1048] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.578917  2043 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.666154  1796 tablet_bootstrap.cc:654] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.670677  2135 raft_consensus.cc:697] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:43.696277  1925 consensus_queue.cc:1048] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:12:43.715759  1600 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.708931  2111 consensus_queue.cc:1048] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:43.719462  2043 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:43.720968  1677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:43.727727  1795 tablet_bootstrap.cc:654] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.755494  1794 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:43.768710  1797 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
W20260709 13:12:43.786053  1493 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 56573.5us
W20260709 13:12:43.790740  1494 leader_election.cc:343] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.782491  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:43.793756  1796 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:43.798741  1796 ts_tablet_manager.cc:1403] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.223s	user 0.014s	sys 0.002s
I20260709 13:12:43.809329  1796 raft_consensus.cc:359] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.810555  1796 raft_consensus.cc:385] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.810962  1796 raft_consensus.cc:740] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.811986  1796 consensus_queue.cc:260] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.825531  1796 ts_tablet_manager.cc:1434] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:12:43.828625  1796 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:43.773808  2135 consensus_queue.cc:237] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:43.817691  1749 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.841708  2212 raft_consensus.cc:493] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.862042  1938 consensus_queue.cc:1048] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:43.856617  2212 raft_consensus.cc:515] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:43.870589  1796 tablet_bootstrap.cc:654] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.870762  2212 leader_election.cc:290] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:43.873011  1527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:43.886803  1716 leader_election.cc:343] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:43.886070  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 70417.2us
I20260709 13:12:43.909642  2239 raft_consensus.cc:493] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.912885  1425 catalog_manager.cc:5697] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:43.919688  1749 raft_consensus.cc:2468] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:43.921228  1797 tablet_bootstrap.cc:654] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.913647  2239 raft_consensus.cc:515] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:43.928066  1493 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:12:43.927099  2201 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.932106  2201 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:43.934281  2201 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:43.926023  1428 catalog_manager.cc:5697] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 1 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.942028  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:43.942898  1753 raft_consensus.cc:2393] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:43.943398  2237 raft_consensus.cc:2804] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.944152  1794 tablet_bootstrap.cc:654] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.935351  2239 leader_election.cc:290] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:43.965399  1753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:43.944192  2237 raft_consensus.cc:697] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:44.007462  2204 raft_consensus.cc:493] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.012117  2204 raft_consensus.cc:515] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.019865  1795 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:44.020558  1795 ts_tablet_manager.cc:1403] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.557s	user 0.038s	sys 0.072s
I20260709 13:12:44.007678  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:44.008814  2046 consensus_queue.cc:1048] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:12:44.060595  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:12:44.066797  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 103070us
I20260709 13:12:44.073808  1797 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:44.074342  1797 ts_tablet_manager.cc:1403] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.306s	user 0.004s	sys 0.016s
I20260709 13:12:44.079061  1796 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:44.079708  1796 ts_tablet_manager.cc:1403] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.253s	user 0.034s	sys 0.013s
I20260709 13:12:44.070982  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
W20260709 13:12:44.084080  2252 log.cc:927] Time spent T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:12:44.086467  1795 raft_consensus.cc:359] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.087814  1795 raft_consensus.cc:385] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.088302  1795 raft_consensus.cc:740] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.089447  1795 consensus_queue.cc:260] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.091992  2204 leader_election.cc:290] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:44.098456  1796 raft_consensus.cc:359] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.099205  1796 raft_consensus.cc:385] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.099582  1796 raft_consensus.cc:740] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.100023  1797 raft_consensus.cc:359] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.101138  1797 raft_consensus.cc:385] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.101516  1797 raft_consensus.cc:740] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.102312  1797 consensus_queue.cc:260] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.066851  2237 consensus_queue.cc:237] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.112012  1795 ts_tablet_manager.cc:1434] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.002s
I20260709 13:12:44.100468  1796 consensus_queue.cc:260] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.123895  1795 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:44.165824  1797 ts_tablet_manager.cc:1434] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.002s
I20260709 13:12:44.167392  1797 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: Bootstrap starting.
W20260709 13:12:44.168556  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 100031us
I20260709 13:12:44.173089  1796 ts_tablet_manager.cc:1434] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 13:12:44.174196  1796 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
I20260709 13:12:44.178468  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:44.159850  2239 consensus_queue.cc:1048] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:12:44.197980  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:44.207321  1794 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:44.213824  1794 ts_tablet_manager.cc:1403] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.459s	user 0.021s	sys 0.033s
I20260709 13:12:44.215610  1797 tablet_bootstrap.cc:654] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.237098  1569 leader_election.cc:304] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a
I20260709 13:12:44.238269  2262 raft_consensus.cc:2749] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:44.240345  2250 log.cc:927] Time spent T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:12:44.272244  1795 tablet_bootstrap.cc:654] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.283720  1794 raft_consensus.cc:359] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:44.284523  1794 raft_consensus.cc:385] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.284813  1794 raft_consensus.cc:740] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.285430  1794 consensus_queue.cc:260] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:44.287050  1794 ts_tablet_manager.cc:1434] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
W20260709 13:12:44.294448  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 46087.7us
I20260709 13:12:44.306573  1794 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
W20260709 13:12:44.306488  1717 leader_election.cc:343] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.347790  2266 consensus_queue.cc:1048] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:12:44.352485  1796 tablet_bootstrap.cc:654] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.329463  2212 consensus_queue.cc:1048] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:12:44.373265  1797 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: No bootstrap required, opened a new log
I20260709 13:12:44.374019  1797 ts_tablet_manager.cc:1403] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: Time spent bootstrapping tablet: real 0.207s	user 0.026s	sys 0.007s
I20260709 13:12:44.374709  1794 tablet_bootstrap.cc:654] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.397209  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:44.376127  2050 consensus_queue.cc:1048] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:12:44.426496  1642 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:44.447393  2272 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.463344  2050 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.472028  1603 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.485805  1795 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:44.486395  1795 ts_tablet_manager.cc:1403] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.363s	user 0.033s	sys 0.026s
I20260709 13:12:44.487320  2247 raft_consensus.cc:493] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.487864  2247 raft_consensus.cc:515] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.492314  2050 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.494468  2050 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:44.478665  1797 raft_consensus.cc:359] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.495766  1797 raft_consensus.cc:385] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.496068  1797 raft_consensus.cc:740] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.504776  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
W20260709 13:12:44.507697  1716 leader_election.cc:343] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.526126  1796 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:44.526845  1796 ts_tablet_manager.cc:1403] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.353s	user 0.010s	sys 0.009s
I20260709 13:12:44.507591  2042 consensus_queue.cc:1048] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 13:12:44.500262  1718 leader_election.cc:343] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.536784  1718 leader_election.cc:304] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:44.537762  2200 raft_consensus.cc:2749] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:44.538651  1718 leader_election.cc:343] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.539788  2247 leader_election.cc:290] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:44.530504  1796 raft_consensus.cc:359] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.548370  1795 raft_consensus.cc:359] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.549069  1796 raft_consensus.cc:385] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.549168  1795 raft_consensus.cc:385] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.549455  1796 raft_consensus.cc:740] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.549506  1795 raft_consensus.cc:740] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.550340  1795 consensus_queue.cc:260] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.565857  1795 ts_tablet_manager.cc:1434] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:12:44.566972  1796 consensus_queue.cc:260] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.570308  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bdde8c8124516a8bf5558f04c5749" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:44.570428  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bdde8c8124516a8bf5558f04c5749" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:44.571008  1797 consensus_queue.cc:260] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.573374  1797 ts_tablet_manager.cc:1434] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: Time spent starting tablet: real 0.199s	user 0.009s	sys 0.001s
I20260709 13:12:44.539072  1718 leader_election.cc:304] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:44.571146  1525 raft_consensus.cc:2468] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:44.581079  1996 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.598667  1996 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:44.577867  1752 raft_consensus.cc:2468] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
W20260709 13:12:44.604163  1718 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 65536us
I20260709 13:12:44.604424  1936 raft_consensus.cc:2749] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.609540  1642 leader_election.cc:304] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:44.609884  1996 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:44.614806  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:44.614275  2272 raft_consensus.cc:2749] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.622228  1796 ts_tablet_manager.cc:1434] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:12:44.628993  1796 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: Bootstrap starting.
W20260709 13:12:44.632939  1495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 194470us
I20260709 13:12:44.635432  1795 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:44.646304  2246 raft_consensus.cc:2804] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.646780  2246 raft_consensus.cc:493] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.647118  2246 raft_consensus.cc:3060] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.645419  1676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
W20260709 13:12:44.658496  1718 leader_election.cc:343] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.659786  1525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:44.663306  1568 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:44.664590  2262 raft_consensus.cc:2749] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:44.658995  1718 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:44.679752  2200 raft_consensus.cc:2749] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.687769  1795 tablet_bootstrap.cc:654] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.695662  1794 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:44.696381  1794 ts_tablet_manager.cc:1403] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.390s	user 0.015s	sys 0.008s
I20260709 13:12:44.707531  1425 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35068 (request call id 79) took 1101 ms. Trace:
I20260709 13:12:44.708927  1794 raft_consensus.cc:359] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.710074  1794 raft_consensus.cc:385] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.710454  1794 raft_consensus.cc:740] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.717872  1794 consensus_queue.cc:260] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.726123  1925 consensus_queue.cc:1048] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.708034  1425 rpcz_store.cc:276] 0709 13:12:43.618407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.618590 (+   183us) service_pool.cc:224] Handling call
0709 13:12:43.722481 (+103891us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54007abf54. stack: 00007fbd7fb12343 00007fbd7fb12240 00007fbd7f4a11d4 00007fbd891df304 00007fbd891df299 00007fbd82b9b090 00007fbd82c39f3a 00007fbd889f01cc 00007fbd88aee37e 00007fbd86faf2a4 00007fbd86faf232 00007fbd86faf161 00007fbd86faf0dc 00007fbd86fae392 00007fbd80f6c48c 00007fbd80f6b8c6
0709 13:12:44.707444 (+984963us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:44.232908 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:44.233419 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:44.233446 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:12:44.233463 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:44.233770 (+   307us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:44.233812 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:44.233840 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:44.234010 (+   170us) tablet.cc:701] Row locks acquired
0709 13:12:44.234031 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:44.234160 (+   129us) write_op.cc:270] Start()
0709 13:12:44.234257 (+    97us) write_op.cc:276] Timestamp: P: 1783602764234106 usec, L: 0
0709 13:12:44.234277 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:44.234914 (+   637us) log.cc:844] Serialized 543 byte log entry
0709 13:12:44.567453 (+332539us) op_driver.cc:464] REPLICATION: finished
0709 13:12:44.618498 (+ 51045us) write_op.cc:301] APPLY: starting
0709 13:12:44.618561 (+    63us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:44.618658 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:44.618751 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:44.618953 (+   202us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:44.619089 (+   136us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:44.619130 (+    41us) write_op.cc:312] APPLY: finished
0709 13:12:44.633547 (+ 14417us) log.cc:844] Serialized 22 byte log entry
0709 13:12:44.640212 (+  6665us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.641508 (+  1296us) write_op.cc:454] Released schema lock
0709 13:12:44.642064 (+   556us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:44.649821 (+  7757us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.649852 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81086,"reported_tablets":3,"spinlock_wait_cycles":144425728,"child_traces":[["op",{"apply.queue_time_us":50868,"apply.run_cpu_time_us":1777,"apply.run_wall_time_us":30883,"mutex_wait_us":1292,"num_ops":1,"prepare.queue_time_us":273733,"prepare.run_cpu_time_us":2372,"prepare.run_wall_time_us":11960,"replication_time_us":333060,"spinlock_wait_cycles":883328,"thread_start_us":77538,"threads_started":1}]]}
I20260709 13:12:44.733886  2289 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.734385  2289 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.736467  2289 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:44.742976  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:44.743754  1751 raft_consensus.cc:2468] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 0.
I20260709 13:12:44.747351  1794 ts_tablet_manager.cc:1434] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.001s
I20260709 13:12:44.747731  1493 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:44.750411  1925 raft_consensus.cc:2804] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.750797  1925 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.751948  1925 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.754349  1424 catalog_manager.cc:5697] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.771678  1794 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:44.777027  1925 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.792488  1925 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:44.796967  1794 tablet_bootstrap.cc:654] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.800654  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:44.801375  1752 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.774827  2246 raft_consensus.cc:515] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:44.806378  2042 consensus_queue.cc:1048] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.812539  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bdde8c8124516a8bf5558f04c5749" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:44.813053  1795 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:44.814734  2246 leader_election.cc:290] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:44.813135  1749 raft_consensus.cc:3060] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.816425  1529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bdde8c8124516a8bf5558f04c5749" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:44.817154  1529 raft_consensus.cc:3060] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.818343  1795 ts_tablet_manager.cc:1403] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.190s	user 0.039s	sys 0.064s
I20260709 13:12:44.821516  2282 consensus_queue.cc:1048] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.824985  1795 raft_consensus.cc:359] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.825688  1795 raft_consensus.cc:385] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.825959  1795 raft_consensus.cc:740] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.826606  1795 consensus_queue.cc:260] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.831494  1796 tablet_bootstrap.cc:654] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.834905  1605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:44.835071  1529 raft_consensus.cc:2468] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:44.836119  1795 ts_tablet_manager.cc:1434] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:44.841105  1795 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:44.840989  1642 leader_election.cc:304] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
W20260709 13:12:44.858302  1495 leader_election.cc:343] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.846475  2246 raft_consensus.cc:2804] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.884049  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:44.885396  2246 raft_consensus.cc:697] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:44.886643  2246 consensus_queue.cc:237] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:44.895753  1495 leader_election.cc:343] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:44.847945  1752 raft_consensus.cc:2468] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 1.
I20260709 13:12:44.914171  1493 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:12:44.924631  1794 tablet_bootstrap.cc:492] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:44.925118  1794 ts_tablet_manager.cc:1403] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.154s	user 0.024s	sys 0.015s
I20260709 13:12:44.929072  2234 raft_consensus.cc:2804] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.941028  1794 raft_consensus.cc:359] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.941882  1794 raft_consensus.cc:385] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.942170  1794 raft_consensus.cc:740] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.942812  1794 consensus_queue.cc:260] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.946560  1795 tablet_bootstrap.cc:654] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.953352  1796 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: No bootstrap required, opened a new log
I20260709 13:12:44.954000  1796 ts_tablet_manager.cc:1403] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent bootstrapping tablet: real 0.329s	user 0.013s	sys 0.005s
I20260709 13:12:44.936445  2234 raft_consensus.cc:697] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:12:44.957321  2234 consensus_queue.cc:237] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:44.953234  1749 raft_consensus.cc:2468] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:44.961006  2113 raft_consensus.cc:493] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.961607  2113 raft_consensus.cc:515] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:44.957152  1796 raft_consensus.cc:359] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:44.962877  1796 raft_consensus.cc:385] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.963197  1796 raft_consensus.cc:740] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.967269  2113 leader_election.cc:290] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:44.968835  1794 ts_tablet_manager.cc:1434] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:12:44.978345  1796 consensus_queue.cc:260] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:44.988174  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:44.988513  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:45.001138  1748 raft_consensus.cc:2468] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:45.002081  1604 raft_consensus.cc:2468] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:45.002465  1642 leader_election.cc:304] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:45.003278  2256 raft_consensus.cc:2804] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.003633  2256 raft_consensus.cc:493] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.003942  2256 raft_consensus.cc:3060] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.006670  1424 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35084 (request call id 79) took 1157 ms. Trace:
I20260709 13:12:45.009310  1796 ts_tablet_manager.cc:1434] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:12:45.007038  1424 rpcz_store.cc:276] 0709 13:12:43.854944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:43.855111 (+   167us) service_pool.cc:224] Handling call
0709 13:12:45.006611 (+1151500us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:44.939658 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:44.940249 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:44.940284 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:12:44.940303 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:44.940692 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:44.940766 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:44.940801 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:44.941014 (+   213us) tablet.cc:701] Row locks acquired
0709 13:12:44.941039 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:12:44.941184 (+   145us) write_op.cc:270] Start()
0709 13:12:44.941294 (+   110us) write_op.cc:276] Timestamp: P: 1783602764941140 usec, L: 0
0709 13:12:44.941316 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:44.942015 (+   699us) log.cc:844] Serialized 543 byte log entry
0709 13:12:44.949302 (+  7287us) op_driver.cc:464] REPLICATION: finished
0709 13:12:44.951377 (+  2075us) write_op.cc:301] APPLY: starting
0709 13:12:44.951458 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:44.951579 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:44.951709 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:44.951929 (+   220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:44.952110 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:44.952159 (+    49us) write_op.cc:312] APPLY: finished
0709 13:12:44.952369 (+   210us) log.cc:844] Serialized 22 byte log entry
0709 13:12:44.952521 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.952601 (+    80us) write_op.cc:454] Released schema lock
0709 13:12:44.952640 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:44.960129 (+  7489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:44.962708 (+  2579us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5550,"reported_tablets":11,"spinlock_wait_cycles":15104,"child_traces":[["op",{"apply.queue_time_us":1841,"apply.run_cpu_time_us":1588,"apply.run_wall_time_us":1588,"num_ops":1,"prepare.queue_time_us":159264,"prepare.run_cpu_time_us":2689,"prepare.run_wall_time_us":20465,"replication_time_us":7864,"thread_start_us":135284,"threads_started":1}]]}
I20260709 13:12:45.020525  2256 raft_consensus.cc:515] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:45.024591  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:45.025382  1752 raft_consensus.cc:3060] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.027464  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecf06b378aa48e987bc3e69cad1acd0" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:45.028228  1603 raft_consensus.cc:3060] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.037014  1752 raft_consensus.cc:2468] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:45.038250  1642 leader_election.cc:304] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:45.040216  2247 raft_consensus.cc:2804] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.040740  2247 raft_consensus.cc:697] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:45.041540  2247 consensus_queue.cc:237] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:12:45.046825  1794 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
W20260709 13:12:45.047458  2302 log.cc:927] Time spent T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:12:45.049336  2256 leader_election.cc:290] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:12:45.064586  1603 raft_consensus.cc:2468] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:45.073558  1794 tablet_bootstrap.cc:654] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.071878  1428 catalog_manager.cc:5697] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.086550  1428 catalog_manager.cc:5697] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.088894  2262 raft_consensus.cc:493] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.109226  1795 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: No bootstrap required, opened a new log
I20260709 13:12:45.106623  2262 raft_consensus.cc:515] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.111871  2262 leader_election.cc:290] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:45.114636  1795 ts_tablet_manager.cc:1403] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.273s	user 0.021s	sys 0.014s
I20260709 13:12:45.121743  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:45.119580  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:45.123425  1749 raft_consensus.cc:2468] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:45.125213  1568 leader_election.cc:304] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:45.126209  1996 raft_consensus.cc:2804] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.126579  1996 raft_consensus.cc:493] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.126904  1996 raft_consensus.cc:3060] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.139487  1526 raft_consensus.cc:2468] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 0.
I20260709 13:12:45.179890  1996 raft_consensus.cc:515] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.180171  1795 raft_consensus.cc:359] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:45.181030  1795 raft_consensus.cc:385] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.181322  1795 raft_consensus.cc:740] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.184605  1795 consensus_queue.cc:260] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:45.187965  1795 ts_tablet_manager.cc:1434] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:12:45.189508  1996 leader_election.cc:290] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:45.200717  1794 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:45.201303  1794 ts_tablet_manager.cc:1403] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.009s
I20260709 13:12:45.205288  1794 raft_consensus.cc:359] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:45.205987  1794 raft_consensus.cc:385] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.206254  1794 raft_consensus.cc:740] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.207098  1794 consensus_queue.cc:260] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:45.209213  1794 ts_tablet_manager.cc:1434] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:45.210105  1794 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Bootstrap starting.
I20260709 13:12:45.215584  1794 tablet_bootstrap.cc:654] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:45.216102  2272 raft_consensus.cc:493] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.216645  2272 raft_consensus.cc:515] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:45.218904  2272 leader_election.cc:290] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:45.219794  1794 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: No bootstrap required, opened a new log
I20260709 13:12:45.220249  1794 ts_tablet_manager.cc:1403] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:12:45.222239  1794 raft_consensus.cc:359] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.222671  1794 raft_consensus.cc:385] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:45.222823  1794 raft_consensus.cc:740] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Initialized, Role: FOLLOWER
I20260709 13:12:45.223289  1794 consensus_queue.cc:260] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.226653  1794 ts_tablet_manager.cc:1434] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:45.313906  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0691a4d3494313af304064070cf2e4" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:45.314637  1601 raft_consensus.cc:2468] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:45.316077  1644 leader_election.cc:304] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:45.317325  2256 raft_consensus.cc:2804] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:45.317751  2256 raft_consensus.cc:493] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.318056  2256 raft_consensus.cc:3060] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.318576  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0691a4d3494313af304064070cf2e4" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:45.319311  1530 raft_consensus.cc:2468] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 0.
I20260709 13:12:45.322181  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:45.322781  1749 raft_consensus.cc:3060] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.330220  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adb3694e79904863a5bcb3e9f2985ad0" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:45.330905  1530 raft_consensus.cc:3060] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.357164  1749 raft_consensus.cc:2468] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:45.365042  2256 raft_consensus.cc:515] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
W20260709 13:12:45.378535  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 44617.2us
I20260709 13:12:45.397571  1530 raft_consensus.cc:2468] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:45.399102  1568 leader_election.cc:304] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:45.404439  2239 raft_consensus.cc:2804] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.404958  2239 raft_consensus.cc:697] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:45.405777  2239 consensus_queue.cc:237] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.455803  2239 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.456372  2239 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:45.459616  2239 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:45.461954  1475 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:45.464315  1530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" is_pre_election: true
I20260709 13:12:45.487884  2113 consensus_queue.cc:1048] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.504132  2272 consensus_queue.cc:1048] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:45.537248  2256 leader_election.cc:290] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:45.538744  1526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0691a4d3494313af304064070cf2e4" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
I20260709 13:12:45.539511  1526 raft_consensus.cc:3060] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:45.539733  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 44635.2us
I20260709 13:12:45.541900  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:45.542807  1749 raft_consensus.cc:2393] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 1: Already voted for candidate f0f836402fd5410b9deb0c569dbc1a7e in this term.
I20260709 13:12:45.548039  2145 consensus_queue.cc:1048] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.552481  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a0691a4d3494313af304064070cf2e4" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:45.553274  1601 raft_consensus.cc:3060] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.557863  1568 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:45.554186  1526 raft_consensus.cc:2468] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:45.559213  2210 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:45.568339  1642 leader_election.cc:304] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:12:45.573601  2247 raft_consensus.cc:2804] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:45.574189  2247 raft_consensus.cc:697] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:45.575590  2247 consensus_queue.cc:237] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
W20260709 13:12:45.590608  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 52626.3us
I20260709 13:12:45.701237  1424 catalog_manager.cc:5697] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:45.727406  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 77605.1us
W20260709 13:12:45.741945  2312 log.cc:927] Time spent T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:12:45.782778  2210 raft_consensus.cc:2749] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:45.808810  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 58559.8us
I20260709 13:12:45.808137  2303 consensus_queue.cc:1048] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:12:45.873153  1601 raft_consensus.cc:2468] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:45.945519  2247 consensus_queue.cc:1048] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:45.980844  2246 consensus_queue.cc:1048] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:45.981762  2322 consensus_queue.cc:1048] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:46.006505  1427 catalog_manager.cc:5697] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } }
I20260709 13:12:46.015614  1427 catalog_manager.cc:5697] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 1 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.041365  2262 consensus_queue.cc:1048] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:46.053651  1428 catalog_manager.cc:5697] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:46.088055  2331 consensus_queue.cc:1048] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:46.092290  1424 catalog_manager.cc:5697] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:46.146901  2272 consensus_queue.cc:1048] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:46.391757  1626 debug-util.cc:398] Leaking SignalData structure 0x7b0800285540 after lost signal to thread 26161
W20260709 13:12:46.393909  1626 debug-util.cc:398] Leaking SignalData structure 0x7b08002db3a0 after lost signal to thread 1462
W20260709 13:12:46.406186  1626 debug-util.cc:398] Leaking SignalData structure 0x7b08002535e0 after lost signal to thread 1554
I20260709 13:12:46.416778 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:12:46.420488  1626 debug-util.cc:398] Leaking SignalData structure 0x7b080024d940 after lost signal to thread 1629
W20260709 13:12:46.420354  1495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 80859.4us
W20260709 13:12:46.431520  1626 debug-util.cc:398] Leaking SignalData structure 0x7b080010bbc0 after lost signal to thread 1703
W20260709 13:12:46.428467  1568 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:46.520478  1626 debug-util.cc:398] Leaking SignalData structure 0x7b08002de3a0 after lost signal to thread 1777
W20260709 13:12:46.533598  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 105295us
W20260709 13:12:46.609522  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.610296  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.610940  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.647313  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.648038  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.648622  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.649132  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.649662  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.650174  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.656533  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.658485  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.665343  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.666083  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.674358  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.677246  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.678081  1642 consensus_peers.cc:597] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.713973  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.742753 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:46.745576 26158 tablet_replica.cc:333] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.746940 26158 raft_consensus.cc:2243] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.748054 26158 raft_consensus.cc:2272] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:46.753970  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.775156 26158 tablet_replica.cc:333] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.776899 26158 raft_consensus.cc:2243] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.777784 26158 raft_consensus.cc:2272] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:46.782348  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.795688  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.805302  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.798926 26158 tablet_replica.cc:333] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.808327 26158 raft_consensus.cc:2243] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.809818 26158 raft_consensus.cc:2272] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.814649 26158 tablet_replica.cc:333] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.815719 26158 raft_consensus.cc:2243] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.816430 26158 raft_consensus.cc:2272] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.824079 26158 tablet_replica.cc:333] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.825230 26158 raft_consensus.cc:2243] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.826480 26158 raft_consensus.cc:2272] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.830473 26158 tablet_replica.cc:333] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.831487 26158 raft_consensus.cc:2243] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.832290 26158 raft_consensus.cc:2272] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.836141 26158 tablet_replica.cc:333] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.837903 26158 raft_consensus.cc:2243] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.838804 26158 raft_consensus.cc:2272] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.851672 26158 tablet_replica.cc:333] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.853051 26158 raft_consensus.cc:2243] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.862403 26158 raft_consensus.cc:2272] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.866941 26158 tablet_replica.cc:333] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.870080 26158 raft_consensus.cc:2243] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.870952 26158 raft_consensus.cc:2272] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.874874 26158 tablet_replica.cc:333] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.875952 26158 raft_consensus.cc:2243] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.877422 26158 raft_consensus.cc:2272] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:46.884083  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.894838 26158 tablet_replica.cc:333] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.895973 26158 raft_consensus.cc:2243] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.897115 26158 raft_consensus.cc:2272] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.903692 26158 tablet_replica.cc:333] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.905305 26158 raft_consensus.cc:2243] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.906140 26158 raft_consensus.cc:2272] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.910096 26158 tablet_replica.cc:333] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.913384 26158 raft_consensus.cc:2243] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.920864 26158 raft_consensus.cc:2272] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.936483 26158 tablet_replica.cc:333] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.937593 26158 raft_consensus.cc:2243] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.939024 26158 raft_consensus.cc:2272] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.945308 26158 tablet_replica.cc:333] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.950642 26158 raft_consensus.cc:2243] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.952376 26158 raft_consensus.cc:2272] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.965061 26158 tablet_replica.cc:333] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.971139 26158 raft_consensus.cc:2243] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.972401 26158 raft_consensus.cc:2272] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.975740 26158 tablet_replica.cc:333] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.976869 26158 raft_consensus.cc:2243] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.977706 26158 raft_consensus.cc:2272] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.981318 26158 tablet_replica.cc:333] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.982234 26158 raft_consensus.cc:2243] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.983661 26158 raft_consensus.cc:2272] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.987856 26158 tablet_replica.cc:333] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:46.991192 26158 raft_consensus.cc:2243] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.992682 26158 raft_consensus.cc:2272] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.011101 26158 tablet_replica.cc:333] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.012244 26158 raft_consensus.cc:2243] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.018725 26158 raft_consensus.cc:2272] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.027302 26158 tablet_replica.cc:333] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.028496 26158 raft_consensus.cc:2243] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.029999 26158 raft_consensus.cc:2272] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.033579 26158 tablet_replica.cc:333] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.034502 26158 raft_consensus.cc:2243] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.035346 26158 raft_consensus.cc:2272] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.044857 26158 tablet_replica.cc:333] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.045900 26158 raft_consensus.cc:2243] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.054957 26158 raft_consensus.cc:2272] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.058425 26158 tablet_replica.cc:333] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.059535 26158 raft_consensus.cc:2243] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.060403 26158 raft_consensus.cc:2272] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.064309 26158 tablet_replica.cc:333] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.065342 26158 raft_consensus.cc:2243] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.066155 26158 raft_consensus.cc:2272] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.073906 26158 tablet_replica.cc:333] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.075093 26158 raft_consensus.cc:2243] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.076572 26158 raft_consensus.cc:2272] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.080134 26158 tablet_replica.cc:333] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.081028 26158 raft_consensus.cc:2243] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.081768 26158 raft_consensus.cc:2272] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.095317 26158 tablet_replica.cc:333] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.096155 26158 raft_consensus.cc:2243] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.097559 26158 raft_consensus.cc:2272] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.100884 26158 tablet_replica.cc:333] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.102042 26158 raft_consensus.cc:2243] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.103261 26158 raft_consensus.cc:2272] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.106987 26158 tablet_replica.cc:333] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.108915 26158 raft_consensus.cc:2243] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.110185 26158 raft_consensus.cc:2272] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.113706 26158 tablet_replica.cc:333] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.120662 26158 raft_consensus.cc:2243] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.122027 26158 raft_consensus.cc:2272] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.125532 26158 tablet_replica.cc:333] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.126474 26158 raft_consensus.cc:2243] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.127882 26158 raft_consensus.cc:2272] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.131137 26158 tablet_replica.cc:333] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.132602 26158 raft_consensus.cc:2243] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.133889 26158 raft_consensus.cc:2272] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.136809 26158 tablet_replica.cc:333] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.137624 26158 raft_consensus.cc:2243] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.138269 26158 raft_consensus.cc:2272] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.141562 26158 tablet_replica.cc:333] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.142541 26158 raft_consensus.cc:2243] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.143371 26158 raft_consensus.cc:2272] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.147125 26158 tablet_replica.cc:333] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.147996 26158 raft_consensus.cc:2243] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.149109 26158 raft_consensus.cc:2272] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.152367 26158 tablet_replica.cc:333] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.153151 26158 raft_consensus.cc:2243] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.154035 26158 raft_consensus.cc:2272] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.166093 26158 tablet_replica.cc:333] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.167028 26158 raft_consensus.cc:2243] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.168813 26158 raft_consensus.cc:2272] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.171911 26158 tablet_replica.cc:333] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.172735 26158 raft_consensus.cc:2243] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.173372 26158 raft_consensus.cc:2272] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.176597 26158 tablet_replica.cc:333] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.177404 26158 raft_consensus.cc:2243] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.178061 26158 raft_consensus.cc:2272] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.181365 26158 tablet_replica.cc:333] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.182144 26158 raft_consensus.cc:2243] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.183286 26158 raft_consensus.cc:2272] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.187695 26158 tablet_replica.cc:333] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.188342 26158 raft_consensus.cc:2243] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.188894 26158 raft_consensus.cc:2272] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.191759 26158 tablet_replica.cc:333] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.192437 26158 raft_consensus.cc:2243] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.193506 26158 raft_consensus.cc:2272] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.196434 26158 tablet_replica.cc:333] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.197086 26158 raft_consensus.cc:2243] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:47.197644 26158 raft_consensus.cc:2272] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.200062 26158 tablet_replica.cc:333] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: stopping tablet replica
I20260709 13:12:47.200541 26158 raft_consensus.cc:2243] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:47.201355 26158 raft_consensus.cc:2272] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.987895  2323 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:47.990931  2323 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:47.993923  2323 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:47.998178  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
W20260709 13:12:48.011807  1568 leader_election.cc:336] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.012466  1568 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.013911  2323 raft_consensus.cc:2749] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.019701  2247 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.020561  2247 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.025868  2323 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.034474  2323 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.031526  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.023025  2247 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.042272  2247 raft_consensus.cc:493] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.043394  2247 raft_consensus.cc:515] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.044080  2212 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.045775  2247 leader_election.cc:290] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.045007  2246 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.047016  2246 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.051792  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.052695  2323 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.045614  2212 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.061892  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.071816  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.072551  1603 raft_consensus.cc:2468] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.073865  1718 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.074739  2212 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.075379  2212 raft_consensus.cc:2804] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.075807  2212 raft_consensus.cc:493] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.076226  2212 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.078794  1716 leader_election.cc:336] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.061628  2246 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:48.089205  1568 leader_election.cc:336] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.089322  1642 leader_election.cc:336] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.091297  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.095371  1642 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.096712  2212 raft_consensus.cc:515] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.098155  1748 raft_consensus.cc:2393] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 2: Already voted for candidate 81b721300bd34373862d7937c3bf394a in this term.
I20260709 13:12:48.100097  2355 raft_consensus.cc:2749] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.101729  1642 leader_election.cc:336] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.102227  1642 leader_election.cc:304] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.104873  2352 raft_consensus.cc:2749] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.106016  1642 leader_election.cc:336] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.106904  2255 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
W20260709 13:12:48.108494  1716 leader_election.cc:336] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.108835  2255 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.109623  2323 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.110178  2323 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.111013  2255 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.111753  1642 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.108150  1568 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.112953  2255 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.114598  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.115309  1673 raft_consensus.cc:2468] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.116794  1569 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:48.120752  2323 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.121524  2255 raft_consensus.cc:2749] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.122035  2323 raft_consensus.cc:2804] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.123835  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.124470  2352 raft_consensus.cc:2749] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.124622  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c105f80f46794d4c918b5380fdd165b3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.141047  1603 raft_consensus.cc:2468] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.142901  1718 leader_election.cc:304] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.143918  2353 raft_consensus.cc:2804] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.144476  2353 raft_consensus.cc:697] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.145503  2353 consensus_queue.cc:237] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.147186  2352 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.147845  2352 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
W20260709 13:12:48.149075  1568 leader_election.cc:336] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.149593  1568 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:48.150506  1568 leader_election.cc:336] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.150907  2356 raft_consensus.cc:2749] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.151566  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.126856  2323 raft_consensus.cc:493] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.153632  2352 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.125332  2212 leader_election.cc:290] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.154063  2323 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.154644  2356 raft_consensus.cc:493] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.155303  2356 raft_consensus.cc:515] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.157853  2356 leader_election.cc:290] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.160254  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.166039  2355 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.166623  2355 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.166937  2212 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.167541  2212 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.168823  2355 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.170498  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
W20260709 13:12:48.174870  1716 leader_election.cc:336] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.177469  2355 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.177696  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.178102  2355 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:48.177810  1642 leader_election.cc:336] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.179133  1718 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.179946  2317 raft_consensus.cc:2749] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.179993  2212 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.180151  2355 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.179447  1642 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.181298  2355 raft_consensus.cc:2749] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.181551  1642 leader_election.cc:336] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.183259  1642 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.184041  2355 raft_consensus.cc:2749] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.181701  1568 leader_election.cc:336] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.186190  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.186316  1568 leader_election.cc:304] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.187095  2356 raft_consensus.cc:2749] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.187829  2212 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.183916  2323 raft_consensus.cc:515] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.188380  2212 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.189168  2356 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.189733  2356 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.191358  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.192304  2356 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.192871  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c413246a168d46a28a09378837a4453e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.193531  1672 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.196867  1642 leader_election.cc:336] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.197337  1642 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.198975  2355 raft_consensus.cc:2749] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:48.199854  1716 leader_election.cc:336] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.200344  1716 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.199512  1424 catalog_manager.cc:5697] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.202598  2356 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.203143  2356 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.205236  2356 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.207942  2353 raft_consensus.cc:2749] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.208868  2212 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.209820  2323 leader_election.cc:290] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.211831  2353 raft_consensus.cc:493] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.212005  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.212422  2353 raft_consensus.cc:515] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.212711  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.213399  1749 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.215305  2212 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.215677  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.215809  2212 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.216298  1603 raft_consensus.cc:2468] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.217556  1718 leader_election.cc:304] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.217988  2212 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.218416  2317 raft_consensus.cc:2804] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.218595  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.218880  2317 raft_consensus.cc:493] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.219357  2317 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.219395  1673 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.220923  1717 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
W20260709 13:12:48.225008  1716 leader_election.cc:336] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.225534  2354 raft_consensus.cc:2804] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.225997  2354 raft_consensus.cc:493] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.226354  2354 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.227880  1716 leader_election.cc:336] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.230372  2356 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.214844  1672 raft_consensus.cc:2468] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:48.231261  2353 leader_election.cc:290] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.232151  1569 leader_election.cc:304] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:48.230948  2356 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.233037  2255 raft_consensus.cc:2804] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.233593  2255 raft_consensus.cc:697] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:48.234500  2255 consensus_queue.cc:237] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.234674  1568 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.234719  2356 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.237561  2356 raft_consensus.cc:2804] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.238067  2356 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.238569  2356 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.240196  2354 raft_consensus.cc:515] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.253239  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "062b7dfb8c3f4c0498cd8d10a1d2dd26" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.253916  1672 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.256369  1716 leader_election.cc:336] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.252069  2354 leader_election.cc:290] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.252024  2317 raft_consensus.cc:515] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.261170  2317 leader_election.cc:290] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.262794  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e6f598fa6943a3b2a180ba51e31e1c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.263435  1603 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.262351  2356 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.265149  2356 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.266970  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
W20260709 13:12:48.269016  1568 leader_election.cc:336] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.269748  1568 leader_election.cc:336] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.270124  1568 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:48.270967  1568 leader_election.cc:336] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.272789  2323 raft_consensus.cc:2749] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.274545  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:48.275230  1749 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.275597  1568 leader_election.cc:336] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.276103  1568 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.275100  2317 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.278688  2317 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.278009  1603 raft_consensus.cc:2468] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.280261  1718 leader_election.cc:304] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.280833  2317 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.281435  2354 raft_consensus.cc:2804] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.281972  2354 raft_consensus.cc:697] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
W20260709 13:12:48.283128  1716 leader_election.cc:336] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.284474  2255 raft_consensus.cc:2749] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.283993  2354 consensus_queue.cc:237] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.285605  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.292209  1427 catalog_manager.cc:5697] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.299233  2353 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.299985  2353 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.287560  1672 raft_consensus.cc:2468] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.301925  2355 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.302073  1717 leader_election.cc:304] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.302558  2355 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.303025  2317 raft_consensus.cc:2804] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.304690  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.305461  1679 raft_consensus.cc:2468] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.302574  2353 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.304032  2317 raft_consensus.cc:697] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.306596  2355 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.306841  1717 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.306996  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.307694  2317 consensus_queue.cc:237] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:48.308998  1716 leader_election.cc:336] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.309298  2353 raft_consensus.cc:2804] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.309518  1716 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.309837  2353 raft_consensus.cc:493] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.310348  2212 raft_consensus.cc:2749] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.311928  1749 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:48.310364  2353 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.317577 26158 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:48.317581  1642 leader_election.cc:336] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.318630  1642 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.320021  2355 raft_consensus.cc:2749] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.321233  2212 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.321822  2212 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.324862  2212 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.314551  1568 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.326154  2255 raft_consensus.cc:2804] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.326691  2255 raft_consensus.cc:697] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:48.327509  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.328197  1603 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.327876  2255 consensus_queue.cc:237] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.329589  1718 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
W20260709 13:12:48.330394  1568 leader_election.cc:336] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.335745  2212 raft_consensus.cc:2804] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.336288  2212 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.336664  2212 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.357059  2353 raft_consensus.cc:515] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.359884  2353 leader_election.cc:290] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.360611  2353 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.364864  2353 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.371551  2356 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.372383  2356 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.376783  2360 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.377456  2360 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.381856  2355 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.383304  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5160521b61c64b3197aeb0a169fecff3" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.382934  2355 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.384032  1672 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.394496  2355 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:48.400250  1642 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.401201  1672 raft_consensus.cc:2468] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.384001  2353 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.404520  2212 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:48.419534  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 55777.8us
W20260709 13:12:48.418490  1716 leader_election.cc:336] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.420781  1717 leader_election.cc:304] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.421694  2354 raft_consensus.cc:2804] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.425117  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.425962  1603 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.428201  2323 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.428813  2323 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.422739  2212 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.430692  2212 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.425163  2354 raft_consensus.cc:697] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.431391  2212 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:48.432987  1716 leader_election.cc:336] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.432868  2354 consensus_queue.cc:237] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:48.435731  1716 leader_election.cc:336] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.436072  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
W20260709 13:12:48.436515  1716 leader_election.cc:336] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.436939  1603 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.439424  1718 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.430838  2323 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.441160  2317 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.446525  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.442891  2353 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.449277  2353 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.449687  2353 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.449860  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.450583  1675 raft_consensus.cc:2468] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.453305  2360 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
W20260709 13:12:48.456709  1716 leader_election.cc:336] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.454867  2247 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.448041  2317 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.457528  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.457996  2247 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.459873  2317 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.460433  2317 raft_consensus.cc:493] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.460930  2367 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.461594  2367 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.462762  1599 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:48.460940  2317 raft_consensus.cc:515] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.463729  2356 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.465173  2317 leader_election.cc:290] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.465266  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.465502  2247 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.466013  1675 raft_consensus.cc:2468] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.467718  2367 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.456905  1569 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
W20260709 13:12:48.474323  1642 leader_election.cc:336] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.476389  1603 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.478097  2212 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.481304  1599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.482103  1599 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.483326  1718 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.484683  2212 raft_consensus.cc:2804] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.485351  2212 raft_consensus.cc:697] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.486428  2212 consensus_queue.cc:237] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.489108  2353 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.490485  1718 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
W20260709 13:12:48.491395  1568 leader_election.cc:336] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.492092  1568 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:48.495959  1568 leader_election.cc:336] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.497148  1568 leader_election.cc:336] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.499605  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.500535  1603 raft_consensus.cc:2468] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.501504  2368 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.501737  2353 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.502115  2368 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.491714  2369 raft_consensus.cc:2804] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.504251  2369 raft_consensus.cc:493] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.504427  2356 raft_consensus.cc:2804] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.504678  2369 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.504858  2356 raft_consensus.cc:493] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.505295  2356 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.508339  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.509053  1672 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
W20260709 13:12:48.509599  1716 leader_election.cc:336] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.509895  1644 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.511346  2355 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.511761  2355 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.512127  2355 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.515614  2368 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.517894  1718 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.503866  2323 raft_consensus.cc:2749] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.523509  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.524170  1672 raft_consensus.cc:2468] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.526149  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
W20260709 13:12:48.526281  1716 leader_election.cc:336] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.527333  1716 leader_election.cc:336] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.531057  1717 leader_election.cc:304] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:48.532697  1568 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.537892  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.538712  1603 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.537164  2356 raft_consensus.cc:515] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.521854  1569 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.544473  1569 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.556623  2246 raft_consensus.cc:493] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.557300  2246 raft_consensus.cc:515] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.559865  2246 leader_election.cc:290] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.562034  2356 leader_election.cc:290] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.562282  2365 raft_consensus.cc:2804] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.562951  2365 raft_consensus.cc:493] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.563501  2365 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.569343  2362 raft_consensus.cc:2804] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.569860  2362 raft_consensus.cc:493] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.570261  2362 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.574376  1644 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.581369  1603 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.521147  2255 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.537006  2354 raft_consensus.cc:2804] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.584410  2354 raft_consensus.cc:493] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.584983  2354 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.572033  2372 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.596803  2255 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.597180  2372 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.598275  2246 raft_consensus.cc:2749] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.599551  2372 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.600230  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.602417  2367 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.602932  2255 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.602984  2367 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.604700  2367 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.539804  2352 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.608394  2352 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.608578  2360 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.609000  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.609758  1672 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.609468  2360 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.610774  2352 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:48.608403  1568 leader_election.cc:336] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.611929  1568 leader_election.cc:336] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.612617  1717 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.613767  2372 raft_consensus.cc:2804] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.614149  2372 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.614578  2372 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.615353  2369 raft_consensus.cc:515] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:48.616147  1568 leader_election.cc:336] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.618427  2369 leader_election.cc:290] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.619328  2368 raft_consensus.cc:493] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.620083  2368 raft_consensus.cc:515] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.626673  1718 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.635723  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ee3a20a0274ce9b86ef729e86f8669" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.636480  1603 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.634512  2247 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.636021  2323 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.655308  2368 leader_election.cc:290] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.661972  2323 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.672089  2369 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.672713  2369 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.674784  2369 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.658594  2247 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.675272  2380 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.675848  2380 raft_consensus.cc:697] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.677033  2247 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:48.683547  1568 leader_election.cc:336] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.684401  2354 raft_consensus.cc:515] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.685262  2360 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.688679  2323 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.690526  2354 leader_election.cc:290] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.691221  2354 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
W20260709 13:12:48.684352  1568 leader_election.cc:336] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.693696  2355 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.694329  2367 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.695390  2354 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.697387  1603 raft_consensus.cc:2468] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.676697  2380 consensus_queue.cc:237] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.703073  1718 leader_election.cc:304] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.702054  2365 raft_consensus.cc:515] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.711941  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.712239  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978d44de9b6f410a9c94c0898667c8f1" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.712707  1675 raft_consensus.cc:2468] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.712831  1672 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.715066  1600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.715826  1600 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.664866  2352 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.696116  2355 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.721568  1569 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.721792  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.721554  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.722615  1679 raft_consensus.cc:2468] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.722833  1678 raft_consensus.cc:2393] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 2: Already voted for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in this term.
I20260709 13:12:48.721621  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:48.724049  1673 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 1.
I20260709 13:12:48.716701  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.725207  1598 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.724525  1427 catalog_manager.cc:5697] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.726056  2368 raft_consensus.cc:2804] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.726486  2368 raft_consensus.cc:493] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.716526  2352 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.726341  1427 catalog_manager.cc:5697] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.728730  1427 catalog_manager.cc:5697] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.729468  2352 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.730428  1427 catalog_manager.cc:5697] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.726881  2368 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.708719  2379 raft_consensus.cc:2804] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.731427  1672 raft_consensus.cc:2468] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:48.706964  2367 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
W20260709 13:12:48.751214  1568 leader_election.cc:336] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.726068  2362 raft_consensus.cc:515] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.739591  1569 leader_election.cc:304] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.750419  1718 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
W20260709 13:12:48.739080  1716 leader_election.cc:336] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.763774  1568 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.764045  1600 raft_consensus.cc:2468] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.765297  2367 raft_consensus.cc:2804] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.767511  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.767439  2368 raft_consensus.cc:515] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.768791  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.769459  1601 raft_consensus.cc:2393] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 2: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:48.769754  2368 leader_election.cc:290] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.770222  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.770689  1604 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:48.771642  1598 raft_consensus.cc:2393] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c68eed42dc40c4ac69ff82c925b3f0 in current term 2: Already voted for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in this term.
I20260709 13:12:48.771808  1718 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
W20260709 13:12:48.772359  1568 leader_election.cc:336] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.772568  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" is_pre_election: true
I20260709 13:12:48.773123  1603 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 1.
I20260709 13:12:48.773984  1672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c508d13a2e4137b001068a1d1a3a28" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.774504  1672 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.766971  1569 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.777420  2377 raft_consensus.cc:2749] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:48.782068  1569 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.784431  2369 raft_consensus.cc:2804] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.745744  2379 raft_consensus.cc:697] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.784992  2369 raft_consensus.cc:697] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.785931  2379 consensus_queue.cc:237] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.786665  2372 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:48.787292  1568 leader_election.cc:336] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.784428  2323 raft_consensus.cc:2804] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.788265  2323 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.788654  2323 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.783937  1569 leader_election.cc:304] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.786018  2369 consensus_queue.cc:237] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.795459  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ae70b3df284d3faf8022535886954e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.796056  1673 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.796571  1716 leader_election.cc:336] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.788938  2372 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.790860  1678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.795037  1679 raft_consensus.cc:1275] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:48.799654  1678 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.800287  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.800873  2377 consensus_queue.cc:1048] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:48.792500  2381 raft_consensus.cc:2804] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.793056  2368 raft_consensus.cc:2804] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.801994  2368 raft_consensus.cc:697] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:48.802846  2368 consensus_queue.cc:237] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.805862  2381 raft_consensus.cc:493] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.765729  2367 raft_consensus.cc:493] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.783707  1718 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.806143  1673 raft_consensus.cc:2468] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:48.806499  2367 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.800907  1748 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
I20260709 13:12:48.807869  1569 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.806337  2381 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.817238  2362 leader_election.cc:290] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:48.797353  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:48.806865  2317 raft_consensus.cc:2804] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.742597  2365 leader_election.cc:290] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.812908  1678 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.818225  2317 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.818925  2317 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.806077  2323 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.820284  1717 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.819314  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3239aa727f34be3b22879bece578a0c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.798530  1644 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:48.756784  2354 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:12:48.823637  1716 leader_election.cc:336] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.824076  1673 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.824973  1716 leader_election.cc:336] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.826705  2372 raft_consensus.cc:2804] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.827479  2372 raft_consensus.cc:697] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.829923  2372 consensus_queue.cc:237] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.832513  2365 raft_consensus.cc:2804] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.833096  2365 raft_consensus.cc:697] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:48.833972  2365 consensus_queue.cc:237] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
W20260709 13:12:48.835691  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:48.829499  1427 catalog_manager.cc:5697] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:48.843222  2382 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.843832  2382 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.844918  2323 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:48.845997  2382 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:48.847740  1716 leader_election.cc:336] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.848620  1716 leader_election.cc:336] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.850118  1716 leader_election.cc:336] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:48.852931  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 54467.1us
I20260709 13:12:48.853688  1673 raft_consensus.cc:2468] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:48.855423  2352 raft_consensus.cc:2804] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.855742  1675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:48.855881  1717 leader_election.cc:304] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.856411  1675 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.855903  2352 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.857172  2352 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:48.860251  1568 leader_election.cc:336] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.863337  2380 raft_consensus.cc:2804] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:48.863986  2380 raft_consensus.cc:697] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:48.864876  2380 consensus_queue.cc:237] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.866593  1642 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:48.867437  2355 raft_consensus.cc:2804] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:48.867869  2355 raft_consensus.cc:493] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:12:48.868273  2355 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.849352  2317 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:48.887044  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35b348df9bbb4e10aedb07823b2f015d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.889405  2355 raft_consensus.cc:515] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.895790  1748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.896559  1748 raft_consensus.cc:2468] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 1.
W20260709 13:12:48.894603  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:48.897593  1716 leader_election.cc:336] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:48.883937  2367 raft_consensus.cc:515] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:48.905661  1598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:48.906705  1598 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:48.916345  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a" is_pre_election: true
I20260709 13:12:48.913981  2317 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:48.912074  1427 catalog_manager.cc:5697] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.980754  1675 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:48.984779  1673 raft_consensus.cc:1275] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:48.986405  1604 raft_consensus.cc:1275] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:48.984571  1427 catalog_manager.cc:5697] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.991008  1427 catalog_manager.cc:5697] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:48.993160  1749 raft_consensus.cc:1275] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:48.994972  1568 leader_election.cc:304] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:48.998705  1569 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:49.000648  1642 leader_election.cc:336] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.001341  1642 leader_election.cc:304] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.007812  2323 raft_consensus.cc:2749] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.009171  2355 leader_election.cc:290] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:48.916961  2352 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:48.910151  2367 leader_election.cc:290] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:12:49.011265  2352 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:49.018340  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea444d3b35d44516a3598e78aa5a6771" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:49.019014  1679 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.020509  2255 raft_consensus.cc:2804] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.026264  2255 raft_consensus.cc:697] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:49.027276  2255 consensus_queue.cc:237] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:49.012312  1672 raft_consensus.cc:2468] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:49.015882  2381 raft_consensus.cc:515] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:49.038980  1569 leader_election.cc:304] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.040678  2381 leader_election.cc:290] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:12:49.035781  1603 raft_consensus.cc:1275] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:49.033540  1642 leader_election.cc:336] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.049302  1642 leader_election.cc:336] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.049719  1642 leader_election.cc:304] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.056192  1747 raft_consensus.cc:2393] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in current term 2: Already voted for candidate 81b721300bd34373862d7937c3bf394a in this term.
I20260709 13:12:49.035297  2395 consensus_queue.cc:1048] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:12:49.059403  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 44598.6us
I20260709 13:12:49.061134  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
W20260709 13:12:49.061254  1568 leader_election.cc:336] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.061818  1604 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:49.072407  1642 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.072950  1642 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:49.076406  1642 leader_election.cc:336] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.058531  2323 raft_consensus.cc:2804] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.070185  2247 raft_consensus.cc:2749] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.087509  1679 raft_consensus.cc:2468] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:12:49.151618  1569 leader_election.cc:304] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.043465  2317 consensus_queue.cc:1048] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:12:49.155285  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c76ddc05f4da4c84b448ea837803e27c" candidate_uuid: "81b721300bd34373862d7937c3bf394a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:12:49.155925  1603 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:49.156807  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 79437us
W20260709 13:12:49.159782  2390 log.cc:927] Time spent T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:12:49.161826  2393 log.cc:927] Time spent T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:49.089780  2355 raft_consensus.cc:2749] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:49.172757  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 83128.2us
W20260709 13:12:49.175148  1568 consensus_peers.cc:597] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.075958  2382 raft_consensus.cc:2749] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:49.175876  1427 catalog_manager.cc:5697] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.179868  1427 catalog_manager.cc:5697] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:49.181155  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.087509  1598 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:49.167008  1603 raft_consensus.cc:2468] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b721300bd34373862d7937c3bf394a in term 2.
I20260709 13:12:49.185122  1718 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:49.077075  2369 consensus_queue.cc:1048] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:12:49.186293  1642 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:49.187870  2379 raft_consensus.cc:2804] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.177901  2360 raft_consensus.cc:2804] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:12:49.202224  1642 leader_election.cc:336] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.208767  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 192711us
I20260709 13:12:49.227746  1604 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:12:49.234486  1644 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:12:49.213940  2379 raft_consensus.cc:697] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:49.220265  2360 raft_consensus.cc:697] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
W20260709 13:12:49.264709  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.238775  2352 raft_consensus.cc:2804] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.239544  2374 raft_consensus.cc:2804] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:49.280449  2360 consensus_queue.cc:237] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:49.282989  1718 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:12:49.283387  1600 raft_consensus.cc:1275] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.280535  2352 raft_consensus.cc:697] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:49.263916  2323 raft_consensus.cc:697] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:49.284922  2403 raft_consensus.cc:2804] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.285622  2352 consensus_queue.cc:237] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:49.285931  2323 consensus_queue.cc:237] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:49.286477  2403 raft_consensus.cc:697] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Leader. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:12:49.277465  2374 raft_consensus.cc:493] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
W20260709 13:12:49.289357  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.290496  1678 raft_consensus.cc:1275] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:49.293118  1642 consensus_peers.cc:597] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.302415  1676 raft_consensus.cc:1275] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.302284  1747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793b9da3cfbe48f7912724719cac2e28" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:49.303371  1747 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.304317  2401 consensus_queue.cc:1048] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:49.306156  1716 leader_election.cc:336] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:49.308599  2404 consensus_queue.cc:1048] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:12:49.310016  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.310582  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.290817  2374 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.266968  2379 consensus_queue.cc:237] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:49.319249 26158 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:49.321798  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.322357  1642 leader_election.cc:336] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.329013  1642 leader_election.cc:336] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.330014  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.330560  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.338035  1568 leader_election.cc:304] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.338753  2377 consensus_queue.cc:1048] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:49.339529  2368 raft_consensus.cc:2749] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:49.350749  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.351346  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.351797  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.352427  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.360728  1678 raft_consensus.cc:1275] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:49.374598  1716 leader_election.cc:336] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.377497  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.379783  2375 consensus_queue.cc:1048] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:12:49.356235  2403 consensus_queue.cc:237] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:49.415472  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 45352.9us
I20260709 13:12:49.410413  2395 consensus_queue.cc:1048] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:12:49.406307  2374 raft_consensus.cc:515] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:49.485379  1747 raft_consensus.cc:2468] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:12:49.485952  2374 leader_election.cc:290] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:12:49.487813  2411 log.cc:927] Time spent T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:12:49.488780  2409 log.cc:927] Time spent T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:49.489537  1679 raft_consensus.cc:1275] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.474195  1428 catalog_manager.cc:5697] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.492790  1428 catalog_manager.cc:5697] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.497490  1642 leader_election.cc:304] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:49.497757  2317 consensus_queue.cc:1048] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:49.499837  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64bfde6140f041d3835174d6009e02d2" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:12:49.500049  2246 raft_consensus.cc:2804] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.500574  1752 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:49.500685  2246 raft_consensus.cc:697] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:49.501835  2246 consensus_queue.cc:237] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
W20260709 13:12:49.511706  1642 leader_election.cc:336] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:12:49.557416  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.557844  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 179939us
W20260709 13:12:49.558251  1716 consensus_peers.cc:597] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.558578  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.559296  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.559696  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.560199  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.560515  1716 consensus_peers.cc:597] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.572983  1752 raft_consensus.cc:2468] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:12:49.593950  1642 leader_election.cc:304] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: f0f836402fd5410b9deb0c569dbc1a7e
W20260709 13:12:49.596670  2424 log.cc:927] Time spent T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:12:49.597736  1568 consensus_peers.cc:597] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.599393  2412 raft_consensus.cc:2804] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:49.600004  2412 raft_consensus.cc:697] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:12:49.601089  2412 consensus_queue.cc:237] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:49.604117  1598 raft_consensus.cc:1275] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.610138  1673 raft_consensus.cc:1275] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.612427  1598 raft_consensus.cc:1275] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.616544  1603 raft_consensus.cc:1275] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.618811  1427 catalog_manager.cc:5697] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:49.631614  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.634078  1568 consensus_peers.cc:597] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.636615  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.636449  2405 consensus_queue.cc:1048] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:12:49.637120  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.639454  2377 consensus_queue.cc:1048] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:49.640419  2397 consensus_queue.cc:1048] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:49.645810  1673 raft_consensus.cc:1275] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.645939  2369 consensus_queue.cc:1048] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:12:49.671118  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.671730  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.677523  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:49.675966  2403 consensus_queue.cc:1048] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:12:49.724097  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 45594.3us
W20260709 13:12:49.727415  1716 consensus_peers.cc:597] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.727877  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 55610.5us
W20260709 13:12:49.728590  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.758703  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.759589  1568 consensus_peers.cc:597] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.771917  1600 raft_consensus.cc:1275] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.774055  2247 consensus_queue.cc:1048] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:49.779639  1428 catalog_manager.cc:5697] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.787495  1428 catalog_manager.cc:5697] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.789354  1428 catalog_manager.cc:5697] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:49.814088  1568 consensus_peers.cc:597] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:49.814605  1568 consensus_peers.cc:597] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.824833  1598 raft_consensus.cc:1275] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.828981  2317 consensus_queue.cc:1048] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.832163  1427 catalog_manager.cc:5697] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.841642  1427 catalog_manager.cc:5697] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:49.845232  1642 consensus_peers.cc:597] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.887468  1678 raft_consensus.cc:1275] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.888938  2377 consensus_queue.cc:1048] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:49.905725  1642 consensus_peers.cc:597] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.893757  1427 catalog_manager.cc:5697] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:49.917266  1673 raft_consensus.cc:1275] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:49.919911  2368 consensus_queue.cc:1048] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:49.921931  1427 catalog_manager.cc:5697] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a reported cstate change: term changed from 1 to 2, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 81b721300bd34373862d7937c3bf394a (127.25.139.132). New cstate: current_term: 2 leader_uuid: "81b721300bd34373862d7937c3bf394a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:49.926074  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.993214  1747 raft_consensus.cc:1275] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:50.006552  1716 consensus_peers.cc:597] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:50.009169  1642 consensus_peers.cc:597] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:49.995203  2412 consensus_queue.cc:1048] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:12:50.093335  1600 raft_consensus.cc:1275] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 81b721300bd34373862d7937c3bf394a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.095284  2380 consensus_queue.cc:1048] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.202076  1748 raft_consensus.cc:1275] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.203802  2412 consensus_queue.cc:1048] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:50.319787 26158 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1551)
I20260709 13:12:50.889801  2360 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:50.890690  2360 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:50.895610  2360 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:50.898363  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" is_pre_election: true
I20260709 13:12:50.902889  1679 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
W20260709 13:12:50.903944  1568 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:50.904641  1569 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:50.905400  2360 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:50.905884  2360 raft_consensus.cc:493] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:50.906304  2360 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.920107  2360 raft_consensus.cc:515] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:50.924926  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c161302a6f43a2a5815562dd376bb7" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:12:50.930152  1679 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:50.928853  1568 leader_election.cc:336] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:12:50.924225  2360 leader_election.cc:290] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 election: Requested vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:12:50.951884  1679 raft_consensus.cc:2468] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 3.
I20260709 13:12:50.954058  1569 leader_election.cc:304] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:12:50.955272  2360 raft_consensus.cc:2804] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:50.956640  2360 raft_consensus.cc:697] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:12:50.957826  2360 consensus_queue.cc:237] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:50.975591  1427 catalog_manager.cc:5697] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 3, leader changed from f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 3 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:51.230856  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.321334 26158 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:51.343310  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.384774  1568 consensus_peers.cc:597] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:51.404505  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.430073  1568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111) [suppressed 389 similar messages]
I20260709 13:12:51.453496  1679 raft_consensus.cc:1275] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:51.455404  2360 consensus_queue.cc:1048] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:51.459940  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.481587  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.534677  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.580900  1716 consensus_peers.cc:597] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.638141  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.638830  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.833755  1716 consensus_peers.cc:597] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.944695  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:51.950428  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.957118  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:51.960889  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.176159  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.176839  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.177085  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 253493us
W20260709 13:12:52.223152  1568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.009s
W20260709 13:12:52.223590  1568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.006s	sys 0.009s
W20260709 13:12:52.273725  1642 consensus_peers.cc:597] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.291687  1716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 318379us
W20260709 13:12:52.297122  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.299695  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.301875  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.308346  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.309304  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.317513  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.318122  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.318657  1716 consensus_peers.cc:597] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.321863 26158 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:52.369421  1642 consensus_peers.cc:597] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.401290  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.402298  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.402766  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.403302  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.403741  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.404176  1568 consensus_peers.cc:597] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.404606  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.405131  1568 consensus_peers.cc:597] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.405565  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.534868  1568 consensus_peers.cc:597] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.593407  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 58594.6us
W20260709 13:12:52.687736  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 49862.5us
W20260709 13:12:52.695457  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.697171  1568 consensus_peers.cc:597] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.751639  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 54524.6us
W20260709 13:12:52.777029  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:52.795411  1716 consensus_peers.cc:597] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.811386  1568 consensus_peers.cc:597] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:52.952224  1568 consensus_peers.cc:597] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:53.069181  1642 consensus_peers.cc:597] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:53.148036  1642 consensus_peers.cc:597] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:53.150065  1700 debug-util.cc:398] Leaking SignalData structure 0x7b08000f66c0 after lost signal to thread 26161
W20260709 13:12:53.151394  1700 debug-util.cc:398] Leaking SignalData structure 0x7b080037a0a0 after lost signal to thread 1462
W20260709 13:12:53.152909  1700 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4d60 after lost signal to thread 1629
W20260709 13:12:53.154165  1700 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf3e0 after lost signal to thread 1703
W20260709 13:12:53.155409  1700 debug-util.cc:398] Leaking SignalData structure 0x7b080026ff00 after lost signal to thread 1777
W20260709 13:12:53.322304 26158 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:53.866966  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:53.908557  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 45808.3us
W20260709 13:12:53.910036  1642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 46125.6us
W20260709 13:12:53.950021  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:53.951598  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.043565  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.044445  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.086259  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.114888  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.210326  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.252972  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.272392  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.322809 26158 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:54.379154  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 60686.9us
W20260709 13:12:54.401052  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.414359  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.424721  1716 consensus_peers.cc:597] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.427695  1716 consensus_peers.cc:597] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.429080  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.438158  1568 consensus_peers.cc:597] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:54.429538  1716 consensus_peers.cc:597] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.531998  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.581171  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.582641  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.590830  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.592972  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.615643  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.658933  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.743306  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.819720  1642 consensus_peers.cc:597] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.851699  1642 consensus_peers.cc:597] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.869498  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.894078  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.912057  1568 consensus_peers.cc:597] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.914258  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:54.942827  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.946511  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.982532  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:54.992087  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.005174  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:55.135914  1568 consensus_peers.cc:597] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.137436  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:55.156071  1568 consensus_peers.cc:597] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.214272  1716 consensus_peers.cc:597] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.323371 26158 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:55.323225  1568 consensus_peers.cc:597] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.494277  1568 consensus_peers.cc:597] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.577467  1568 consensus_peers.cc:597] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:55.771792  1644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35065, user_credentials={real_user=slave}} blocked reactor thread for 54538.1us
W20260709 13:12:55.817467  1642 consensus_peers.cc:597] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:56.000598  1642 consensus_peers.cc:597] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:56.323879 26158 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:56.411849  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.432279  1568 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111) [suppressed 411 similar messages]
W20260709 13:12:56.452699  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.556463  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.626498  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.657382  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.669162  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.728607  1716 consensus_peers.cc:597] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.746050  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.759516  1716 consensus_peers.cc:597] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.783529  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.809525  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.855683  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.865095  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.875190  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.877592  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.896823  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:56.943638  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.946419  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:56.980504  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.069888  1568 consensus_peers.cc:597] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.084352  1568 consensus_peers.cc:597] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:57.164150  1642 consensus_peers.cc:597] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.183207  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.197166  1716 consensus_peers.cc:597] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.202060  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.228155  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.275780  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.324716 26158 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1551)
W20260709 13:12:57.327796  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.341410  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.380316  1568 consensus_peers.cc:597] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.390065  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.416175  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.449178  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.535501  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.627738  1642 consensus_peers.cc:597] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.796875  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 50398.4us
W20260709 13:12:57.800433  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.836894  1568 consensus_peers.cc:597] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.855926  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:57.855263  1716 consensus_peers.cc:597] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:57.844121  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:57.936693 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
I20260709 13:12:58.101634 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:58.117465  2497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.133785  2498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.146776  1717 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 52395.1us
W20260709 13:12:58.165046  2500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.162014  1568 consensus_peers.cc:597] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:58.180438 26158 server_base.cc:1061] running on GCE node
I20260709 13:12:58.188982 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:58.189455 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:58.189724 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602778189705 us; error 0 us; skew 500 ppm
I20260709 13:12:58.190676 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:12:58.184751  1568 consensus_peers.cc:597] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:58.206492 26158 webserver.cc:533] Webserver started at http://127.25.139.129:36365/ using document root <none> and password file <none>
I20260709 13:12:58.207427 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:58.207809 26158 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:58.214018 26158 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:58.227782  2505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.228891 26158 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:12:58.229333 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
format_stamp: "Formatted at 2026-07-09 13:12:33 on dist-test-slave-v5z2"
I20260709 13:12:58.230078 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:12:58.250937  1568 consensus_peers.cc:597] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:58.300549 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:58.302585 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:58.324050 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:58.338974  2513 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:12:58.460297  1642 consensus_peers.cc:597] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:58.588047  1642 consensus_peers.cc:597] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:58.721626 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:58.722154 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.392s	user 0.014s	sys 0.005s
I20260709 13:12:58.722581 26158 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:58.732967  2513 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:58.754068  2513 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.755208  2513 tablet_bootstrap.cc:492] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:58.755964  2513 ts_tablet_manager.cc:1403] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:12:58.759567  2513 raft_consensus.cc:359] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:58.760979  2513 raft_consensus.cc:740] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.761981  2513 consensus_queue.cc:260] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:58.779522  2513 ts_tablet_manager.cc:1434] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:12:58.780647  2513 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:58.819837  2513 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.821018  2513 tablet_bootstrap.cc:492] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:58.822510  2513 ts_tablet_manager.cc:1403] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.012s
I20260709 13:12:58.828298  2513 raft_consensus.cc:359] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:58.833539  2513 raft_consensus.cc:740] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
W20260709 13:12:58.833674  1642 consensus_peers.cc:597] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:58.834425  2513 consensus_queue.cc:260] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:58.836791  2513 ts_tablet_manager.cc:1434] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:58.837680  2513 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:58.870352  2513 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.871685  2513 tablet_bootstrap.cc:492] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:58.872550  2513 ts_tablet_manager.cc:1403] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.019s
I20260709 13:12:58.875774  2513 raft_consensus.cc:359] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.877537  2513 raft_consensus.cc:740] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.878432  2513 consensus_queue.cc:260] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.880970  2513 ts_tablet_manager.cc:1434] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:12:58.881870  2513 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:58.904713  2513 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.905867  2513 tablet_bootstrap.cc:492] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:58.906850  2513 ts_tablet_manager.cc:1403] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:12:58.912936  2513 raft_consensus.cc:359] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.914191  2513 raft_consensus.cc:740] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.915115  2513 consensus_queue.cc:260] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.917320  2513 ts_tablet_manager.cc:1434] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:58.918239  2513 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:58.945092  2513 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:58.946192  2513 tablet_bootstrap.cc:492] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:58.946913  2513 ts_tablet_manager.cc:1403] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:12:58.949615  2513 raft_consensus.cc:359] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.950440  2513 raft_consensus.cc:740] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.951251  2513 consensus_queue.cc:260] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:58.953634  2513 ts_tablet_manager.cc:1434] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:58.954486  2513 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:58.963841  1716 consensus_peers.cc:597] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.002383  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:59.029474  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.033545  2513 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.035183  2513 tablet_bootstrap.cc:492] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.036017  2513 ts_tablet_manager.cc:1403] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.082s	user 0.030s	sys 0.035s
I20260709 13:12:59.039247  2513 raft_consensus.cc:359] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.040570  2513 raft_consensus.cc:740] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.042462  2513 consensus_queue.cc:260] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.045557  2513 ts_tablet_manager.cc:1434] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:59.046428  2513 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.071233  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.077193  2513 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.078361  2513 tablet_bootstrap.cc:492] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.079140  2513 ts_tablet_manager.cc:1403] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.003s
I20260709 13:12:59.082093  2513 raft_consensus.cc:359] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.083446  2513 raft_consensus.cc:740] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.084331  2513 consensus_queue.cc:260] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.086849  2513 ts_tablet_manager.cc:1434] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:12:59.087808  2513 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.137746  2513 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.138931  2513 tablet_bootstrap.cc:492] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.139746  2513 ts_tablet_manager.cc:1403] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.008s
I20260709 13:12:59.142517  2513 raft_consensus.cc:359] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.143325  2513 raft_consensus.cc:740] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.144141  2513 consensus_queue.cc:260] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.146494  2513 ts_tablet_manager.cc:1434] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:12:59.147511  2513 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.156438  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.169888  2513 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.171368  2513 tablet_bootstrap.cc:492] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.172216  2513 ts_tablet_manager.cc:1403] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:12:59.175202  2513 raft_consensus.cc:359] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.176038  2513 raft_consensus.cc:740] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.177006  2513 consensus_queue.cc:260] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.179569  2513 ts_tablet_manager.cc:1434] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:59.180552  2513 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.191895  1568 consensus_peers.cc:597] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.198519  1716 consensus_peers.cc:597] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:59.195953  1568 consensus_peers.cc:597] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:59.203028  2513 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.204116  2513 tablet_bootstrap.cc:492] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.204819  2513 ts_tablet_manager.cc:1403] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:12:59.207746  2513 raft_consensus.cc:359] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.208379  2513 raft_consensus.cc:740] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.209040  2513 consensus_queue.cc:260] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.210940  2513 ts_tablet_manager.cc:1434] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:59.211902  2513 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.219604 26158 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:59.220126 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.498s	user 0.297s	sys 0.015s
W20260709 13:12:59.242767  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.269203  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.269840  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:59.275408  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:59.283684  2513 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.284857  2513 tablet_bootstrap.cc:492] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.285635  2513 ts_tablet_manager.cc:1403] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.039s
I20260709 13:12:59.289645  2513 raft_consensus.cc:359] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.290498  2513 raft_consensus.cc:740] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.291364  2513 consensus_queue.cc:260] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.294021  2513 ts_tablet_manager.cc:1434] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:59.294888  2513 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.317999  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.319303  2513 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.320425  2513 tablet_bootstrap.cc:492] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.321344  2513 ts_tablet_manager.cc:1403] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:12:59.324438  2513 raft_consensus.cc:359] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.325239  2513 raft_consensus.cc:740] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.325964  2513 consensus_queue.cc:260] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.330251  2513 ts_tablet_manager.cc:1434] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.332516  2513 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.332942  1716 consensus_peers.cc:597] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:59.354871  2513 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.356177  2513 tablet_bootstrap.cc:492] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.357707  2513 ts_tablet_manager.cc:1403] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.000s
I20260709 13:12:59.360663  2513 raft_consensus.cc:359] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.361521  2513 raft_consensus.cc:740] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.362457  2513 consensus_queue.cc:260] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.365031  2513 ts_tablet_manager.cc:1434] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.365904  2513 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.392731  2513 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.394091  2513 tablet_bootstrap.cc:492] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.394935  2513 ts_tablet_manager.cc:1403] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:12:59.397990  2513 raft_consensus.cc:359] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.398869  2513 raft_consensus.cc:740] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.400209  2513 consensus_queue.cc:260] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.403692  2513 ts_tablet_manager.cc:1434] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:59.405011  2513 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.429575  2513 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.430807  2513 tablet_bootstrap.cc:492] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.431726  2513 ts_tablet_manager.cc:1403] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.027s	user 0.025s	sys 0.000s
I20260709 13:12:59.435230  2513 raft_consensus.cc:359] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.436159  2513 raft_consensus.cc:740] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.437214  2513 consensus_queue.cc:260] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.440407  2513 ts_tablet_manager.cc:1434] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:59.441510  2513 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.465258  1642 consensus_peers.cc:597] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.466063  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.477033  1568 consensus_peers.cc:597] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.481743  2513 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.483747  2513 tablet_bootstrap.cc:492] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.484485  2513 ts_tablet_manager.cc:1403] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.004s
I20260709 13:12:59.487919  2513 raft_consensus.cc:359] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.488690  2513 raft_consensus.cc:740] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.489449  2513 consensus_queue.cc:260] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:12:59.490945  2513 ts_tablet_manager.cc:1434] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:59.491617  2513 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.507783  2513 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.508816  2513 tablet_bootstrap.cc:492] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.509837  2513 ts_tablet_manager.cc:1403] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:59.516670  2513 raft_consensus.cc:359] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.517614  2513 raft_consensus.cc:740] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.518456  2513 consensus_queue.cc:260] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.520975  2513 ts_tablet_manager.cc:1434] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:12:59.522020  2513 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.578063  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:59.578019  2513 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.585749  2513 tablet_bootstrap.cc:492] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.586609  2513 ts_tablet_manager.cc:1403] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.007s
I20260709 13:12:59.591094  2513 raft_consensus.cc:359] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:12:59.591958  2513 raft_consensus.cc:740] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.593143  2513 consensus_queue.cc:260] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
W20260709 13:12:59.597973  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:59.600299  2513 ts_tablet_manager.cc:1434] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:12:59.601342  2513 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:12:59.611810  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.628837  2591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:38043 every 8 connection(s)
I20260709 13:12:59.632808 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:38043
I20260709 13:12:59.638406  2513 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.639591  2513 tablet_bootstrap.cc:492] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.640416  2513 ts_tablet_manager.cc:1403] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.004s
I20260709 13:12:59.643613  2513 raft_consensus.cc:359] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.644305  2513 raft_consensus.cc:740] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.645013  2513 consensus_queue.cc:260] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.652860  2513 ts_tablet_manager.cc:1434] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:12:59.653815  2513 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.781237  2563 raft_consensus.cc:3060] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.800032  2561 raft_consensus.cc:3060] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.824330  2593 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41051
I20260709 13:12:59.824877  2593 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:59.825976  2593 heartbeater.cc:507] Master 127.25.139.190:41051 requested a full tablet report, sending...
I20260709 13:12:59.826026  2560 raft_consensus.cc:3060] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:59.861476  2562 raft_consensus.cc:3060] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.861734  2513 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:59.862946  2513 tablet_bootstrap.cc:492] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:12:59.863732  2513 ts_tablet_manager.cc:1403] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.210s	user 0.066s	sys 0.087s
W20260709 13:12:59.873806  1716 consensus_peers.cc:597] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:59.874305  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:59.874858  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:59.876659  1568 consensus_peers.cc:597] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:59.897279  2513 raft_consensus.cc:359] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.898085  2513 raft_consensus.cc:740] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.898838  2513 consensus_queue.cc:260] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:12:59.912108  2559 raft_consensus.cc:3060] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.922065  2558 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.971537  2556 raft_consensus.cc:3060] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.920531  2513 ts_tablet_manager.cc:1434] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:12:59.985476  2513 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:12:59.992626  2563 raft_consensus.cc:3060] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.997792  2555 raft_consensus.cc:3060] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.004050  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:00.006615  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:00.022822  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:00.033725  2561 raft_consensus.cc:3060] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:00.124382  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.132:42975, user_credentials={real_user=slave}} blocked reactor thread for 66036.9us
I20260709 13:13:00.147899  2513 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.149413  2513 tablet_bootstrap.cc:492] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.150219  2513 ts_tablet_manager.cc:1403] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.165s	user 0.025s	sys 0.004s
W20260709 13:13:00.153944  2608 log.cc:927] Time spent T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 13:13:00.155879  2513 raft_consensus.cc:359] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.158777  2513 raft_consensus.cc:740] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
W20260709 13:13:00.168736  1716 consensus_peers.cc:597] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:00.175935  2513 consensus_queue.cc:260] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.185281  2513 ts_tablet_manager.cc:1434] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:13:00.188580  2513 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:13:00.188777  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260709 13:13:00.251912  1642 consensus_peers.cc:597] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:00.254021  1427 ts_manager.cc:194] Re-registered known tserver with Master: f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:13:00.282474  1568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:38043, user_credentials={real_user=slave}} blocked reactor thread for 83625.4us
W20260709 13:13:00.337464  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:00.339620  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 26: this message will repeat every 5th retry.
W20260709 13:13:00.351720  1568 consensus_peers.cc:597] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:00.358381  2513 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.362176  2513 tablet_bootstrap.cc:492] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.362914  2513 ts_tablet_manager.cc:1403] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.176s	user 0.017s	sys 0.001s
I20260709 13:13:00.365156  2563 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.367336  2513 raft_consensus.cc:359] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.368077  2513 raft_consensus.cc:740] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.368716  2513 consensus_queue.cc:260] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.370900  2513 ts_tablet_manager.cc:1434] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.000s
I20260709 13:13:00.372042  2513 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.395365  2554 raft_consensus.cc:3060] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.396705  2513 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.397858  2513 tablet_bootstrap.cc:492] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.397913  1427 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58946
I20260709 13:13:00.398980  2513 ts_tablet_manager.cc:1403] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:13:00.402099  2513 raft_consensus.cc:359] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.403288  2513 raft_consensus.cc:740] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.404313  2593 heartbeater.cc:499] Master 127.25.139.190:41051 was elected leader, sending a full tablet report...
I20260709 13:13:00.404244  2513 consensus_queue.cc:260] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.418295  2513 ts_tablet_manager.cc:1434] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:13:00.419524  2513 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.455265  2513 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.456645  2513 tablet_bootstrap.cc:492] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.457432  2513 ts_tablet_manager.cc:1403] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.015s
I20260709 13:13:00.459825  2513 raft_consensus.cc:359] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.460500  2513 raft_consensus.cc:740] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.461129  2513 consensus_queue.cc:260] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.462810  2513 ts_tablet_manager.cc:1434] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.000s
I20260709 13:13:00.463608  2513 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.497419  2513 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.498557  2513 tablet_bootstrap.cc:492] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.499332  2513 ts_tablet_manager.cc:1403] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.008s
I20260709 13:13:00.501780  2513 raft_consensus.cc:359] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.502517  2513 raft_consensus.cc:740] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.503333  2513 consensus_queue.cc:260] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.505640  2513 ts_tablet_manager.cc:1434] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:00.506479  2513 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.524024  2513 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.525154  2513 tablet_bootstrap.cc:492] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.525905  2513 ts_tablet_manager.cc:1403] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:13:00.528503  2513 raft_consensus.cc:359] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.529261  2513 raft_consensus.cc:740] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.530150  2513 consensus_queue.cc:260] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.532694  2513 ts_tablet_manager.cc:1434] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:00.533569  2513 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
W20260709 13:13:00.596729  1568 consensus_peers.cc:597] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260709 13:13:00.613554  2513 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.614600  2513 tablet_bootstrap.cc:492] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.615585  2513 ts_tablet_manager.cc:1403] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.024s
I20260709 13:13:00.617959  2513 raft_consensus.cc:359] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.618499  2513 raft_consensus.cc:740] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.619143  2513 consensus_queue.cc:260] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.620782  2513 ts_tablet_manager.cc:1434] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:13:00.621624  2513 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.647781  2513 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.648844  2513 tablet_bootstrap.cc:492] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.649595  2513 ts_tablet_manager.cc:1403] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.028s	user 0.026s	sys 0.001s
I20260709 13:13:00.653015  2513 raft_consensus.cc:359] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.653764  2513 raft_consensus.cc:740] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.654441  2513 consensus_queue.cc:260] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.657795  2513 ts_tablet_manager.cc:1434] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:13:00.658658  2513 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.682747  2513 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.683838  2513 tablet_bootstrap.cc:492] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.684480  2513 ts_tablet_manager.cc:1403] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:13:00.686798  2513 raft_consensus.cc:359] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.687484  2513 raft_consensus.cc:740] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.688279  2513 consensus_queue.cc:260] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.691233  2513 ts_tablet_manager.cc:1434] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:00.692984  2513 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.711309  2513 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.712242  2513 tablet_bootstrap.cc:492] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.712919  2513 ts_tablet_manager.cc:1403] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:13:00.715114  2513 raft_consensus.cc:359] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.715684  2513 raft_consensus.cc:740] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.716410  2513 consensus_queue.cc:260] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.718250  2513 ts_tablet_manager.cc:1434] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:00.719064  2513 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.745352  2513 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.746343  2513 tablet_bootstrap.cc:492] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.747095  2513 ts_tablet_manager.cc:1403] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
I20260709 13:13:00.749831  2513 raft_consensus.cc:359] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.750607  2513 raft_consensus.cc:740] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.751281  2513 consensus_queue.cc:260] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.753338  2513 ts_tablet_manager.cc:1434] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:00.754464  2513 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.769268  2513 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.770228  2513 tablet_bootstrap.cc:492] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.770895  2513 ts_tablet_manager.cc:1403] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:13:00.773243  2513 raft_consensus.cc:359] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.773954  2513 raft_consensus.cc:740] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.774681  2513 consensus_queue.cc:260] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.778420  2513 ts_tablet_manager.cc:1434] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:00.779284  2513 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.785274  2563 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.799665  2561 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.802189  2513 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.803234  2513 tablet_bootstrap.cc:492] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.803957  2513 ts_tablet_manager.cc:1403] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 13:13:00.808485  2513 raft_consensus.cc:359] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.809254  2513 raft_consensus.cc:740] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.810016  2513 consensus_queue.cc:260] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.812168  2513 ts_tablet_manager.cc:1434] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:00.813017  2513 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.837728  2513 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.838828  2513 tablet_bootstrap.cc:492] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.839602  2513 ts_tablet_manager.cc:1403] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.002s
I20260709 13:13:00.842303  2513 raft_consensus.cc:359] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.843067  2513 raft_consensus.cc:740] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.843793  2513 consensus_queue.cc:260] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.845767  2513 ts_tablet_manager.cc:1434] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:00.846637  2513 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.869645  2563 raft_consensus.cc:3060] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.883091  2513 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.900128  2513 tablet_bootstrap.cc:492] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.900945  2513 ts_tablet_manager.cc:1403] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.009s
I20260709 13:13:00.903702  2513 raft_consensus.cc:359] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.904455  2513 raft_consensus.cc:740] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.905179  2513 consensus_queue.cc:260] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:00.914485  2513 ts_tablet_manager.cc:1434] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:00.915434  2513 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.930871  2560 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.937604  2513 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.942868  2513 tablet_bootstrap.cc:492] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.943670  2513 ts_tablet_manager.cc:1403] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.013s
I20260709 13:13:00.948439  2513 raft_consensus.cc:359] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.949260  2513 raft_consensus.cc:740] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.950485  2513 consensus_queue.cc:260] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:00.952781  2513 ts_tablet_manager.cc:1434] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:13:00.956101  2513 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:00.986307  2513 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:00.987290  2513 tablet_bootstrap.cc:492] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:00.988075  2513 ts_tablet_manager.cc:1403] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.016s
I20260709 13:13:00.997673  2513 raft_consensus.cc:359] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:00.998487  2513 raft_consensus.cc:740] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.999264  2513 consensus_queue.cc:260] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:01.001335  2513 ts_tablet_manager.cc:1434] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:13:01.007658  2563 raft_consensus.cc:3060] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.010042  2513 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.024986  2561 raft_consensus.cc:3060] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.037937  2513 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.039041  2513 tablet_bootstrap.cc:492] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.039791  2513 ts_tablet_manager.cc:1403] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.001s
I20260709 13:13:01.044258  2513 raft_consensus.cc:359] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.045120  2513 raft_consensus.cc:740] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.046121  2513 consensus_queue.cc:260] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.049201  2513 ts_tablet_manager.cc:1434] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:01.050303  2513 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.081609  2513 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.082710  2513 tablet_bootstrap.cc:492] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.083494  2513 ts_tablet_manager.cc:1403] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.033s	user 0.027s	sys 0.000s
I20260709 13:13:01.085951  2513 raft_consensus.cc:359] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:01.086665  2513 raft_consensus.cc:740] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.087497  2513 consensus_queue.cc:260] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:01.089489  2513 ts_tablet_manager.cc:1434] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:13:01.090307  2513 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.113256  2513 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.114084  2513 tablet_bootstrap.cc:492] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.114732  2513 ts_tablet_manager.cc:1403] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:13:01.117146  2513 raft_consensus.cc:359] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:01.117887  2513 raft_consensus.cc:740] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.118563  2513 consensus_queue.cc:260] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:01.120921  2513 ts_tablet_manager.cc:1434] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:01.121768  2513 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.152907  2513 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.154028  2513 tablet_bootstrap.cc:492] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.154789  2513 ts_tablet_manager.cc:1403] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.012s
I20260709 13:13:01.157563  2513 raft_consensus.cc:359] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.158317  2513 raft_consensus.cc:740] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.159030  2513 consensus_queue.cc:260] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.161701  2513 ts_tablet_manager.cc:1434] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:01.162811  2513 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.169529  2563 raft_consensus.cc:3060] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.238299  2513 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.242702  2513 tablet_bootstrap.cc:492] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.243594  2513 ts_tablet_manager.cc:1403] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.081s	user 0.040s	sys 0.012s
I20260709 13:13:01.248793  2513 raft_consensus.cc:359] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.249639  2513 raft_consensus.cc:740] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.250442  2513 consensus_queue.cc:260] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.254050  2513 ts_tablet_manager.cc:1434] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:01.255014  2513 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.307479  2513 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.308358  2513 tablet_bootstrap.cc:492] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.309130  2513 ts_tablet_manager.cc:1403] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.010s
I20260709 13:13:01.312062  2561 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.311843  2513 raft_consensus.cc:359] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.323973  2513 raft_consensus.cc:740] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.324790  2513 consensus_queue.cc:260] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:01.330986  2513 ts_tablet_manager.cc:1434] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:13:01.331889  2513 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.361832  2513 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.362653  2513 tablet_bootstrap.cc:492] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.363476  2513 ts_tablet_manager.cc:1403] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.003s
I20260709 13:13:01.365379  2513 raft_consensus.cc:359] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:01.365890  2513 raft_consensus.cc:740] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.366518  2513 consensus_queue.cc:260] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:01.368585  2513 ts_tablet_manager.cc:1434] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:13:01.370169  2513 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap starting.
I20260709 13:13:01.386540  2513 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:01.387619  2513 tablet_bootstrap.cc:492] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Bootstrap complete.
I20260709 13:13:01.388278  2513 ts_tablet_manager.cc:1403] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:13:01.390202  2513 raft_consensus.cc:359] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:01.390738  2513 raft_consensus.cc:740] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.391393  2513 consensus_queue.cc:260] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:01.393493  2513 ts_tablet_manager.cc:1434] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:01.544337  2563 raft_consensus.cc:3060] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.597352  2561 raft_consensus.cc:3060] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.616133  2563 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.668270 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:09.719769  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25c304781e4047a3aa43c42385c174da"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47388
I20260709 13:13:09.720788  1679 raft_consensus.cc:606] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.724340  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47388
I20260709 13:13:09.724928  1679 raft_consensus.cc:606] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.759882  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:09.760490  1601 raft_consensus.cc:606] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.774520  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:09.775115  1752 raft_consensus.cc:606] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.777455  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e94725900d8046968b81fad5677b14a6"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:09.777904  1601 raft_consensus.cc:606] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.780229  1601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:09.781140  1601 raft_consensus.cc:606] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:09.782305 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:09.783612 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:09.853760  2673 raft_consensus.cc:993] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.854449  2684 raft_consensus.cc:1081] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.856284  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50204
I20260709 13:13:09.856938  2561 raft_consensus.cc:493] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:09.857407  2561 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.866472  2561 raft_consensus.cc:515] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:09.867555  2683 raft_consensus.cc:993] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.868335  2681 raft_consensus.cc:1081] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.869308  2561 leader_election.cc:290] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:13:09.874365  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50228
I20260709 13:13:09.874964  2561 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:09.875376  2561 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.882136  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:09.883049  1601 raft_consensus.cc:3055] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.883378  1601 raft_consensus.cc:740] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:09.883867  2561 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:09.884342  1601 consensus_queue.cc:260] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:09.885982  1601 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.886549  2561 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:09.888057  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ce7af2981b948d384465e8ee576e78e" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:09.888782  1679 raft_consensus.cc:3060] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.891754  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:09.892396  1673 raft_consensus.cc:3055] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:09.892715  1673 raft_consensus.cc:740] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:09.893510  1673 consensus_queue.cc:260] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:09.895334  1673 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.901216  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b14405810174b1da9026bec4dfa5110" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:09.901894  1752 raft_consensus.cc:3060] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:09.903782  1673 raft_consensus.cc:2468] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:09.905223  2507 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:09.907429  2692 raft_consensus.cc:2804] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:09.909847  2684 raft_consensus.cc:993] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.910068  1752 raft_consensus.cc:2468] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:09.910610  2684 raft_consensus.cc:1081] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:09.910518  2692 raft_consensus.cc:697] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:09.912784  1679 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:09.913623  1601 raft_consensus.cc:2468] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:09.915793  2692 consensus_queue.cc:237] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:09.916172  2507 leader_election.cc:304] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:09.917917  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e94725900d8046968b81fad5677b14a6"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50204
I20260709 13:13:09.918128  2693 raft_consensus.cc:2804] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.918576  2561 raft_consensus.cc:493] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:09.919013  2561 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.929894  2561 raft_consensus.cc:515] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:09.933607  2561 leader_election.cc:290] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:09.935470  2693 raft_consensus.cc:697] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:09.936932  2693 consensus_queue.cc:237] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:09.938913  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:09.939581  1603 raft_consensus.cc:3055] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:09.939867  1603 raft_consensus.cc:740] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:09.940815  1603 consensus_queue.cc:260] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:09.941726  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e94725900d8046968b81fad5677b14a6" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:09.942322  1752 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.942646  1603 raft_consensus.cc:3060] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:09.950313  1603 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:09.947990  1428 catalog_manager.cc:5697] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:09.953465  2508 leader_election.cc:304] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:09.960539  1752 raft_consensus.cc:2468] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:09.962656  2694 raft_consensus.cc:2804] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:09.975658  2694 raft_consensus.cc:697] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:09.977003  2694 consensus_queue.cc:237] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:09.998471  1428 catalog_manager.cc:5697] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.000190  1428 catalog_manager.cc:5697] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.150007  2683 raft_consensus.cc:993] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.150487  2681 raft_consensus.cc:1081] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.151887  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25c304781e4047a3aa43c42385c174da"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50228
I20260709 13:13:10.152366  2561 raft_consensus.cc:493] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.152618  2561 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.158092  2561 raft_consensus.cc:515] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:10.159790  2561 leader_election.cc:290] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:13:10.160452  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:10.160878  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25c304781e4047a3aa43c42385c174da" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:10.161126  1603 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.161482  1679 raft_consensus.cc:3055] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.161800  1679 raft_consensus.cc:740] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:10.162612  1679 consensus_queue.cc:260] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:10.163862  1679 raft_consensus.cc:3060] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.169495  1603 raft_consensus.cc:2468] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.170197  1679 raft_consensus.cc:2468] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.170562  2508 leader_election.cc:304] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:10.171449  2694 raft_consensus.cc:2804] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.171859  2694 raft_consensus.cc:697] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:10.172629  2694 consensus_queue.cc:237] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:10.181644  1428 catalog_manager.cc:5697] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.218107  2684 raft_consensus.cc:993] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.218670  2677 raft_consensus.cc:1081] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.220064  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50204
I20260709 13:13:10.220561  2561 raft_consensus.cc:493] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.220820  2561 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.227389  2561 raft_consensus.cc:515] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:10.229218  2561 leader_election.cc:290] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:10.230187  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:10.230793  1749 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.237213  1749 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.238261  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea539e73baec42e2bf45e9ca296219aa" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:10.238446  2506 leader_election.cc:304] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:10.238814  1603 raft_consensus.cc:3055] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.239223  1603 raft_consensus.cc:740] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:10.239398  2694 raft_consensus.cc:2804] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.239918  2694 raft_consensus.cc:697] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:10.240150  1603 consensus_queue.cc:260] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:10.240844  2694 consensus_queue.cc:237] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:10.241478  1603 raft_consensus.cc:3060] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.247149  1603 raft_consensus.cc:2468] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.251304  1424 catalog_manager.cc:5697] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:10.314284  1673 raft_consensus.cc:1275] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.315666  2694 consensus_queue.cc:1048] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.322801  2688 raft_consensus.cc:993] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.324184  2668 raft_consensus.cc:1081] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:10.329607  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:10.330256  2561 raft_consensus.cc:493] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.330627  2561 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.350512  2561 raft_consensus.cc:515] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:10.353011  1749 raft_consensus.cc:1275] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.353066  1673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:10.353812  1673 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.354559  2561 leader_election.cc:290] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:10.357668  2693 consensus_queue.cc:1048] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.359760  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc6e4900b0f8471a9e011ad8e7b4883c" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:10.360394  1749 raft_consensus.cc:3055] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.360673  1749 raft_consensus.cc:740] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:10.361433  1749 consensus_queue.cc:260] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:10.361887  1673 raft_consensus.cc:2468] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.362552  1749 raft_consensus.cc:3060] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.363152  2507 leader_election.cc:304] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:10.364063  2694 raft_consensus.cc:2804] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.364533  2694 raft_consensus.cc:697] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:10.365439  2694 consensus_queue.cc:237] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:10.375507  1673 raft_consensus.cc:1275] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:10.377280  1749 raft_consensus.cc:2468] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:10.379839  2693 consensus_queue.cc:1048] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:10.403482  1601 raft_consensus.cc:1275] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:10.405057  2693 consensus_queue.cc:1048] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:10.426182  1427 catalog_manager.cc:5697] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:10.469724  1752 raft_consensus.cc:1275] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:10.470993  2692 consensus_queue.cc:1048] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:10.480382  1603 raft_consensus.cc:1275] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:10.482052  2693 consensus_queue.cc:1048] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:10.607322  1603 raft_consensus.cc:1275] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.608518  2693 consensus_queue.cc:1048] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.617996  1679 raft_consensus.cc:1275] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.619709  2694 consensus_queue.cc:1048] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.671037  1752 raft_consensus.cc:1275] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.672219  2694 consensus_queue.cc:1048] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.688943  1603 raft_consensus.cc:1275] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.690582  2715 consensus_queue.cc:1048] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:10.784612 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.833272 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:10.871300  1752 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:10.871809  1752 raft_consensus.cc:606] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:10.874245  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:10.874691  1749 raft_consensus.cc:606] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Received request to transfer leadership to TS 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:13:10.876820  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75086307353648738b0658d935e444c6"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:10.877243  1749 raft_consensus.cc:606] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Received request to transfer leadership to TS 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:13:10.879554  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:10.880026  1749 raft_consensus.cc:606] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Received request to transfer leadership to TS 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:13:10.884841  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:10.885283  1749 raft_consensus.cc:606] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Received request to transfer leadership to TS 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:13:10.885637  2668 raft_consensus.cc:993] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: : Instructing follower 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:10.886175  2705 raft_consensus.cc:1081] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Signalling peer 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:10.886361 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:10.887781  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:49922
I20260709 13:13:10.888118 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:10.888427  1603 raft_consensus.cc:493] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:10.888854  1603 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.893517  1749 raft_consensus.cc:1275] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.894090  1603 raft_consensus.cc:515] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:10.894724  2715 consensus_queue.cc:1048] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.896907  1603 leader_election.cc:290] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:10.897199  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:10.897600  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f7ea292ba4c446baa780c385e973388" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:10.897869  1679 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.898173  1752 raft_consensus.cc:3055] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:10.898507  1752 raft_consensus.cc:740] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:10.899258  1752 consensus_queue.cc:260] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:10.900516  1752 raft_consensus.cc:3060] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:10.905798  1679 raft_consensus.cc:2468] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:10.907310  1569 leader_election.cc:304] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:13:10.907327  1752 raft_consensus.cc:2468] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:10.908439  2684 raft_consensus.cc:2804] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:10.921136  2684 raft_consensus.cc:697] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:10.922082  2684 consensus_queue.cc:237] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:10.925420  1673 raft_consensus.cc:1275] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:10.927333  2694 consensus_queue.cc:1048] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:10.958340  1428 catalog_manager.cc:5697] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.221414  2728 raft_consensus.cc:993] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:11.221926  2668 raft_consensus.cc:1081] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:11.224081  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:11.224668  2561 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.224970  2561 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.230295  2561 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:11.232434  2561 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:11.232733  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:11.232888  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b45057315e4ff09bd85cb63fd64c39" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:11.233359  1749 raft_consensus.cc:3055] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:11.233498  1601 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.233739  1749 raft_consensus.cc:740] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:11.234630  1749 consensus_queue.cc:260] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:11.235766  1749 raft_consensus.cc:3060] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:11.239881  1601 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:11.241146  2508 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:11.241986  2694 raft_consensus.cc:2804] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:11.242403  1749 raft_consensus.cc:2468] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:11.242555  2694 raft_consensus.cc:697] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:11.243642  2694 consensus_queue.cc:237] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:11.254087  1428 catalog_manager.cc:5697] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.270752  2728 raft_consensus.cc:993] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: : Instructing follower 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:11.271317  2668 raft_consensus.cc:1081] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Signalling peer 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:11.272629  1603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75086307353648738b0658d935e444c6"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:49922
I20260709 13:13:11.273062  1603 raft_consensus.cc:493] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.273345  1603 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.279392  1603 raft_consensus.cc:515] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.281420  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:11.281942  1679 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.282801  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75086307353648738b0658d935e444c6" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:11.283612  1749 raft_consensus.cc:3055] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.283910  1749 raft_consensus.cc:740] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:11.285073  1749 consensus_queue.cc:260] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.285984  1749 raft_consensus.cc:3060] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.289953  1603 leader_election.cc:290] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:11.295461  1679 raft_consensus.cc:2468] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:11.296382  1749 raft_consensus.cc:2468] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:11.297091  1569 leader_election.cc:304] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:13:11.298045  2721 raft_consensus.cc:2804] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.298537  2721 raft_consensus.cc:697] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:11.299357  2721 consensus_queue.cc:237] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.309659  1428 catalog_manager.cc:5697] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.321935  2668 raft_consensus.cc:993] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: : Instructing follower 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:11.322355  2728 raft_consensus.cc:1081] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Signalling peer 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:11.323694  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:56454
I20260709 13:13:11.324093  1679 raft_consensus.cc:493] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.324311  1679 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.328722  1679 raft_consensus.cc:515] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.330772  1679 leader_election.cc:290] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:11.331704  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:11.332510  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7246ca069aee46739528e2ba5e72e40c" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:11.333252  1603 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.334005  1749 raft_consensus.cc:3055] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.334370  1749 raft_consensus.cc:740] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:11.335129  1749 consensus_queue.cc:260] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.336439  1749 raft_consensus.cc:3060] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.339967  1603 raft_consensus.cc:2468] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:11.341879  1644 leader_election.cc:304] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:13:11.342756  2683 raft_consensus.cc:2804] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.343281  2683 raft_consensus.cc:697] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:11.343334  1749 raft_consensus.cc:2468] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:11.344273  2683 consensus_queue.cc:237] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.392184  2705 raft_consensus.cc:993] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: : Instructing follower 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:11.391825  1428 catalog_manager.cc:5697] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.392747  2705 raft_consensus.cc:1081] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Signalling peer 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:11.394332  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:56454
I20260709 13:13:11.394783  1679 raft_consensus.cc:493] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.395108  1679 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.402565  1679 raft_consensus.cc:515] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.404413  1679 leader_election.cc:290] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:11.405019  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:11.405907  1603 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.406002  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d03b372e29b64b72a97eedf387abc386" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:11.406594  1752 raft_consensus.cc:3055] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.406908  1752 raft_consensus.cc:740] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:11.407651  1752 consensus_queue.cc:260] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.408896  1752 raft_consensus.cc:3060] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.413211  1603 raft_consensus.cc:2468] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:11.415454  1644 leader_election.cc:304] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 7482af1eecbe4abc9f0a21e2d2dbb61b; no voters: 
I20260709 13:13:11.415524  1752 raft_consensus.cc:2468] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:11.416204  2683 raft_consensus.cc:2804] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.416791  2683 raft_consensus.cc:697] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:11.417707  2683 consensus_queue.cc:237] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:11.428686  1428 catalog_manager.cc:5697] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.473253  1752 raft_consensus.cc:1275] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.474546  2721 consensus_queue.cc:1048] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.484503  1679 raft_consensus.cc:1275] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.485908  2673 consensus_queue.cc:1048] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.704144  1752 raft_consensus.cc:1275] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.705745  2673 consensus_queue.cc:1048] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.716570  1679 raft_consensus.cc:1275] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.719506  2673 consensus_queue.cc:1048] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.727525  1604 raft_consensus.cc:1275] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:11.733819  2694 consensus_queue.cc:1048] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:11.753156  1749 raft_consensus.cc:1275] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:11.756362  2694 consensus_queue.cc:1048] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:11.766530  1603 raft_consensus.cc:1275] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.767669  2731 consensus_queue.cc:1048] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.786402  1749 raft_consensus.cc:1275] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.788113  2683 consensus_queue.cc:1048] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.889161 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.928002 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:11.958568  1603 raft_consensus.cc:1275] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.960121  2683 consensus_queue.cc:1048] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.963737  1749 raft_consensus.cc:1275] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:11.967092  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47388
I20260709 13:13:11.967790  1679 raft_consensus.cc:606] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:11.968573  2683 consensus_queue.cc:1048] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:11.970963  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:11.971762  1749 raft_consensus.cc:606] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:11.980968  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:11.981513  1604 raft_consensus.cc:606] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Received request to transfer leadership to TS 56c68eed42dc40c4ac69ff82c925b3f0
I20260709 13:13:11.984115  1604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:11.984563  1604 raft_consensus.cc:606] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:11.986971  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
mode: GRACEFUL
new_leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:47388
I20260709 13:13:11.987558  1679 raft_consensus.cc:606] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Received request to transfer leadership to TS 7482af1eecbe4abc9f0a21e2d2dbb61b
I20260709 13:13:11.988591 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:11.990154 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:12.004689  2732 raft_consensus.cc:993] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.005273  2705 raft_consensus.cc:1081] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.006639  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:12.007097  2561 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.007387  2561 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.013032  2561 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.014532  2561 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:12.015704  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:12.016382  1752 raft_consensus.cc:3055] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:12.016709  1752 raft_consensus.cc:740] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:12.017390  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fb98195cf34f6baea8c9209c1621e7" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:12.018117  1604 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.017632  1752 consensus_queue.cc:260] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.019153  1752 raft_consensus.cc:3060] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:12.025249  1752 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:12.026610  2506 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:12.027465  2694 raft_consensus.cc:2804] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:12.028038  2694 raft_consensus.cc:697] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:12.031417  1604 raft_consensus.cc:2468] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:12.031661  2694 consensus_queue.cc:237] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.042076  1428 catalog_manager.cc:5697] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.093143  2683 raft_consensus.cc:993] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.093667  2749 raft_consensus.cc:1081] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.095103  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50228
I20260709 13:13:12.095656  2561 raft_consensus.cc:493] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.096000  2561 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.101152  2561 raft_consensus.cc:515] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:12.103129  2561 leader_election.cc:290] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:12.103394  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:12.103647  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43d4bdf431b24970b2da0f2c5bf1fdec" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:12.104015  1679 raft_consensus.cc:3055] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.104182  1752 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.104351  1679 raft_consensus.cc:740] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:12.105094  1679 consensus_queue.cc:260] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:12.106297  1679 raft_consensus.cc:3060] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.111337  1752 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:12.113900  1679 raft_consensus.cc:2468] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:12.115316  2507 leader_election.cc:304] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:12.116129  2694 raft_consensus.cc:2804] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.116593  2694 raft_consensus.cc:697] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:12.117548  2694 consensus_queue.cc:237] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:12.138427  1428 catalog_manager.cc:5697] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:12.172137  2673 raft_consensus.cc:993] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.172708  2741 raft_consensus.cc:1081] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:12.174099  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50204
I20260709 13:13:12.174605  2561 raft_consensus.cc:493] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.174939  2561 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.181488  2561 raft_consensus.cc:515] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.183100  2561 leader_election.cc:290] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:12.183596  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:12.184073  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7f777d8fcda4822b72ea2ff86629dad" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:12.184228  1749 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.184520  1604 raft_consensus.cc:3055] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.184759  1604 raft_consensus.cc:740] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:12.185353  1604 consensus_queue.cc:260] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.186168  1604 raft_consensus.cc:3060] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.189172  1749 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:12.190277  2506 leader_election.cc:304] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81b721300bd34373862d7937c3bf394a, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:12.191092  2694 raft_consensus.cc:2804] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.191303  1604 raft_consensus.cc:2468] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:12.191637  2694 raft_consensus.cc:697] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:12.192054  2673 raft_consensus.cc:993] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:12.192634  2741 raft_consensus.cc:1081] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Signalling peer 56c68eed42dc40c4ac69ff82c925b3f0 to start an election
I20260709 13:13:12.192886  2694 consensus_queue.cc:237] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:12.194133  1679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
 from {username='slave'} at 127.0.0.1:56468
I20260709 13:13:12.194589  1679 raft_consensus.cc:493] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.194903  1679 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.201689  1679 raft_consensus.cc:515] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.203898  1679 leader_election.cc:290] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:12.203712  1428 catalog_manager.cc:5697] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.204424  1604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:12.204424  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6016a96ce80848be9feac61f7c5bdcee" candidate_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:12.205143  1604 raft_consensus.cc:3055] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.205298  1749 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.205505  1604 raft_consensus.cc:740] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:12.206264  1604 consensus_queue.cc:260] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.207590  1604 raft_consensus.cc:3060] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.212129  1749 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:12.213234  1642 leader_election.cc:304] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:13:12.214078  2683 raft_consensus.cc:2804] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.214330  1604 raft_consensus.cc:2468] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 56c68eed42dc40c4ac69ff82c925b3f0 in term 2.
I20260709 13:13:12.214537  2683 raft_consensus.cc:697] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Leader. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:12.215629  2683 consensus_queue.cc:237] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.224495  1428 catalog_manager.cc:5697] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 reported cstate change: term changed from 1 to 2, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.243584  2681 raft_consensus.cc:993] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: : Instructing follower 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:12.244146  2683 raft_consensus.cc:1081] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Signalling peer 7482af1eecbe4abc9f0a21e2d2dbb61b to start an election
I20260709 13:13:12.248426  1604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
 from {username='slave'} at 127.0.0.1:49914
I20260709 13:13:12.248976  1604 raft_consensus.cc:493] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.249279  1604 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.255847  1604 raft_consensus.cc:515] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.257894  1604 leader_election.cc:290] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:12.258281  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:12.258796  1752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98bf1eac1604413a4fb7dc095aa0e4d" candidate_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:12.259151  1679 raft_consensus.cc:3055] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.259460  1752 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.259614  1679 raft_consensus.cc:740] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:12.260489  1679 consensus_queue.cc:260] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.261492  1679 raft_consensus.cc:3060] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.264694  1752 raft_consensus.cc:2468] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:12.265746  1568 leader_election.cc:304] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, 81b721300bd34373862d7937c3bf394a; no voters: 
I20260709 13:13:12.266086  1679 raft_consensus.cc:2468] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7482af1eecbe4abc9f0a21e2d2dbb61b in term 2.
I20260709 13:13:12.266453  2741 raft_consensus.cc:2804] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.266960  2741 raft_consensus.cc:697] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Becoming Leader. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:12.267832  2741 consensus_queue.cc:237] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } }
I20260709 13:13:12.277573  1428 catalog_manager.cc:5697] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b reported cstate change: term changed from 1 to 2, leader changed from 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131) to 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130). New cstate: current_term: 2 leader_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.537943  1604 raft_consensus.cc:1275] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.539314  2694 consensus_queue.cc:1048] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.550271  1752 raft_consensus.cc:1275] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:12.553922  2692 consensus_queue.cc:1048] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:12.596499  1679 raft_consensus.cc:1275] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.597592  2692 consensus_queue.cc:1048] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.607769  1752 raft_consensus.cc:1275] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.609688  1604 raft_consensus.cc:1275] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.611297  2681 consensus_queue.cc:1048] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.611419  2693 consensus_queue.cc:1048] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.615641  1752 raft_consensus.cc:1275] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 56c68eed42dc40c4ac69ff82c925b3f0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.619216  2749 consensus_queue.cc:1048] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:12.702687  1569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:45361, user_credentials={real_user=slave}} blocked reactor thread for 52231.4us
I20260709 13:13:12.779835  1749 raft_consensus.cc:1275] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.788240  2771 consensus_queue.cc:1048] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:13:12.820878  1603 raft_consensus.cc:1275] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.822654  2694 consensus_queue.cc:1048] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.843695  1679 raft_consensus.cc:1275] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.845053  2777 consensus_queue.cc:1048] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.859824  1749 raft_consensus.cc:1275] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Refusing update from remote peer 7482af1eecbe4abc9f0a21e2d2dbb61b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.866977  2776 consensus_queue.cc:1048] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:12.990940 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.031018 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:13.062306  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:13.062793  1749 raft_consensus.cc:606] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:13.065269  1749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da5ca4158645483daecbd41331823b28"
dest_uuid: "81b721300bd34373862d7937c3bf394a"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47072
I20260709 13:13:13.065729  1749 raft_consensus.cc:606] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:13.068123  1679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9"
dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:47388
I20260709 13:13:13.068606  1679 raft_consensus.cc:606] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:13.071224  1603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2"
dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
mode: GRACEFUL
new_leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:38150
I20260709 13:13:13.071699  1603 raft_consensus.cc:606] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Received request to transfer leadership to TS f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:13.072826 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:13.074080 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:13.188444  2772 raft_consensus.cc:993] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.189030  2769 raft_consensus.cc:1081] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.190539  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50228
I20260709 13:13:13.191128  2561 raft_consensus.cc:493] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.191458  2561 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.196358  2561 raft_consensus.cc:515] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.199259  2561 leader_election.cc:290] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:13:13.199214  1603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:13.200503  1603 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.201506  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec881282fcaa453cb97c580feb5000c9" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:13.202087  1679 raft_consensus.cc:3055] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.202394  1679 raft_consensus.cc:740] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 56c68eed42dc40c4ac69ff82c925b3f0, State: Running, Role: LEADER
I20260709 13:13:13.203377  1679 consensus_queue.cc:260] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.204154  1679 raft_consensus.cc:3060] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.207823  1603 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.209127  2508 leader_election.cc:304] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:13.210148  2774 raft_consensus.cc:2804] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.210632  2774 raft_consensus.cc:697] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:13.211475  2774 consensus_queue.cc:237] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.214965  2780 raft_consensus.cc:993] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.215526  2780 raft_consensus.cc:1081] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.217228  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da5ca4158645483daecbd41331823b28"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:13.217720  1679 raft_consensus.cc:2468] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.218283  2561 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.218757  2561 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.233959  1427 catalog_manager.cc:5697] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.237655  2561 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:13.244848  2561 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:13.244989  1749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:13.245738  1749 raft_consensus.cc:3055] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.246129  1749 raft_consensus.cc:740] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:13.246497  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5ca4158645483daecbd41331823b28" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:13.247090  1601 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.252151  1601 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.247097  1749 consensus_queue.cc:260] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:13.253257  2508 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:13.254070  1749 raft_consensus.cc:3060] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.258075  2774 raft_consensus.cc:2804] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.260783  2774 raft_consensus.cc:697] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:13.264757  1749 raft_consensus.cc:2468] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.261806  2774 consensus_queue.cc:237] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:13.268478  2777 raft_consensus.cc:993] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.268945  2777 raft_consensus.cc:1081] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.270948  2561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50204
I20260709 13:13:13.271514  2561 raft_consensus.cc:493] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.271835  2561 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.281046  2561 raft_consensus.cc:515] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.282719  2561 leader_election.cc:290] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Requested vote from peers 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065), 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361)
I20260709 13:13:13.283474  1601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b"
I20260709 13:13:13.284027  1601 raft_consensus.cc:3055] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:13.284312  1601 raft_consensus.cc:740] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7482af1eecbe4abc9f0a21e2d2dbb61b, State: Running, Role: LEADER
I20260709 13:13:13.284667  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c73b2826d849cb95d78247681a3fc2" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:13.285265  1679 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.285168  1601 consensus_queue.cc:260] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.286358  1601 raft_consensus.cc:3060] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:13.291965  1679 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:13.290660  1427 catalog_manager.cc:5697] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.293658  2507 leader_election.cc:304] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:13.293905  1601 raft_consensus.cc:2468] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 2.
I20260709 13:13:13.294512  2774 raft_consensus.cc:2804] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:13.295136  2774 raft_consensus.cc:697] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:13.298709  2774 consensus_queue.cc:237] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } }
I20260709 13:13:13.310613  1427 catalog_manager.cc:5697] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 1 to 2, leader changed from 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:13.487957  2779 raft_consensus.cc:993] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: : Instructing follower f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.488395  2770 raft_consensus.cc:1081] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Signalling peer f0f836402fd5410b9deb0c569dbc1a7e to start an election
I20260709 13:13:13.489784  2556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740"
dest_uuid: "f0f836402fd5410b9deb0c569dbc1a7e"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:13.490263  2556 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:13.490644  2556 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.496574  2556 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:13.498641  2556 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Requested vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), 81b721300bd34373862d7937c3bf394a (127.25.139.132:42975)
I20260709 13:13:13.499615  1679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "56c68eed42dc40c4ac69ff82c925b3f0"
I20260709 13:13:13.499806  1751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92c0d0759d14171ae0df1638e73c740" candidate_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "81b721300bd34373862d7937c3bf394a"
I20260709 13:13:13.500275  1679 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.500478  1751 raft_consensus.cc:3055] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:13.500875  1751 raft_consensus.cc:740] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 81b721300bd34373862d7937c3bf394a, State: Running, Role: LEADER
I20260709 13:13:13.501580  1751 consensus_queue.cc:260] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:13.502480  1751 raft_consensus.cc:3060] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:13.505574  1679 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.506738  2507 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e; no voters: 
I20260709 13:13:13.507575  2771 raft_consensus.cc:2804] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:13.508091  2771 raft_consensus.cc:697] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Becoming Leader. State: Replica: f0f836402fd5410b9deb0c569dbc1a7e, State: Running, Role: LEADER
I20260709 13:13:13.509034  1751 raft_consensus.cc:2468] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f836402fd5410b9deb0c569dbc1a7e in term 3.
I20260709 13:13:13.508838  2771 consensus_queue.cc:237] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:13.518311  1427 catalog_manager.cc:5697] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e reported cstate change: term changed from 2 to 3, leader changed from 81b721300bd34373862d7937c3bf394a (127.25.139.132) to f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129). New cstate: current_term: 3 leader_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:13.594794  1679 raft_consensus.cc:1275] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.596151  2694 consensus_queue.cc:1048] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.599874  1601 raft_consensus.cc:1275] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.602051  2694 consensus_queue.cc:1048] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.785904  1749 raft_consensus.cc:1275] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.787118  2694 consensus_queue.cc:1048] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.797024  1603 raft_consensus.cc:1275] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.798529  2774 consensus_queue.cc:1048] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.824362  1601 raft_consensus.cc:1275] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.829677  2771 consensus_queue.cc:1048] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:13.851820  1679 raft_consensus.cc:1275] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:13.855626  2771 consensus_queue.cc:1048] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:13.922624  1749 raft_consensus.cc:1275] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.923843  2771 consensus_queue.cc:1048] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:13.933265  1679 raft_consensus.cc:1275] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Refusing update from remote peer f0f836402fd5410b9deb0c569dbc1a7e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:13.934995  2771 consensus_queue.cc:1048] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:14.074970 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:14.113253 26158 tablet_server.cc:179] TabletServer@127.25.139.129:38043 shutting down...
I20260709 13:13:14.142938 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:14.143997 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.145125 26158 raft_consensus.cc:2243] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.146064 26158 raft_consensus.cc:2272] T ec881282fcaa453cb97c580feb5000c9 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.149084 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.150024 26158 raft_consensus.cc:2243] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.150497 26158 raft_consensus.cc:2272] T adb3694e79904863a5bcb3e9f2985ad0 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.152019  1716 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 285 similar messages]
I20260709 13:13:14.153391 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.154249 26158 raft_consensus.cc:2243] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:14.154772  1716 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.155220 26158 raft_consensus.cc:2272] T f6c73b2826d849cb95d78247681a3fc2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.157567 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.158125 26158 raft_consensus.cc:2243] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.158509 26158 raft_consensus.cc:2272] T d4ae70b3df284d3faf8022535886954e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.161075 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.161757 26158 raft_consensus.cc:2243] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.162182 26158 raft_consensus.cc:2272] T 08fc8c696d1441de9afedcc0a96f0908 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.163528  1716 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.164953 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.165611 26158 raft_consensus.cc:2243] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.166352 26158 raft_consensus.cc:2272] T a7f777d8fcda4822b72ea2ff86629dad P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.168596 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.169193 26158 raft_consensus.cc:2243] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.169608 26158 raft_consensus.cc:2272] T b158c68a91e44e46bc65d09542c6ef0d P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.171573 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.172129 26158 raft_consensus.cc:2243] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.173110 26158 raft_consensus.cc:2272] T da5ca4158645483daecbd41331823b28 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.175595 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.176487 26158 raft_consensus.cc:2243] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.177156 26158 raft_consensus.cc:2272] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.180419 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.181264 26158 raft_consensus.cc:2243] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.182161 26158 raft_consensus.cc:2272] T 53fb98195cf34f6baea8c9209c1621e7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.184871 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.185709 26158 raft_consensus.cc:2243] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.186267 26158 raft_consensus.cc:2272] T 827bdde8c8124516a8bf5558f04c5749 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.187752  1568 consensus_peers.cc:597] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.188927 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.189729 26158 raft_consensus.cc:2243] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.190563 26158 raft_consensus.cc:2272] T 3b14405810174b1da9026bec4dfa5110 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.192708 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.193275 26158 raft_consensus.cc:2243] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.193763 26158 raft_consensus.cc:2272] T 64bfde6140f041d3835174d6009e02d2 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.196237 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.196996 26158 raft_consensus.cc:2243] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.197932 26158 raft_consensus.cc:2272] T 6ce7af2981b948d384465e8ee576e78e P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.200505 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.201268 26158 raft_consensus.cc:2243] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.201998 26158 raft_consensus.cc:2272] T e94725900d8046968b81fad5677b14a6 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.204093  1642 consensus_peers.cc:597] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.204697 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.205562 26158 raft_consensus.cc:2243] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.206058 26158 raft_consensus.cc:2272] T c7892b317e15474e89775b9d69f7fe66 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.208724 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.209333 26158 raft_consensus.cc:2243] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.209797 26158 raft_consensus.cc:2272] T 793b9da3cfbe48f7912724719cac2e28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.212006 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.212538 26158 raft_consensus.cc:2243] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.212941 26158 raft_consensus.cc:2272] T 6195852602da44ef9cbb867e62b07bac P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.214978 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.215487 26158 raft_consensus.cc:2243] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.215858 26158 raft_consensus.cc:2272] T f3239aa727f34be3b22879bece578a0c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.218009 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.218621 26158 raft_consensus.cc:2243] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.219249 26158 raft_consensus.cc:2272] T c77a28753d4848a3880e7b8e19c7c253 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.222084 26158 tablet_replica.cc:333] stopping tablet replica
W20260709 13:13:14.222607  1568 consensus_peers.cc:597] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.222823 26158 raft_consensus.cc:2243] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.223417 26158 raft_consensus.cc:2272] T 71e6f598fa6943a3b2a180ba51e31e1c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.225857 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.226636 26158 raft_consensus.cc:2243] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.227424 26158 raft_consensus.cc:2272] T 43d4bdf431b24970b2da0f2c5bf1fdec P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.229545 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.230216 26158 raft_consensus.cc:2243] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.230779 26158 raft_consensus.cc:2272] T 56487f97c81348d18d1336ca6b5a08e2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.233363 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.233901 26158 raft_consensus.cc:2243] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.234227 26158 raft_consensus.cc:2272] T c105f80f46794d4c918b5380fdd165b3 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.236136 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.236734 26158 raft_consensus.cc:2243] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.237412 26158 raft_consensus.cc:2272] T bc6e4900b0f8471a9e011ad8e7b4883c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.239341 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.239904 26158 raft_consensus.cc:2243] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.240322 26158 raft_consensus.cc:2272] T d7dfeb0bf60e419a808cb054b8a99ebe P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.242794 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.243585 26158 raft_consensus.cc:2243] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.244061 26158 raft_consensus.cc:2272] T bfa8234639df4f6cb6d73f59b3a8fffc P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.246028 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.246572 26158 raft_consensus.cc:2243] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.247007 26158 raft_consensus.cc:2272] T 5160521b61c64b3197aeb0a169fecff3 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.249539 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.250264 26158 raft_consensus.cc:2243] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.251084 26158 raft_consensus.cc:2272] T 25c304781e4047a3aa43c42385c174da P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.253391 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.254179 26158 raft_consensus.cc:2243] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.254705 26158 raft_consensus.cc:2272] T 66c508d13a2e4137b001068a1d1a3a28 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.257467 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.258219 26158 raft_consensus.cc:2243] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.258669 26158 raft_consensus.cc:2272] T 9ec3c6f8fd494b03a01e4794bf69e59f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.261353 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.261857 26158 raft_consensus.cc:2243] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.262218 26158 raft_consensus.cc:2272] T a43dc0ea5206435ebf2346061be97395 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.264213 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.264820 26158 raft_consensus.cc:2243] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.265244 26158 raft_consensus.cc:2272] T c76ddc05f4da4c84b448ea837803e27c P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.267409 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.267983 26158 raft_consensus.cc:2243] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.268757 26158 raft_consensus.cc:2272] T 70b45057315e4ff09bd85cb63fd64c39 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.270838 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.271576 26158 raft_consensus.cc:2243] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.272130 26158 raft_consensus.cc:2272] T 25c161302a6f43a2a5815562dd376bb7 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.275429 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.276141 26158 raft_consensus.cc:2243] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.276687 26158 raft_consensus.cc:2272] T 50ee3a20a0274ce9b86ef729e86f8669 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.279671 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.280414 26158 raft_consensus.cc:2243] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.280874 26158 raft_consensus.cc:2272] T 0379b5784a684643b7f6abcd1a99e91f P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.281481  1716 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.282908  1568 consensus_peers.cc:597] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.283552 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.284238 26158 raft_consensus.cc:2243] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.284766 26158 raft_consensus.cc:2272] T 35b348df9bbb4e10aedb07823b2f015d P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.287309 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.287878 26158 raft_consensus.cc:2243] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.288295 26158 raft_consensus.cc:2272] T cb08ccac0eca4cd2af937e0c1cb87ce2 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.290833 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.291450 26158 raft_consensus.cc:2243] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.292351 26158 raft_consensus.cc:2272] T a92c0d0759d14171ae0df1638e73c740 P f0f836402fd5410b9deb0c569dbc1a7e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.295672  1642 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.296876  1716 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.296029 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.297806 26158 raft_consensus.cc:2243] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.298306 26158 raft_consensus.cc:2272] T ea444d3b35d44516a3598e78aa5a6771 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.300520 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.301038 26158 raft_consensus.cc:2243] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.301538 26158 raft_consensus.cc:2272] T c413246a168d46a28a09378837a4453e P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.304239 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.304859 26158 raft_consensus.cc:2243] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.305743 26158 raft_consensus.cc:2272] T ea539e73baec42e2bf45e9ca296219aa P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.307955  1716 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.308522 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.309324 26158 raft_consensus.cc:2243] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.309814 26158 raft_consensus.cc:2272] T 0a0691a4d3494313af304064070cf2e4 P f0f836402fd5410b9deb0c569dbc1a7e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.311432  1716 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.312311 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:14.312947 26158 raft_consensus.cc:2243] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.313515 26158 raft_consensus.cc:2272] T 978d44de9b6f410a9c94c0898667c8f1 P f0f836402fd5410b9deb0c569dbc1a7e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.318796  1568 consensus_peers.cc:597] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.323071  1716 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.324625  1568 consensus_peers.cc:597] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.349524  1642 consensus_peers.cc:597] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.355829  1716 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.385761  1568 consensus_peers.cc:597] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.391575 26158 tablet_server.cc:196] TabletServer@127.25.139.129:38043 shutdown complete.
W20260709 13:13:14.404304  1642 consensus_peers.cc:597] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.432909  1716 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.441597  1716 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.449055  1716 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.464270  1642 consensus_peers.cc:597] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.480140 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
W20260709 13:13:14.487884  1716 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.492928  1568 consensus_peers.cc:597] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.518788  1642 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.529752 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:14.530607 26158 tablet_replica.cc:333] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.531366 26158 raft_consensus.cc:2243] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.531886 26158 raft_consensus.cc:2272] T c105f80f46794d4c918b5380fdd165b3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.534511 26158 tablet_replica.cc:333] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.535449 26158 raft_consensus.cc:2243] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.535948 26158 raft_consensus.cc:2272] T 0a0691a4d3494313af304064070cf2e4 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.538029 26158 tablet_replica.cc:333] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.538573 26158 raft_consensus.cc:2243] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.539415 26158 raft_consensus.cc:2272] T adb3694e79904863a5bcb3e9f2985ad0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.541215 26158 tablet_replica.cc:333] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.541738 26158 raft_consensus.cc:2243] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.542487 26158 raft_consensus.cc:2272] T 978d44de9b6f410a9c94c0898667c8f1 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.545051 26158 tablet_replica.cc:333] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.545943 26158 raft_consensus.cc:2243] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.546494 26158 raft_consensus.cc:2272] T d03b372e29b64b72a97eedf387abc386 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.547750  1718 consensus_peers.cc:597] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.548372  1568 consensus_peers.cc:597] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.548972 26158 tablet_replica.cc:333] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.549574 26158 raft_consensus.cc:2243] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.549934 26158 raft_consensus.cc:2272] T a7f777d8fcda4822b72ea2ff86629dad P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.552315 26158 tablet_replica.cc:333] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.553124 26158 raft_consensus.cc:2243] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.553673 26158 raft_consensus.cc:2272] T e5cbb2cdb27143549a19371a87196764 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.553941  1644 consensus_peers.cc:597] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.555757 26158 tablet_replica.cc:333] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.556421 26158 raft_consensus.cc:2243] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.556849 26158 raft_consensus.cc:2272] T da5ca4158645483daecbd41331823b28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.559262 26158 tablet_replica.cc:333] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.560158 26158 raft_consensus.cc:2243] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.560613 26158 raft_consensus.cc:2272] T 10e8d04de04d4aaba701d3d54a96ba95 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.562554 26158 tablet_replica.cc:333] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.563102 26158 raft_consensus.cc:2243] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.563577 26158 raft_consensus.cc:2272] T f6c73b2826d849cb95d78247681a3fc2 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.566072 26158 tablet_replica.cc:333] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.566778 26158 raft_consensus.cc:2243] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.567268 26158 raft_consensus.cc:2272] T e94725900d8046968b81fad5677b14a6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.570627  1716 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.570648 26158 tablet_replica.cc:333] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.571758 26158 raft_consensus.cc:2243] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.572175 26158 raft_consensus.cc:2272] T c7892b317e15474e89775b9d69f7fe66 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.574440 26158 tablet_replica.cc:333] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.575452 26158 raft_consensus.cc:2243] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.576524 26158 raft_consensus.cc:2272] T 66c508d13a2e4137b001068a1d1a3a28 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.578979  1644 consensus_peers.cc:597] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.579419 26158 tablet_replica.cc:333] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.580189 26158 raft_consensus.cc:2243] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.580672 26158 raft_consensus.cc:2272] T 25c304781e4047a3aa43c42385c174da P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.583024 26158 tablet_replica.cc:333] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.583645 26158 raft_consensus.cc:2243] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.584363 26158 raft_consensus.cc:2272] T 75086307353648738b0658d935e444c6 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.586369 26158 tablet_replica.cc:333] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.587145 26158 raft_consensus.cc:2243] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.587661 26158 raft_consensus.cc:2272] T 50ee3a20a0274ce9b86ef729e86f8669 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.590090 26158 tablet_replica.cc:333] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
W20260709 13:13:14.590076  1644 consensus_peers.cc:597] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.591058 26158 raft_consensus.cc:2243] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.591620 26158 raft_consensus.cc:2272] T 53fb98195cf34f6baea8c9209c1621e7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.593559 26158 tablet_replica.cc:333] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.594357 26158 raft_consensus.cc:2243] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.595283 26158 raft_consensus.cc:2272] T ea444d3b35d44516a3598e78aa5a6771 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.597656  1642 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.598120 26158 tablet_replica.cc:333] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.598814 26158 raft_consensus.cc:2243] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.599378 26158 raft_consensus.cc:2272] T 0b3d4b647afe44848c02525fceeb81a7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.601301 26158 tablet_replica.cc:333] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.601953 26158 raft_consensus.cc:2243] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.602401 26158 raft_consensus.cc:2272] T 71e6f598fa6943a3b2a180ba51e31e1c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.604425 26158 tablet_replica.cc:333] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.604970 26158 raft_consensus.cc:2243] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.605767 26158 raft_consensus.cc:2272] T c77a28753d4848a3880e7b8e19c7c253 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.607817 26158 tablet_replica.cc:333] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.608383 26158 raft_consensus.cc:2243] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.609143 26158 raft_consensus.cc:2272] T c413246a168d46a28a09378837a4453e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.611068 26158 tablet_replica.cc:333] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.611706 26158 raft_consensus.cc:2243] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.612146 26158 raft_consensus.cc:2272] T ea539e73baec42e2bf45e9ca296219aa P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.614771 26158 tablet_replica.cc:333] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
W20260709 13:13:14.615304  1644 consensus_peers.cc:597] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.615475 26158 raft_consensus.cc:2243] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.616103 26158 raft_consensus.cc:2272] T 356632bab23f4101862a3ce673ca5d8c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.618111 26158 tablet_replica.cc:333] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.618719 26158 raft_consensus.cc:2243] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.619297 26158 raft_consensus.cc:2272] T d7dfeb0bf60e419a808cb054b8a99ebe P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.621764 26158 tablet_replica.cc:333] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.622406 26158 raft_consensus.cc:2243] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:14.622808  1644 consensus_peers.cc:597] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.623384 26158 raft_consensus.cc:2272] T d4ae70b3df284d3faf8022535886954e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.625844 26158 tablet_replica.cc:333] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.626442 26158 raft_consensus.cc:2243] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.627301 26158 raft_consensus.cc:2272] T 6195852602da44ef9cbb867e62b07bac P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.629374 26158 tablet_replica.cc:333] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.629916 26158 raft_consensus.cc:2243] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.630362 26158 raft_consensus.cc:2272] T 10d2a7145e324ea3a64b9ae40643e923 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.632323 26158 tablet_replica.cc:333] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.632915 26158 raft_consensus.cc:2243] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.633311 26158 raft_consensus.cc:2272] T 7246ca069aee46739528e2ba5e72e40c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.635200 26158 tablet_replica.cc:333] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.635711 26158 raft_consensus.cc:2243] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.636510 26158 raft_consensus.cc:2272] T 25c161302a6f43a2a5815562dd376bb7 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.638370 26158 tablet_replica.cc:333] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.638911 26158 raft_consensus.cc:2243] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.639366 26158 raft_consensus.cc:2272] T 70b45057315e4ff09bd85cb63fd64c39 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.641263 26158 tablet_replica.cc:333] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.641826 26158 raft_consensus.cc:2243] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.642238 26158 raft_consensus.cc:2272] T eecf06b378aa48e987bc3e69cad1acd0 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.644142 26158 tablet_replica.cc:333] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.644819 26158 raft_consensus.cc:2243] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.645319 26158 raft_consensus.cc:2272] T 35b348df9bbb4e10aedb07823b2f015d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.647796 26158 tablet_replica.cc:333] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.648384 26158 raft_consensus.cc:2243] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.648799 26158 raft_consensus.cc:2272] T bfa8234639df4f6cb6d73f59b3a8fffc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.650844 26158 tablet_replica.cc:333] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.651597 26158 raft_consensus.cc:2243] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.652078 26158 raft_consensus.cc:2272] T 6016a96ce80848be9feac61f7c5bdcee P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.653923 26158 tablet_replica.cc:333] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.654429 26158 raft_consensus.cc:2243] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.654953 26158 raft_consensus.cc:2272] T b158c68a91e44e46bc65d09542c6ef0d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.657321 26158 tablet_replica.cc:333] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.657861 26158 raft_consensus.cc:2243] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.658555 26158 raft_consensus.cc:2272] T c98bf1eac1604413a4fb7dc095aa0e4d P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.660770 26158 tablet_replica.cc:333] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.661276 26158 raft_consensus.cc:2243] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.661669 26158 raft_consensus.cc:2272] T 6ce7af2981b948d384465e8ee576e78e P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.662495  1718 consensus_peers.cc:597] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.664009 26158 tablet_replica.cc:333] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.664671 26158 raft_consensus.cc:2243] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.665129 26158 raft_consensus.cc:2272] T c76ddc05f4da4c84b448ea837803e27c P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.667156 26158 tablet_replica.cc:333] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.667780 26158 raft_consensus.cc:2243] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.668709 26158 raft_consensus.cc:2272] T a43dc0ea5206435ebf2346061be97395 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.671334 26158 tablet_replica.cc:333] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.672081 26158 raft_consensus.cc:2243] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.673059 26158 raft_consensus.cc:2272] T cdbab434e7b64cfb957c2d17d7ba0efc P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.674229  1716 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Couldn't send request to peer f0f836402fd5410b9deb0c569dbc1a7e. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.674870  1644 consensus_peers.cc:597] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.675956 26158 tablet_replica.cc:333] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.676852 26158 raft_consensus.cc:2243] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.677915 26158 raft_consensus.cc:2272] T 9f7ea292ba4c446baa780c385e973388 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.679410  1644 consensus_peers.cc:597] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.680774 26158 tablet_replica.cc:333] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.681630 26158 raft_consensus.cc:2243] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.682718 26158 raft_consensus.cc:2272] T 52c0b8276e87458183fa270edf8307f3 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.685412 26158 tablet_replica.cc:333] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b: stopping tablet replica
I20260709 13:13:14.686033 26158 raft_consensus.cc:2243] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.686543 26158 raft_consensus.cc:2272] T ec881282fcaa453cb97c580feb5000c9 P 7482af1eecbe4abc9f0a21e2d2dbb61b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.744683  1718 consensus_peers.cc:597] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.754630  1718 consensus_peers.cc:597] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.756376  1718 consensus_peers.cc:597] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.808270  1718 consensus_peers.cc:597] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.810954  1718 consensus_peers.cc:597] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.825668 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
W20260709 13:13:14.850513  1644 consensus_peers.cc:597] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.853459  1718 consensus_peers.cc:597] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.857758  1644 consensus_peers.cc:597] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.863600  1644 consensus_peers.cc:597] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 -> Peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Couldn't send request to peer 7482af1eecbe4abc9f0a21e2d2dbb61b. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.904759 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
W20260709 13:13:14.924659  1717 consensus_peers.cc:597] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:14.946581  1717 consensus_peers.cc:597] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.965523 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:14.966497 26158 tablet_replica.cc:333] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.967552 26158 raft_consensus.cc:2243] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.968537 26158 raft_consensus.cc:2272] T 0a0691a4d3494313af304064070cf2e4 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.970994 26158 tablet_replica.cc:333] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.971810 26158 raft_consensus.cc:2243] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.972404 26158 raft_consensus.cc:2272] T 978d44de9b6f410a9c94c0898667c8f1 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:14.974817  1717 consensus_peers.cc:597] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.975304 26158 tablet_replica.cc:333] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.975951 26158 raft_consensus.cc:2243] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.976625 26158 raft_consensus.cc:2272] T d03b372e29b64b72a97eedf387abc386 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.978508 26158 tablet_replica.cc:333] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.979030 26158 raft_consensus.cc:2243] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.979844 26158 raft_consensus.cc:2272] T e5cbb2cdb27143549a19371a87196764 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.982192 26158 tablet_replica.cc:333] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.982969 26158 raft_consensus.cc:2243] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:14.983311  1717 consensus_peers.cc:597] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:14.983459 26158 raft_consensus.cc:2272] T bc6e4900b0f8471a9e011ad8e7b4883c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.985361 26158 tablet_replica.cc:333] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.985947 26158 raft_consensus.cc:2243] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.986393 26158 raft_consensus.cc:2272] T c413246a168d46a28a09378837a4453e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.988415 26158 tablet_replica.cc:333] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.988981 26158 raft_consensus.cc:2243] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:14.989403 26158 raft_consensus.cc:2272] T f6c73b2826d849cb95d78247681a3fc2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.991241 26158 tablet_replica.cc:333] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.991782 26158 raft_consensus.cc:2243] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.992540 26158 raft_consensus.cc:2272] T eecf06b378aa48e987bc3e69cad1acd0 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.994467 26158 tablet_replica.cc:333] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.995075 26158 raft_consensus.cc:2243] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.995894 26158 raft_consensus.cc:2272] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:14.997925 26158 tablet_replica.cc:333] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:14.998687 26158 raft_consensus.cc:2243] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:14.999715 26158 raft_consensus.cc:2272] T 10e8d04de04d4aaba701d3d54a96ba95 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.002449 26158 tablet_replica.cc:333] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.003226 26158 raft_consensus.cc:2243] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.004168 26158 raft_consensus.cc:2272] T 827bdde8c8124516a8bf5558f04c5749 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.006780 26158 tablet_replica.cc:333] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.007550 26158 raft_consensus.cc:2243] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.008010 26158 raft_consensus.cc:2272] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.009878 26158 tablet_replica.cc:333] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.010429 26158 raft_consensus.cc:2243] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.010815 26158 raft_consensus.cc:2272] T 9f7ea292ba4c446baa780c385e973388 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.012662 26158 tablet_replica.cc:333] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.013393 26158 raft_consensus.cc:2243] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.013875 26158 raft_consensus.cc:2272] T cdbab434e7b64cfb957c2d17d7ba0efc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.016412 26158 tablet_replica.cc:333] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.017182 26158 raft_consensus.cc:2243] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.018056 26158 raft_consensus.cc:2272] T 7246ca069aee46739528e2ba5e72e40c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.020545 26158 tablet_replica.cc:333] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.021260 26158 raft_consensus.cc:2243] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.021782 26158 raft_consensus.cc:2272] T 25c161302a6f43a2a5815562dd376bb7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.024335 26158 tablet_replica.cc:333] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.025081 26158 raft_consensus.cc:2243] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.025606 26158 raft_consensus.cc:2272] T 0379b5784a684643b7f6abcd1a99e91f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.028249 26158 tablet_replica.cc:333] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.028976 26158 raft_consensus.cc:2243] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.029507 26158 raft_consensus.cc:2272] T 6195852602da44ef9cbb867e62b07bac P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.032174 26158 tablet_replica.cc:333] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.032694 26158 raft_consensus.cc:2243] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.033519 26158 raft_consensus.cc:2272] T 10d2a7145e324ea3a64b9ae40643e923 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.035568 26158 tablet_replica.cc:333] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.036293 26158 raft_consensus.cc:2243] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.036803 26158 raft_consensus.cc:2272] T f3239aa727f34be3b22879bece578a0c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.038805 26158 tablet_replica.cc:333] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.039450 26158 raft_consensus.cc:2243] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.039878 26158 raft_consensus.cc:2272] T 66c508d13a2e4137b001068a1d1a3a28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.041683 26158 tablet_replica.cc:333] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.042237 26158 raft_consensus.cc:2243] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.042680 26158 raft_consensus.cc:2272] T 5160521b61c64b3197aeb0a169fecff3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.044682 26158 tablet_replica.cc:333] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.045279 26158 raft_consensus.cc:2243] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.045701 26158 raft_consensus.cc:2272] T 25c304781e4047a3aa43c42385c174da P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.047598 26158 tablet_replica.cc:333] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.048141 26158 raft_consensus.cc:2243] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.048978 26158 raft_consensus.cc:2272] T 64bfde6140f041d3835174d6009e02d2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.051709 26158 tablet_replica.cc:333] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.052418 26158 raft_consensus.cc:2243] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.052904 26158 raft_consensus.cc:2272] T 3b14405810174b1da9026bec4dfa5110 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.055466 26158 tablet_replica.cc:333] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.056246 26158 raft_consensus.cc:2243] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.056744 26158 raft_consensus.cc:2272] T 6ce7af2981b948d384465e8ee576e78e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.059254 26158 tablet_replica.cc:333] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.059768 26158 raft_consensus.cc:2243] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.060117 26158 raft_consensus.cc:2272] T ea444d3b35d44516a3598e78aa5a6771 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.061986 26158 tablet_replica.cc:333] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.062551 26158 raft_consensus.cc:2243] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.062907 26158 raft_consensus.cc:2272] T 0b3d4b647afe44848c02525fceeb81a7 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.064626 26158 tablet_replica.cc:333] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.065106 26158 raft_consensus.cc:2243] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.065446 26158 raft_consensus.cc:2272] T 75086307353648738b0658d935e444c6 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.067067 26158 tablet_replica.cc:333] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.067616 26158 raft_consensus.cc:2243] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.068264 26158 raft_consensus.cc:2272] T 793b9da3cfbe48f7912724719cac2e28 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.069938 26158 tablet_replica.cc:333] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.070398 26158 raft_consensus.cc:2243] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.070751 26158 raft_consensus.cc:2272] T a92c0d0759d14171ae0df1638e73c740 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.072490 26158 tablet_replica.cc:333] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.072956 26158 raft_consensus.cc:2243] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.073292 26158 raft_consensus.cc:2272] T ec881282fcaa453cb97c580feb5000c9 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.075026 26158 tablet_replica.cc:333] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.075555 26158 raft_consensus.cc:2243] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.075922 26158 raft_consensus.cc:2272] T d4ae70b3df284d3faf8022535886954e P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.077708 26158 tablet_replica.cc:333] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.078244 26158 raft_consensus.cc:2243] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.078629 26158 raft_consensus.cc:2272] T 43d4bdf431b24970b2da0f2c5bf1fdec P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.080518 26158 tablet_replica.cc:333] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.081032 26158 raft_consensus.cc:2243] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.081790 26158 raft_consensus.cc:2272] T b158c68a91e44e46bc65d09542c6ef0d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.083664 26158 tablet_replica.cc:333] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.084173 26158 raft_consensus.cc:2243] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.084569 26158 raft_consensus.cc:2272] T c98bf1eac1604413a4fb7dc095aa0e4d P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.086269 26158 tablet_replica.cc:333] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.086764 26158 raft_consensus.cc:2243] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.087560 26158 raft_consensus.cc:2272] T bfa8234639df4f6cb6d73f59b3a8fffc P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.089525 26158 tablet_replica.cc:333] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.090049 26158 raft_consensus.cc:2243] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.090790 26158 raft_consensus.cc:2272] T 6016a96ce80848be9feac61f7c5bdcee P 56c68eed42dc40c4ac69ff82c925b3f0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.092531 26158 tablet_replica.cc:333] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.093067 26158 raft_consensus.cc:2243] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.093550 26158 raft_consensus.cc:2272] T 08fc8c696d1441de9afedcc0a96f0908 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.098302 26158 tablet_replica.cc:333] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.099021 26158 raft_consensus.cc:2243] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.099545 26158 raft_consensus.cc:2272] T 52c0b8276e87458183fa270edf8307f3 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.102068 26158 tablet_replica.cc:333] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.102710 26158 raft_consensus.cc:2243] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.103235 26158 raft_consensus.cc:2272] T c77a28753d4848a3880e7b8e19c7c253 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.105723 26158 tablet_replica.cc:333] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.106287 26158 raft_consensus.cc:2243] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.106674 26158 raft_consensus.cc:2272] T 9ec3c6f8fd494b03a01e4794bf69e59f P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.108489 26158 tablet_replica.cc:333] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.108937 26158 raft_consensus.cc:2243] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.109679 26158 raft_consensus.cc:2272] T 356632bab23f4101862a3ce673ca5d8c P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.111636 26158 tablet_replica.cc:333] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0: stopping tablet replica
I20260709 13:13:15.112200 26158 raft_consensus.cc:2243] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.112588 26158 raft_consensus.cc:2272] T 56487f97c81348d18d1336ca6b5a08e2 P 56c68eed42dc40c4ac69ff82c925b3f0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:15.118939  1717 consensus_peers.cc:597] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:15.207826 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:13:15.222869  2779 raft_consensus.cc:493] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.223592  2779 raft_consensus.cc:515] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:15.225657  2779 leader_election.cc:290] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:13:15.232160  1718 leader_election.cc:336] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111)
W20260709 13:13:15.235047  1716 leader_election.cc:336] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:13:15.235503  1716 leader_election.cc:304] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.236265  2817 raft_consensus.cc:2749] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:15.247133  1717 consensus_peers.cc:597] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.131:45361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:15.250036  1717 consensus_peers.cc:597] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.131:45361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:15.266377  2817 raft_consensus.cc:493] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.267076  2817 raft_consensus.cc:515] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:15.269488  2817 leader_election.cc:290] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
W20260709 13:13:15.273833  1716 leader_election.cc:336] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:13:15.274422  1717 leader_election.cc:336] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Network error: Client connection negotiation failed: client connection to 127.25.139.131:45361: connect: Connection refused (error 111)
I20260709 13:13:15.274870  1717 leader_election.cc:304] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.275671  2817 raft_consensus.cc:2749] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.294266 26158 tablet_server.cc:179] TabletServer@127.25.139.132:0 shutting down...
I20260709 13:13:15.305048  2817 raft_consensus.cc:493] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.305644  2817 raft_consensus.cc:515] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:15.311677  2817 leader_election.cc:290] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:13:15.313686  1716 leader_election.cc:336] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:13:15.315985  1718 leader_election.cc:336] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111)
I20260709 13:13:15.317281  1718 leader_election.cc:304] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.318176  2817 raft_consensus.cc:2749] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.332211  2814 raft_consensus.cc:493] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.332852  2814 raft_consensus.cc:515] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:15.336838  2814 leader_election.cc:290] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
W20260709 13:13:15.342542  1716 leader_election.cc:336] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
W20260709 13:13:15.344389  1718 leader_election.cc:336] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111)
I20260709 13:13:15.344991  1718 leader_election.cc:304] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.345978  2814 raft_consensus.cc:2749] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:15.376806 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:13:15.378156  1717 consensus_peers.cc:597] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a -> Peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Couldn't send request to peer 56c68eed42dc40c4ac69ff82c925b3f0. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.131:45361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:15.379354 26158 tablet_replica.cc:333] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.380365 26158 raft_consensus.cc:2243] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.381361 26158 raft_consensus.cc:2272] T c105f80f46794d4c918b5380fdd165b3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.383093  2814 raft_consensus.cc:493] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.383639  2814 raft_consensus.cc:515] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } } peers { permanent_uuid: "7482af1eecbe4abc9f0a21e2d2dbb61b" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35065 } }
I20260709 13:13:15.384265 26158 tablet_replica.cc:333] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.385169 26158 raft_consensus.cc:2243] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.385468  2814 leader_election.cc:290] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043), 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065)
I20260709 13:13:15.385824 26158 raft_consensus.cc:2272] T d03b372e29b64b72a97eedf387abc386 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.388674 26158 tablet_replica.cc:333] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.389513 26158 raft_consensus.cc:2243] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:15.390236  1718 leader_election.cc:336] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7482af1eecbe4abc9f0a21e2d2dbb61b (127.25.139.130:35065): Network error: Client connection negotiation failed: client connection to 127.25.139.130:35065: connect: Connection refused (error 111)
W20260709 13:13:15.390873  1716 leader_election.cc:336] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:13:15.391333  1716 leader_election.cc:304] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 7482af1eecbe4abc9f0a21e2d2dbb61b, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.391824 26158 raft_consensus.cc:2272] T adb3694e79904863a5bcb3e9f2985ad0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.392043  2779 raft_consensus.cc:2749] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.394870 26158 tablet_replica.cc:333] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.395713 26158 raft_consensus.cc:2243] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.396275 26158 raft_consensus.cc:2272] T a7f777d8fcda4822b72ea2ff86629dad P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.398377 26158 tablet_replica.cc:333] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.398953 26158 raft_consensus.cc:2243] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.399420 26158 raft_consensus.cc:2272] T e5cbb2cdb27143549a19371a87196764 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.401736 26158 tablet_replica.cc:333] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.402372 26158 raft_consensus.cc:2243] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.402869 26158 raft_consensus.cc:2272] T da5ca4158645483daecbd41331823b28 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.405422 26158 tablet_replica.cc:333] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.406231 26158 raft_consensus.cc:2243] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.406646 26158 raft_consensus.cc:2272] T 10e8d04de04d4aaba701d3d54a96ba95 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.409292 26158 tablet_replica.cc:333] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.409854 26158 raft_consensus.cc:2243] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.410384 26158 raft_consensus.cc:2272] T 64bfde6140f041d3835174d6009e02d2 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.412642 26158 tablet_replica.cc:333] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.413209 26158 raft_consensus.cc:2243] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.413623 26158 raft_consensus.cc:2272] T 3b14405810174b1da9026bec4dfa5110 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.415436 26158 tablet_replica.cc:333] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.415972 26158 raft_consensus.cc:2243] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.416739 26158 raft_consensus.cc:2272] T 0379b5784a684643b7f6abcd1a99e91f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.418754 26158 tablet_replica.cc:333] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.419359 26158 raft_consensus.cc:2243] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.419781 26158 raft_consensus.cc:2272] T e94725900d8046968b81fad5677b14a6 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.421990 26158 tablet_replica.cc:333] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.422652 26158 raft_consensus.cc:2243] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.423439 26158 raft_consensus.cc:2272] T c7892b317e15474e89775b9d69f7fe66 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.426059 26158 tablet_replica.cc:333] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.426651 26158 raft_consensus.cc:2243] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.427098 26158 raft_consensus.cc:2272] T 827bdde8c8124516a8bf5558f04c5749 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.429131 26158 tablet_replica.cc:333] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.429679 26158 raft_consensus.cc:2243] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.430117 26158 raft_consensus.cc:2272] T 53fb98195cf34f6baea8c9209c1621e7 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.432369 26158 tablet_replica.cc:333] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.432907 26158 raft_consensus.cc:2243] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.433694 26158 raft_consensus.cc:2272] T 062b7dfb8c3f4c0498cd8d10a1d2dd26 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.434160  2779 raft_consensus.cc:493] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f0f836402fd5410b9deb0c569dbc1a7e)
I20260709 13:13:15.434630  2779 raft_consensus.cc:515] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "56c68eed42dc40c4ac69ff82c925b3f0" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 45361 } } peers { permanent_uuid: "81b721300bd34373862d7937c3bf394a" member_type: VOTER last_known_addr { host: "127.25.139.132" port: 42975 } } peers { permanent_uuid: "f0f836402fd5410b9deb0c569dbc1a7e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 38043 } }
I20260709 13:13:15.436334 26158 tablet_replica.cc:333] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.436856  2779 leader_election.cc:290] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361), f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043)
I20260709 13:13:15.437214 26158 raft_consensus.cc:2243] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.437786 26158 raft_consensus.cc:2272] T 10d2a7145e324ea3a64b9ae40643e923 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.440506 26158 tablet_replica.cc:333] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
W20260709 13:13:15.440757  1717 leader_election.cc:336] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 56c68eed42dc40c4ac69ff82c925b3f0 (127.25.139.131:45361): Network error: Client connection negotiation failed: client connection to 127.25.139.131:45361: connect: Connection refused (error 111)
I20260709 13:13:15.441112 26158 raft_consensus.cc:2243] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:15.441368  1716 leader_election.cc:336] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f0f836402fd5410b9deb0c569dbc1a7e (127.25.139.129:38043): Network error: Client connection negotiation failed: client connection to 127.25.139.129:38043: connect: Connection refused (error 111)
I20260709 13:13:15.441784  1716 leader_election.cc:304] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81b721300bd34373862d7937c3bf394a; no voters: 56c68eed42dc40c4ac69ff82c925b3f0, f0f836402fd5410b9deb0c569dbc1a7e
I20260709 13:13:15.442179 26158 raft_consensus.cc:2272] T f3239aa727f34be3b22879bece578a0c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.442431  2779 raft_consensus.cc:2749] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:15.444384 26158 tablet_replica.cc:333] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.445012 26158 raft_consensus.cc:2243] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.445458 26158 raft_consensus.cc:2272] T a92c0d0759d14171ae0df1638e73c740 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.447397 26158 tablet_replica.cc:333] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.447983 26158 raft_consensus.cc:2243] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.448767 26158 raft_consensus.cc:2272] T 0b3d4b647afe44848c02525fceeb81a7 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.450567 26158 tablet_replica.cc:333] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.451110 26158 raft_consensus.cc:2243] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.452239 26158 raft_consensus.cc:2272] T 50ee3a20a0274ce9b86ef729e86f8669 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.454682 26158 tablet_replica.cc:333] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.455487 26158 raft_consensus.cc:2243] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.455976 26158 raft_consensus.cc:2272] T 75086307353648738b0658d935e444c6 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.457707 26158 tablet_replica.cc:333] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.458274 26158 raft_consensus.cc:2243] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.458683 26158 raft_consensus.cc:2272] T bc6e4900b0f8471a9e011ad8e7b4883c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.460584 26158 tablet_replica.cc:333] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.461146 26158 raft_consensus.cc:2243] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.461921 26158 raft_consensus.cc:2272] T d7dfeb0bf60e419a808cb054b8a99ebe P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.463948 26158 tablet_replica.cc:333] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.464558 26158 raft_consensus.cc:2243] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.464926 26158 raft_consensus.cc:2272] T ea539e73baec42e2bf45e9ca296219aa P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.466662 26158 tablet_replica.cc:333] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.467139 26158 raft_consensus.cc:2243] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.467934 26158 raft_consensus.cc:2272] T 5160521b61c64b3197aeb0a169fecff3 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.470368 26158 tablet_replica.cc:333] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.470847 26158 raft_consensus.cc:2243] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.471299 26158 raft_consensus.cc:2272] T eecf06b378aa48e987bc3e69cad1acd0 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.473277 26158 tablet_replica.cc:333] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.473794 26158 raft_consensus.cc:2243] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.474208 26158 raft_consensus.cc:2272] T cb08ccac0eca4cd2af937e0c1cb87ce2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.476119 26158 tablet_replica.cc:333] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.476649 26158 raft_consensus.cc:2243] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.477366 26158 raft_consensus.cc:2272] T 35b348df9bbb4e10aedb07823b2f015d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.479274 26158 tablet_replica.cc:333] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.479785 26158 raft_consensus.cc:2243] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.480187 26158 raft_consensus.cc:2272] T 7246ca069aee46739528e2ba5e72e40c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.481894 26158 tablet_replica.cc:333] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.482431 26158 raft_consensus.cc:2243] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.482822 26158 raft_consensus.cc:2272] T 70b45057315e4ff09bd85cb63fd64c39 P 81b721300bd34373862d7937c3bf394a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.484488 26158 tablet_replica.cc:333] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.485004 26158 raft_consensus.cc:2243] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.485440 26158 raft_consensus.cc:2272] T 793b9da3cfbe48f7912724719cac2e28 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.487279 26158 tablet_replica.cc:333] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.487785 26158 raft_consensus.cc:2243] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.488513 26158 raft_consensus.cc:2272] T 71e6f598fa6943a3b2a180ba51e31e1c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.490311 26158 tablet_replica.cc:333] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.490834 26158 raft_consensus.cc:2243] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.491273 26158 raft_consensus.cc:2272] T 6016a96ce80848be9feac61f7c5bdcee P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.493077 26158 tablet_replica.cc:333] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.493607 26158 raft_consensus.cc:2243] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.494307 26158 raft_consensus.cc:2272] T 9ec3c6f8fd494b03a01e4794bf69e59f P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.496045 26158 tablet_replica.cc:333] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.496500 26158 raft_consensus.cc:2243] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.496834 26158 raft_consensus.cc:2272] T cdbab434e7b64cfb957c2d17d7ba0efc P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.498898 26158 tablet_replica.cc:333] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.499456 26158 raft_consensus.cc:2243] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.499893 26158 raft_consensus.cc:2272] T 9f7ea292ba4c446baa780c385e973388 P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.501904 26158 tablet_replica.cc:333] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.502405 26158 raft_consensus.cc:2243] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.503121 26158 raft_consensus.cc:2272] T 08fc8c696d1441de9afedcc0a96f0908 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.504980 26158 tablet_replica.cc:333] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.505491 26158 raft_consensus.cc:2243] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.505908 26158 raft_consensus.cc:2272] T 52c0b8276e87458183fa270edf8307f3 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.507779 26158 tablet_replica.cc:333] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.508270 26158 raft_consensus.cc:2243] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.508659 26158 raft_consensus.cc:2272] T c98bf1eac1604413a4fb7dc095aa0e4d P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.510480 26158 tablet_replica.cc:333] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.510952 26158 raft_consensus.cc:2243] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.511399 26158 raft_consensus.cc:2272] T 43d4bdf431b24970b2da0f2c5bf1fdec P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.513113 26158 tablet_replica.cc:333] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.513612 26158 raft_consensus.cc:2243] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.514361 26158 raft_consensus.cc:2272] T c76ddc05f4da4c84b448ea837803e27c P 81b721300bd34373862d7937c3bf394a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.516316 26158 tablet_replica.cc:333] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.516798 26158 raft_consensus.cc:2243] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.517213 26158 raft_consensus.cc:2272] T a43dc0ea5206435ebf2346061be97395 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.518965 26158 tablet_replica.cc:333] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.519520 26158 raft_consensus.cc:2243] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:15.519937 26158 raft_consensus.cc:2272] T 356632bab23f4101862a3ce673ca5d8c P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.521693 26158 tablet_replica.cc:333] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a: stopping tablet replica
I20260709 13:13:15.522136 26158 raft_consensus.cc:2243] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.522878 26158 raft_consensus.cc:2272] T 56487f97c81348d18d1336ca6b5a08e2 P 81b721300bd34373862d7937c3bf394a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.589556 26158 tablet_server.cc:196] TabletServer@127.25.139.132:0 shutdown complete.
I20260709 13:13:15.649869 26158 master.cc:562] Master@127.25.139.190:41051 shutting down...
I20260709 13:13:15.674376 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:15.674932 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:15.675333 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P fd5616a2f655436cb398d7d61eefc3de: stopping tablet replica
I20260709 13:13:15.698206 26158 master.cc:584] Master@127.25.139.190:41051 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (42981 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:15.790736 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:41549
I20260709 13:13:15.792095 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:15.797541  2819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.797610  2818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:15.799120  2821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:15.800257 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:15.801335 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:15.801514 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:15.801623 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602795801612 us; error 0 us; skew 500 ppm
I20260709 13:13:15.802085 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:15.804381 26158 webserver.cc:533] Webserver started at http://127.25.139.190:37167/ using document root <none> and password file <none>
I20260709 13:13:15.804834 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:15.804982 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:15.805188 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:15.806278 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "ef35a74d63fb4f2db20e952ce8aa8b75"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-v5z2"
I20260709 13:13:15.810667 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:13:15.814004  2826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:15.814724 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:15.815042 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "ef35a74d63fb4f2db20e952ce8aa8b75"
format_stamp: "Formatted at 2026-07-09 13:13:15 on dist-test-slave-v5z2"
I20260709 13:13:15.815392 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:15.837646 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:15.838902 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:15.876631 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:41549
I20260709 13:13:15.876727  2877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:41549 every 8 connection(s)
I20260709 13:13:15.880640  2878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.890940  2878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75: Bootstrap starting.
I20260709 13:13:15.895812  2878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.900178  2878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75: No bootstrap required, opened a new log
I20260709 13:13:15.902318  2878 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER }
I20260709 13:13:15.902712  2878 raft_consensus.cc:385] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.902901  2878 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef35a74d63fb4f2db20e952ce8aa8b75, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.903478  2878 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER }
I20260709 13:13:15.903908  2878 raft_consensus.cc:399] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:15.904099  2878 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:15.904309  2878 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.908891  2878 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER }
I20260709 13:13:15.909371  2878 leader_election.cc:304] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef35a74d63fb4f2db20e952ce8aa8b75; no voters: 
I20260709 13:13:15.910441  2878 leader_election.cc:290] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:15.910799  2881 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.912200  2881 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 1 LEADER]: Becoming Leader. State: Replica: ef35a74d63fb4f2db20e952ce8aa8b75, State: Running, Role: LEADER
I20260709 13:13:15.912798  2881 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER }
I20260709 13:13:15.913499  2878 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:15.917286  2883 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef35a74d63fb4f2db20e952ce8aa8b75. Latest consensus state: current_term: 1 leader_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER } }
I20260709 13:13:15.918169  2883 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:15.917965  2882 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef35a74d63fb4f2db20e952ce8aa8b75" member_type: VOTER } }
I20260709 13:13:15.919689  2882 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:15.920849  2888 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:15.929181  2888 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:15.931605 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:15.938771  2888 catalog_manager.cc:1383] Generated new cluster ID: bf34c4dbe81a4651944c8ed72f5f790f
I20260709 13:13:15.939090  2888 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:15.961047  2888 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:15.962297  2888 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:15.982421  2888 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75: Generated new TSK 0
I20260709 13:13:15.983034  2888 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:15.997991 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:16.004294  2899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.005395  2900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.006485  2902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:16.007408 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:16.008550 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:16.008733 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:16.008941 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602796008926 us; error 0 us; skew 500 ppm
I20260709 13:13:16.009419 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:16.011677 26158 webserver.cc:533] Webserver started at http://127.25.139.129:34287/ using document root <none> and password file <none>
I20260709 13:13:16.012146 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:16.012301 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:16.012516 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:16.013504 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "f5d71a6a22714023ac594f0c82a9a324"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.018412 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:13:16.021687  2907 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.022490 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:16.022799 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "f5d71a6a22714023ac594f0c82a9a324"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.023118 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:16.050050 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:16.051360 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:16.052788 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:16.055089 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:16.055325 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.055579 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:16.055783 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.096156 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:36469
I20260709 13:13:16.096264  2969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:36469 every 8 connection(s)
I20260709 13:13:16.101336 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:16.111011  2975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.108597  2974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:16.111982 26158 server_base.cc:1061] running on GCE node
W20260709 13:13:16.112653  2977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:16.113548 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:16.113765 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:16.113955 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602796113936 us; error 0 us; skew 500 ppm
I20260709 13:13:16.114511 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:16.117074 26158 webserver.cc:533] Webserver started at http://127.25.139.130:42791/ using document root <none> and password file <none>
I20260709 13:13:16.117630 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:16.117843 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:16.118116 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:16.119522 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "15a3ed5662c34686bf40ba3c3579d869"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.120563  2970 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41549
I20260709 13:13:16.120973  2970 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:16.121680  2970 heartbeater.cc:507] Master 127.25.139.190:41549 requested a full tablet report, sending...
I20260709 13:13:16.123757  2843 ts_manager.cc:194] Registered new tserver with Master: f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469)
I20260709 13:13:16.124908 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:16.126230  2843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36096
I20260709 13:13:16.129223  2982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.130007 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:16.130324 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "15a3ed5662c34686bf40ba3c3579d869"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.130609 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:16.145727 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:16.146950 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:16.148461 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:16.150661 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:16.150880 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.151124 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:16.151366 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:16.191075 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:38703
I20260709 13:13:16.191236  3044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:38703 every 8 connection(s)
I20260709 13:13:16.195974 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:16.203022  3048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.205243  3049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:16.206329  3051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:16.207206 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:16.208356 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:16.208540  3045 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41549
W20260709 13:13:16.208621 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:16.209039 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602796209023 us; error 0 us; skew 500 ppm
I20260709 13:13:16.209092  3045 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:16.209654 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:16.209940  3045 heartbeater.cc:507] Master 127.25.139.190:41549 requested a full tablet report, sending...
I20260709 13:13:16.212436 26158 webserver.cc:533] Webserver started at http://127.25.139.131:42973/ using document root <none> and password file <none>
I20260709 13:13:16.212466  2843 ts_manager.cc:194] Registered new tserver with Master: 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:16.213235 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:16.213514 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:16.213824 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:16.214425  2843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36112
I20260709 13:13:16.215377 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "55a4dc153bf64de39e1c07251ef93c6b"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.219946 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:16.223271  3056 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.224048 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:16.224377 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "55a4dc153bf64de39e1c07251ef93c6b"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:16.224653 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:16.238929 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:16.240180 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:16.241636 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:16.243923 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:16.244107 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.244411 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:16.244580 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:16.284605 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:33859
I20260709 13:13:16.284749  3118 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:33859 every 8 connection(s)
I20260709 13:13:16.298574  3119 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41549
I20260709 13:13:16.299041  3119 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:16.299767  3119 heartbeater.cc:507] Master 127.25.139.190:41549 requested a full tablet report, sending...
I20260709 13:13:16.301689  2843 ts_manager.cc:194] Registered new tserver with Master: 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:16.302493 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014610611s
I20260709 13:13:16.303056  2843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36120
I20260709 13:13:16.327316  2843 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36126:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:16.330142  2843 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:16.401432  2935 tablet_service.cc:1511] Processing CreateTablet for tablet cb28f4235a99482fa4894bd5838c873c (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:16.404461  2934 tablet_service.cc:1511] Processing CreateTablet for tablet b31955de830248e58b5497fcd457f664 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:16.405164  2933 tablet_service.cc:1511] Processing CreateTablet for tablet 73e3401270bc41f98be1c411e4560fce (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:16.402995  2935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb28f4235a99482fa4894bd5838c873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.406612  2933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3401270bc41f98be1c411e4560fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.407893  2934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31955de830248e58b5497fcd457f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.408434  2932 tablet_service.cc:1511] Processing CreateTablet for tablet 28c4c3a1c1e54d2b82f027b79c4d740d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:16.409996  2932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c4c3a1c1e54d2b82f027b79c4d740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.415546  2931 tablet_service.cc:1511] Processing CreateTablet for tablet 3003943086b2494090eb24c491ef7b27 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:16.417068  2931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3003943086b2494090eb24c491ef7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.421581  2930 tablet_service.cc:1511] Processing CreateTablet for tablet e2a43c8e559a42c8a41e6d7e5985fb13 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:16.423105  2930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a43c8e559a42c8a41e6d7e5985fb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.431353  2929 tablet_service.cc:1511] Processing CreateTablet for tablet 21f26a0a958e44899b50f88fd2414ae0 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:16.432839  2929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f26a0a958e44899b50f88fd2414ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.436875  2928 tablet_service.cc:1511] Processing CreateTablet for tablet 7aab83954ef142daac361e96c946080d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:16.438714  2928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aab83954ef142daac361e96c946080d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.441550  2927 tablet_service.cc:1511] Processing CreateTablet for tablet b46a0549abed4e01b40b7872d3b7e93e (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:16.447676  2927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a0549abed4e01b40b7872d3b7e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.450341  2932 tablet_service.cc:1511] Processing CreateTablet for tablet 8affd57325ad483c9e4602b8cb764892 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:16.455390  2932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affd57325ad483c9e4602b8cb764892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.453810  3133 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.466269  3133 tablet_bootstrap.cc:654] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.500128  3133 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.500691  3133 ts_tablet_manager.cc:1403] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.014s
I20260709 13:13:16.503931  3133 raft_consensus.cc:359] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.504694  3133 raft_consensus.cc:385] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.504999  3133 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.505764  3133 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.508303  2970 heartbeater.cc:499] Master 127.25.139.190:41549 was elected leader, sending a full tablet report...
I20260709 13:13:16.508942  3133 ts_tablet_manager.cc:1434] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:13:16.510162  3133 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.513468  3010 tablet_service.cc:1511] Processing CreateTablet for tablet cb28f4235a99482fa4894bd5838c873c (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:16.513633  3009 tablet_service.cc:1511] Processing CreateTablet for tablet b31955de830248e58b5497fcd457f664 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:16.515285  3010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb28f4235a99482fa4894bd5838c873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.516438  3084 tablet_service.cc:1511] Processing CreateTablet for tablet cb28f4235a99482fa4894bd5838c873c (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:16.516917  3008 tablet_service.cc:1511] Processing CreateTablet for tablet 73e3401270bc41f98be1c411e4560fce (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:16.517349  3133 tablet_bootstrap.cc:654] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.517977  3084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb28f4235a99482fa4894bd5838c873c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.518567  3009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31955de830248e58b5497fcd457f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.518224  3078 tablet_service.cc:1511] Processing CreateTablet for tablet 21f26a0a958e44899b50f88fd2414ae0 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:16.519826  3078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f26a0a958e44899b50f88fd2414ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.520370  3083 tablet_service.cc:1511] Processing CreateTablet for tablet b31955de830248e58b5497fcd457f664 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:16.520555  3077 tablet_service.cc:1511] Processing CreateTablet for tablet 7aab83954ef142daac361e96c946080d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:16.521792  3083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b31955de830248e58b5497fcd457f664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.522081  3007 tablet_service.cc:1511] Processing CreateTablet for tablet 28c4c3a1c1e54d2b82f027b79c4d740d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:16.523465  3007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c4c3a1c1e54d2b82f027b79c4d740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.523646  3077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aab83954ef142daac361e96c946080d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.524396  3082 tablet_service.cc:1511] Processing CreateTablet for tablet 73e3401270bc41f98be1c411e4560fce (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:16.525785  3082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3401270bc41f98be1c411e4560fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.526176  3008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3401270bc41f98be1c411e4560fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.527576  3081 tablet_service.cc:1511] Processing CreateTablet for tablet 28c4c3a1c1e54d2b82f027b79c4d740d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:16.528013  3006 tablet_service.cc:1511] Processing CreateTablet for tablet 3003943086b2494090eb24c491ef7b27 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:16.529019  3081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c4c3a1c1e54d2b82f027b79c4d740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.529321  3006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3003943086b2494090eb24c491ef7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.532356  3080 tablet_service.cc:1511] Processing CreateTablet for tablet 3003943086b2494090eb24c491ef7b27 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:16.533740  3080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3003943086b2494090eb24c491ef7b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.534329  3005 tablet_service.cc:1511] Processing CreateTablet for tablet e2a43c8e559a42c8a41e6d7e5985fb13 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:16.535815  3005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a43c8e559a42c8a41e6d7e5985fb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.536353  3079 tablet_service.cc:1511] Processing CreateTablet for tablet e2a43c8e559a42c8a41e6d7e5985fb13 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:16.537758  3079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a43c8e559a42c8a41e6d7e5985fb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.545562  3004 tablet_service.cc:1511] Processing CreateTablet for tablet 21f26a0a958e44899b50f88fd2414ae0 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:16.546392  3076 tablet_service.cc:1511] Processing CreateTablet for tablet b46a0549abed4e01b40b7872d3b7e93e (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:16.547560  3004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21f26a0a958e44899b50f88fd2414ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.548619  3076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a0549abed4e01b40b7872d3b7e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.555342  3003 tablet_service.cc:1511] Processing CreateTablet for tablet 7aab83954ef142daac361e96c946080d (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:16.557799  3003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aab83954ef142daac361e96c946080d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.572597  3002 tablet_service.cc:1511] Processing CreateTablet for tablet b46a0549abed4e01b40b7872d3b7e93e (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:16.574343  3002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a0549abed4e01b40b7872d3b7e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.581331  3001 tablet_service.cc:1511] Processing CreateTablet for tablet 8affd57325ad483c9e4602b8cb764892 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:16.582962  3001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affd57325ad483c9e4602b8cb764892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:16.593251  3075 tablet_service.cc:1511] Processing CreateTablet for tablet 8affd57325ad483c9e4602b8cb764892 (DEFAULT_TABLE table=test-workload [id=28ffb0fc7d3e4176900f4f8ceae1589e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:16.595438  3075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8affd57325ad483c9e4602b8cb764892. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:16.600641  2971 tablet.cc:2406] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:16.617132  3135 raft_consensus.cc:493] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.626521  3135 raft_consensus.cc:515] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.660959  3135 leader_election.cc:290] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:16.664812  3136 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:16.667891  3133 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.668491  3133 ts_tablet_manager.cc:1403] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.159s	user 0.002s	sys 0.017s
I20260709 13:13:16.682354  3136 tablet_bootstrap.cc:654] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.715993  3133 raft_consensus.cc:359] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.716840  3133 raft_consensus.cc:385] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.717126  3133 raft_consensus.cc:740] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.717854  3133 consensus_queue.cc:260] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.728262  3139 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:16.736286  3139 tablet_bootstrap.cc:654] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.748311  3136 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:16.744719  3133 ts_tablet_manager.cc:1434] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.004s
I20260709 13:13:16.791308  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
W20260709 13:13:16.794813  2911 leader_election.cc:343] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.795528  3133 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.800954  3139 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:16.802143  3139 ts_tablet_manager.cc:1403] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.003s
I20260709 13:13:16.805543  3136 ts_tablet_manager.cc:1403] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.141s	user 0.009s	sys 0.005s
I20260709 13:13:16.809397  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
W20260709 13:13:16.812139  2911 leader_election.cc:343] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.812768  2911 leader_election.cc:304] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:16.816545  3133 tablet_bootstrap.cc:654] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.821513  3135 raft_consensus.cc:2749] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.820122  3136 raft_consensus.cc:359] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.822391  3136 raft_consensus.cc:385] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.822803  3136 raft_consensus.cc:740] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.820163  3139 raft_consensus.cc:359] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.824333  3139 raft_consensus.cc:385] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.823976  3136 consensus_queue.cc:260] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.824731  3139 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.826591  3139 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.829509  3119 heartbeater.cc:499] Master 127.25.139.190:41549 was elected leader, sending a full tablet report...
I20260709 13:13:16.830449  3136 ts_tablet_manager.cc:1434] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.010s
I20260709 13:13:16.832674  3136 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:16.837143  3139 ts_tablet_manager.cc:1434] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.010s
I20260709 13:13:16.838476  3045 heartbeater.cc:499] Master 127.25.139.190:41549 was elected leader, sending a full tablet report...
I20260709 13:13:16.841336  3133 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.842020  3133 ts_tablet_manager.cc:1403] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.008s
I20260709 13:13:16.842428  3136 tablet_bootstrap.cc:654] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.847306  3139 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:16.852981  3135 raft_consensus.cc:493] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.853669  3135 raft_consensus.cc:515] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.854010  3133 raft_consensus.cc:359] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.854969  3133 raft_consensus.cc:385] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.855540  3133 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.856702  3135 leader_election.cc:290] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:16.856448  3133 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.859999  3133 ts_tablet_manager.cc:1434] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:13:16.861377  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:16.862874  3133 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.858808  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
W20260709 13:13:16.867604  2911 leader_election.cc:343] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:16.868388  2911 leader_election.cc:343] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.868824  2911 leader_election.cc:304] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:16.869611  3135 raft_consensus.cc:2749] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.871943  3139 tablet_bootstrap.cc:654] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.874549  3136 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:16.875231  3136 ts_tablet_manager.cc:1403] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.006s
I20260709 13:13:16.879284  3136 raft_consensus.cc:359] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.880760  3136 raft_consensus.cc:385] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.879933  3133 tablet_bootstrap.cc:654] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.881174  3136 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.882347  3136 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.885275  3136 ts_tablet_manager.cc:1434] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:16.886650  3136 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:16.887871  3139 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:16.888509  3139 ts_tablet_manager.cc:1403] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.007s
I20260709 13:13:16.891911  3139 raft_consensus.cc:359] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.893430  3139 raft_consensus.cc:385] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.893752  3139 raft_consensus.cc:740] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.895130  3133 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.895780  3133 ts_tablet_manager.cc:1403] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 13:13:16.896811  3136 tablet_bootstrap.cc:654] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.894729  3139 consensus_queue.cc:260] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.898761  3139 ts_tablet_manager.cc:1434] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:16.900017  3139 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:16.902776  3136 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:16.902420  3133 raft_consensus.cc:359] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.903261  3133 raft_consensus.cc:385] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.903398  3136 ts_tablet_manager.cc:1403] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:13:16.903653  3133 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.904767  3133 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.907387  3133 ts_tablet_manager.cc:1434] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:13:16.908841  3133 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.909137  3136 raft_consensus.cc:359] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.910068  3136 raft_consensus.cc:385] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.910403  3136 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.911351  3136 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.912426  3139 tablet_bootstrap.cc:654] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.914295  3136 ts_tablet_manager.cc:1434] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:16.916218  3136 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:16.918030  3133 tablet_bootstrap.cc:654] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.924340  3136 tablet_bootstrap.cc:654] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.925338  3139 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:16.926092  3139 ts_tablet_manager.cc:1403] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.008s
W20260709 13:13:16.927067  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:16.929860  3139 raft_consensus.cc:359] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.930810  3139 raft_consensus.cc:385] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.931135  3139 raft_consensus.cc:740] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.932336  3139 consensus_queue.cc:260] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.933393  3133 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.933925  3133 ts_tablet_manager.cc:1403] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.009s
I20260709 13:13:16.937587  3139 ts_tablet_manager.cc:1434] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:13:16.937227  3133 raft_consensus.cc:359] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.938109  3133 raft_consensus.cc:385] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.938446  3133 raft_consensus.cc:740] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.938851  3139 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:16.939514  3133 consensus_queue.cc:260] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.942215  3133 ts_tablet_manager.cc:1434] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:13:16.943634  3133 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:16.946729  3139 tablet_bootstrap.cc:654] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.949893  3135 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.950526  3135 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.952881  3133 tablet_bootstrap.cc:654] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.953091  3135 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:16.954211  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:16.955125  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
W20260709 13:13:16.956214  2911 leader_election.cc:343] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:16.957058  2911 leader_election.cc:343] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:16.957574  2911 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:16.958364  3135 raft_consensus.cc:2749] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:16.955853  3136 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:16.961007  3139 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:16.961603  3139 ts_tablet_manager.cc:1403] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:13:16.964910  3136 ts_tablet_manager.cc:1403] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.019s
I20260709 13:13:16.965204  3139 raft_consensus.cc:359] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.966058  3139 raft_consensus.cc:385] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.966394  3139 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.967317  3139 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.968387  3136 raft_consensus.cc:359] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.969249  3136 raft_consensus.cc:385] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.969559  3136 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.969965  3139 ts_tablet_manager.cc:1434] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:16.971347  3139 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:16.971221  3136 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:16.973846  3136 ts_tablet_manager.cc:1434] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:16.975114  3136 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:16.980365  3139 tablet_bootstrap.cc:654] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.980574  3133 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:16.981163  3133 ts_tablet_manager.cc:1403] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.010s
I20260709 13:13:16.982179  3136 tablet_bootstrap.cc:654] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:16.984704  3133 raft_consensus.cc:359] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:16.985756  3133 raft_consensus.cc:385] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:16.986213  3133 raft_consensus.cc:740] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:16.987551  3133 consensus_queue.cc:260] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:16.994931  3135 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:16.995682  3135 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.000219  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
W20260709 13:13:17.001961  2911 leader_election.cc:343] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.002406  3139 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.002959  3133 ts_tablet_manager.cc:1434] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.006s
I20260709 13:13:17.003027  3139 ts_tablet_manager.cc:1403] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 13:13:17.003469  3136 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.003836  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.004048  3136 ts_tablet_manager.cc:1403] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.010s
I20260709 13:13:17.004562  3094 raft_consensus.cc:2468] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.006539  2911 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:17.007040  3139 raft_consensus.cc:359] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.007930  3133 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:17.008055  3139 raft_consensus.cc:385] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.008613  3138 raft_consensus.cc:2804] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.008656  3139 raft_consensus.cc:740] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.009295  3138 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.009693  3138 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.009909  3139 consensus_queue.cc:260] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.001999  3135 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.008039  3136 raft_consensus.cc:359] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.013705  3136 raft_consensus.cc:385] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.014036  3136 raft_consensus.cc:740] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.015118  3136 consensus_queue.cc:260] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.016268  3139 ts_tablet_manager.cc:1434] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:13:17.017158  3133 tablet_bootstrap.cc:654] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.017758  3139 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:17.024428  3136 ts_tablet_manager.cc:1434] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:13:17.028529  3139 tablet_bootstrap.cc:654] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.032532  3136 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:17.033550  3138 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.036631  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
W20260709 13:13:17.038209  2911 leader_election.cc:343] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.040356  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.040931  3094 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.042716  3136 tablet_bootstrap.cc:654] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.043494  3138 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Requested vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.047145  3139 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.047895  3139 ts_tablet_manager.cc:1403] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.007s
I20260709 13:13:17.049513  3133 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:17.050092  3133 ts_tablet_manager.cc:1403] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.015s
I20260709 13:13:17.051677  3094 raft_consensus.cc:2468] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 1.
I20260709 13:13:17.051887  3136 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.051376  3139 raft_consensus.cc:359] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.052397  3139 raft_consensus.cc:385] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.052542  3136 ts_tablet_manager.cc:1403] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 13:13:17.052767  3139 raft_consensus.cc:740] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.053092  2911 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:17.053536  3133 raft_consensus.cc:359] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.053915  3139 consensus_queue.cc:260] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.054371  3138 raft_consensus.cc:2804] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.054427  3133 raft_consensus.cc:385] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.055044  3133 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.055838  3138 raft_consensus.cc:697] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Becoming Leader. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Running, Role: LEADER
I20260709 13:13:17.056034  3133 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.056455  3136 raft_consensus.cc:359] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.056818  3138 consensus_queue.cc:237] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.057339  3136 raft_consensus.cc:385] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.057770  3136 raft_consensus.cc:740] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.058588  3136 consensus_queue.cc:260] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.059031  3133 ts_tablet_manager.cc:1434] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:17.059880  3139 ts_tablet_manager.cc:1434] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:17.060647  3133 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:17.061161  3139 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:17.061204  3136 ts_tablet_manager.cc:1434] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:17.068084  3136 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:17.069012  3133 tablet_bootstrap.cc:654] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.076225  3136 tablet_bootstrap.cc:654] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.078830  3139 tablet_bootstrap.cc:654] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.087898  3133 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:17.088361  3136 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.088527  3133 ts_tablet_manager.cc:1403] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:13:17.088915  3136 ts_tablet_manager.cc:1403] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 13:13:17.087436  2840 catalog_manager.cc:5697] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f5d71a6a22714023ac594f0c82a9a324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.092037  3133 raft_consensus.cc:359] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.092940  3133 raft_consensus.cc:385] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.093300  3133 raft_consensus.cc:740] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.094333  3133 consensus_queue.cc:260] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.095531  3136 raft_consensus.cc:359] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.096383  3136 raft_consensus.cc:385] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.096704  3136 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.097457  3133 ts_tablet_manager.cc:1434] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:13:17.097596  3136 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.099105  3133 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:17.100792  3139 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.101289  3136 ts_tablet_manager.cc:1434] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:17.102617  3136 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:17.101338  3139 ts_tablet_manager.cc:1403] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.009s
I20260709 13:13:17.107633  3133 tablet_bootstrap.cc:654] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.108328  3139 raft_consensus.cc:359] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.111521  3139 raft_consensus.cc:385] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.111855  3139 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.112679  3139 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.110610  3136 tablet_bootstrap.cc:654] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.117110  3133 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:17.117714  3133 ts_tablet_manager.cc:1403] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:13:17.120853  3139 ts_tablet_manager.cc:1434] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:13:17.120966  3133 raft_consensus.cc:359] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.121994  3133 raft_consensus.cc:385] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.122483  3133 raft_consensus.cc:740] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.123473  3133 consensus_queue.cc:260] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.122117  3139 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:17.132206  3133 ts_tablet_manager.cc:1434] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:13:17.133615  3133 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:17.140033  3139 tablet_bootstrap.cc:654] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.140100  3133 tablet_bootstrap.cc:654] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.142011  3136 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.142622  3136 ts_tablet_manager.cc:1403] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.014s
I20260709 13:13:17.145023  3139 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.145481  3139 ts_tablet_manager.cc:1403] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.007s
I20260709 13:13:17.145498  3136 raft_consensus.cc:359] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.146220  3136 raft_consensus.cc:385] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.146441  3136 raft_consensus.cc:740] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.147086  3136 consensus_queue.cc:260] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.147975  3139 raft_consensus.cc:359] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.148661  3139 raft_consensus.cc:385] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.148921  3139 raft_consensus.cc:740] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.149161  3136 ts_tablet_manager.cc:1434] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:17.149529  3133 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: No bootstrap required, opened a new log
I20260709 13:13:17.150111  3133 ts_tablet_manager.cc:1403] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:13:17.149755  3139 consensus_queue.cc:260] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.150331  3136 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:17.153331  3133 raft_consensus.cc:359] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.154158  3133 raft_consensus.cc:385] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.154537  3133 raft_consensus.cc:740] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.155465  3133 consensus_queue.cc:260] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.157291  3147 raft_consensus.cc:493] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.157513  3136 tablet_bootstrap.cc:654] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.157848  3147 raft_consensus.cc:515] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.158397  3133 ts_tablet_manager.cc:1434] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:17.173175  3138 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.173785  3138 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.175877  3138 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.177413  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.177975  3094 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.176852  3147 leader_election.cc:290] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.178877  3147 raft_consensus.cc:493] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.179109  2911 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.179340  3147 raft_consensus.cc:515] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.181145  3147 leader_election.cc:290] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.181607  3138 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.181968  3138 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.182260  3138 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.192102  3138 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.194917  3139 ts_tablet_manager.cc:1434] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:13:17.196163  3139 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:17.198249  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.198907  3094 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.201495  3145 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.202025  3145 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.203148  3147 raft_consensus.cc:493] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.203743  3147 raft_consensus.cc:515] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.206182  3145 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.206350  3147 leader_election.cc:290] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.214596  3094 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 1.
I20260709 13:13:17.215464  3138 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Requested vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.217111  3145 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.218458  3145 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.221240  3145 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.229357  2911 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.230404  3138 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.230950  3138 raft_consensus.cc:697] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Becoming Leader. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Running, Role: LEADER
I20260709 13:13:17.231856  3138 consensus_queue.cc:237] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.243106  3147 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.243999  3147 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.247473  3147 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.248296  3147 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.248955  3147 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.252081  3139 tablet_bootstrap.cc:654] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.252964  3020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.262133  2843 catalog_manager.cc:5697] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f5d71a6a22714023ac594f0c82a9a324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.263447  3020 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.253111  3147 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.254431  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.264703  3019 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.259686  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.267460  3018 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 0.
I20260709 13:13:17.261168  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.268715  3060 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:17.269744  3145 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.270147  3145 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.270519  3145 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.275375  3147 raft_consensus.cc:493] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.275925  3147 raft_consensus.cc:515] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.278216  3147 leader_election.cc:290] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.278893  3019 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 1.
I20260709 13:13:17.285602  3136 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.286375  3136 ts_tablet_manager.cc:1403] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.136s	user 0.047s	sys 0.073s
W20260709 13:13:17.288494  3060 leader_election.cc:343] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.290414  3136 raft_consensus.cc:359] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.291407  3136 raft_consensus.cc:385] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.291128  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.291754  3136 raft_consensus.cc:740] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.292122  3094 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.292657  3136 consensus_queue.cc:260] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.299186  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.300236  3094 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.306205  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.309229  3094 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.309598  3138 raft_consensus.cc:493] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.310107  3138 raft_consensus.cc:515] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.310149  2945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.311039  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.311208  2945 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 0.
I20260709 13:13:17.311837  3094 raft_consensus.cc:2393] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15a3ed5662c34686bf40ba3c3579d869 in current term 1: Already voted for candidate f5d71a6a22714023ac594f0c82a9a324 in this term.
I20260709 13:13:17.312278  3138 leader_election.cc:290] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.313215  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.314237  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.314592  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.314877  3019 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.315898  3138 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.314222  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.317402  3093 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.316296  3092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.317813  3145 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.318518  3092 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.319012  3136 ts_tablet_manager.cc:1434] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.032s	user 0.013s	sys 0.020s
I20260709 13:13:17.314222  2944 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 0.
I20260709 13:13:17.320091  3136 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: Bootstrap starting.
I20260709 13:13:17.316267  2911 leader_election.cc:304] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.316654  3138 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.321496  3135 raft_consensus.cc:2804] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.320842  3059 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:17.321951  3145 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.322583  3145 raft_consensus.cc:2804] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.321986  3135 raft_consensus.cc:493] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.323010  3145 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.323294  3135 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.323443  3145 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.324415  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.325062  3019 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 0.
I20260709 13:13:17.326573  2911 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.327806  3136 tablet_bootstrap.cc:654] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.328011  3138 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.330426  3138 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.321173  3094 raft_consensus.cc:2393] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15a3ed5662c34686bf40ba3c3579d869 in current term 1: Already voted for candidate 55a4dc153bf64de39e1c07251ef93c6b in this term.
I20260709 13:13:17.321182  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.331830  3138 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.332647  2945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.338318  2945 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.333212  2943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.339459  2943 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.334321  2942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.335397  2941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.336442  2940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.337481  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.342036  2939 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.342062  3145 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.343490  3138 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.344327  3147 raft_consensus.cc:493] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.345095  3147 raft_consensus.cc:515] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.346019  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.346689  2939 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.348780  3147 leader_election.cc:290] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.351452  3139 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.352029  3139 ts_tablet_manager.cc:1403] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.012s
I20260709 13:13:17.320861  2986 leader_election.cc:304] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:17.358346  3145 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.357297  2939 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 1.
I20260709 13:13:17.360432  3059 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.361528  3145 raft_consensus.cc:2804] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.362051  3145 raft_consensus.cc:697] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:17.363026  3145 consensus_queue.cc:237] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.363934  3138 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.355012  3139 raft_consensus.cc:359] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.367857  3139 raft_consensus.cc:385] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.368203  3139 raft_consensus.cc:740] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.368798  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aab83954ef142daac361e96c946080d" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.369108  2985 leader_election.cc:304] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.369800  2939 raft_consensus.cc:2468] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 0.
I20260709 13:13:17.370592  3139 consensus_queue.cc:260] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.371668  2944 raft_consensus.cc:2393] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 55a4dc153bf64de39e1c07251ef93c6b in current term 1: Already voted for candidate f5d71a6a22714023ac594f0c82a9a324 in this term.
I20260709 13:13:17.373201  3174 raft_consensus.cc:2804] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.373737  3174 raft_consensus.cc:493] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.374073  3174 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.375051  2985 leader_election.cc:304] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.375984  3147 raft_consensus.cc:2804] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.376513  3147 raft_consensus.cc:493] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.376996  3147 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.379643  2985 leader_election.cc:304] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.381306  2843 catalog_manager.cc:5697] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 1 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.385694  3183 raft_consensus.cc:493] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.386775  3183 raft_consensus.cc:515] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.387570  3174 raft_consensus.cc:515] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.389873  3174 leader_election.cc:290] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.390451  3174 raft_consensus.cc:2804] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.390534  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.390846  3174 raft_consensus.cc:493] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.391067  3139 ts_tablet_manager.cc:1434] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:13:17.391309  3174 raft_consensus.cc:3060] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:17.391961  2986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:33859, user_credentials={real_user=slave}} blocked reactor thread for 71343.4us
I20260709 13:13:17.392608  3139 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: Bootstrap starting.
I20260709 13:13:17.393476  2986 leader_election.cc:304] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:17.391366  2944 raft_consensus.cc:2468] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 0.
I20260709 13:13:17.395977  3059 leader_election.cc:304] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.397207  3138 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Requested vote from peers 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.397439  3145 raft_consensus.cc:2804] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.398629  3145 raft_consensus.cc:493] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.399096  3145 raft_consensus.cc:3060] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:17.400249  2911 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.130:38703, user_credentials={real_user=slave}} blocked reactor thread for 73752.2us
I20260709 13:13:17.406307  3174 raft_consensus.cc:515] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.407936  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.408605  2944 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.408682  3174 leader_election.cc:290] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.410794  3174 raft_consensus.cc:2804] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.410998  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.411381  3174 raft_consensus.cc:493] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.411973  3174 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.412457  2986 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869; no voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:17.414412  2986 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869; no voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:17.398658  3135 raft_consensus.cc:515] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.416021  2942 raft_consensus.cc:2393] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15a3ed5662c34686bf40ba3c3579d869 in current term 1: Already voted for candidate f5d71a6a22714023ac594f0c82a9a324 in this term.
I20260709 13:13:17.416513  3139 tablet_bootstrap.cc:654] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:17.417567  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aab83954ef142daac361e96c946080d" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.418195  2939 raft_consensus.cc:3060] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.418889  3135 leader_election.cc:290] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Requested vote from peers 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.406225  3188 raft_consensus.cc:2804] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:17.412014  3094 raft_consensus.cc:2393] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d71a6a22714023ac594f0c82a9a324 in current term 1: Already voted for candidate 55a4dc153bf64de39e1c07251ef93c6b in this term.
I20260709 13:13:17.424332  3183 leader_election.cc:290] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.420718  3187 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.427299  3188 raft_consensus.cc:493] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:17.430167  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.431214  3189 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.432238  3188 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.431099  2939 raft_consensus.cc:2468] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.437480  3145 raft_consensus.cc:515] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.433790  3136 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: No bootstrap required, opened a new log
I20260709 13:13:17.438694  3136 ts_tablet_manager.cc:1403] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: Time spent bootstrapping tablet: real 0.119s	user 0.053s	sys 0.041s
I20260709 13:13:17.442442  3174 raft_consensus.cc:515] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.443130  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.444056  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.445855  3174 leader_election.cc:290] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.446851  3092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.447350  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aab83954ef142daac361e96c946080d" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.447646  3092 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.448098  3189 raft_consensus.cc:2749] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.448930  3060 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b; no voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:17.449678  3183 raft_consensus.cc:2749] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:17.450618  3060 leader_election.cc:343] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.450948  3091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.455549  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aab83954ef142daac361e96c946080d" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.458650  3017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.464428  3147 raft_consensus.cc:515] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.464833  3017 raft_consensus.cc:2393] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d71a6a22714023ac594f0c82a9a324 in current term 1: Already voted for candidate 15a3ed5662c34686bf40ba3c3579d869 in this term.
I20260709 13:13:17.467971  3145 leader_election.cc:290] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:17.469892  3147 leader_election.cc:290] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.471686  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.472648  2939 raft_consensus.cc:3060] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.475505  3091 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.479480  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
I20260709 13:13:17.480297  3018 raft_consensus.cc:2468] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 0.
I20260709 13:13:17.484823  2939 raft_consensus.cc:2468] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 1.
I20260709 13:13:17.486554  3187 raft_consensus.cc:2749] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.486865  3092 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.487555  3059 leader_election.cc:304] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.494736  2985 leader_election.cc:304] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:17.498185  2944 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.498277  3188 raft_consensus.cc:515] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.488906  3145 raft_consensus.cc:2804] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.504812  3092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.505842  3092 raft_consensus.cc:2393] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d71a6a22714023ac594f0c82a9a324 in current term 1: Already voted for candidate 55a4dc153bf64de39e1c07251ef93c6b in this term.
I20260709 13:13:17.506974  3136 raft_consensus.cc:359] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.507817  3136 raft_consensus.cc:385] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.508111  3136 raft_consensus.cc:740] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.508819  3136 consensus_queue.cc:260] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.510267  3019 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d71a6a22714023ac594f0c82a9a324 in term 1.
I20260709 13:13:17.510773  3093 raft_consensus.cc:3060] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.510833  3136 ts_tablet_manager.cc:1434] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.000s
I20260709 13:13:17.512378  2986 leader_election.cc:304] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
W20260709 13:13:17.513321  2986 leader_election.cc:343] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:17.513607  3094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.513862  3092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "f5d71a6a22714023ac594f0c82a9a324" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.514302  3094 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.514397  3018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c4c3a1c1e54d2b82f027b79c4d740d" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:17.515081  3018 raft_consensus.cc:3060] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.515451  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.516245  2939 raft_consensus.cc:2393] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 15a3ed5662c34686bf40ba3c3579d869 in current term 1: Already voted for candidate f5d71a6a22714023ac594f0c82a9a324 in this term.
I20260709 13:13:17.518383  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.522236  3094 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.523413  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:17.524165  2944 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.525331  3139 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: No bootstrap required, opened a new log
I20260709 13:13:17.525897  3139 ts_tablet_manager.cc:1403] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: Time spent bootstrapping tablet: real 0.134s	user 0.035s	sys 0.025s
I20260709 13:13:17.527002  2986 leader_election.cc:304] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:17.527745  2939 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.527930  3018 raft_consensus.cc:2468] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 1.
I20260709 13:13:17.528389  2911 leader_election.cc:304] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d71a6a22714023ac594f0c82a9a324; no voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:17.528995  3188 leader_election.cc:290] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.529312  3139 raft_consensus.cc:359] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.503846  3145 raft_consensus.cc:697] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:17.503691  3187 raft_consensus.cc:2804] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.530180  3135 raft_consensus.cc:2749] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.530651  3187 raft_consensus.cc:697] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:17.530952  3145 consensus_queue.cc:237] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.522311  3093 raft_consensus.cc:2468] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.531533  3187 consensus_queue.cc:237] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.527969  3189 raft_consensus.cc:2804] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.532866  3135 consensus_queue.cc:1048] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.533972  3189 raft_consensus.cc:697] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:17.521755  3091 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.534916  3189 consensus_queue.cc:237] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.535152  2911 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:17.530140  3139 raft_consensus.cc:385] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:17.538693  3139 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Initialized, Role: FOLLOWER
I20260709 13:13:17.539712  2986 leader_election.cc:304] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:17.539713  3139 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.546552  3188 raft_consensus.cc:2804] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.546741  2939 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.547314  3188 raft_consensus.cc:697] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:17.548574  3188 consensus_queue.cc:237] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:17.522789  3147 raft_consensus.cc:2804] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.554376  3147 raft_consensus.cc:697] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:17.542572  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:17.543375  3135 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.556326  3093 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.556340  3135 raft_consensus.cc:697] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Becoming Leader. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Running, Role: LEADER
I20260709 13:13:17.558497  3135 consensus_queue.cc:237] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.566314  3093 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.565883  2843 catalog_manager.cc:5697] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.568236  2840 catalog_manager.cc:5697] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 1 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.543951  2944 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:17.557487  3139 ts_tablet_manager.cc:1434] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.004s
I20260709 13:13:17.570111  2843 catalog_manager.cc:5697] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.555111  3147 consensus_queue.cc:237] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.571635  3138 consensus_queue.cc:1048] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.574797  2841 catalog_manager.cc:5697] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "f5d71a6a22714023ac594f0c82a9a324" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.570116  2986 leader_election.cc:304] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:17.605227  3188 raft_consensus.cc:2804] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:17.605981  3188 raft_consensus.cc:697] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:17.607102  3188 consensus_queue.cc:237] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
W20260709 13:13:17.619021  2986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.139.131:33859, user_credentials={real_user=slave}} blocked reactor thread for 49019us
I20260709 13:13:17.638080  2842 catalog_manager.cc:5697] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.639657  2842 catalog_manager.cc:5697] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.640902  2842 catalog_manager.cc:5697] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.663334  3138 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.675086  3138 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.700562  3188 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:17.701005  3188 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:17.702775  3188 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:17.703583  2944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d71a6a22714023ac594f0c82a9a324" is_pre_election: true
I20260709 13:13:17.703809  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:17.704347  2944 raft_consensus.cc:2393] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15a3ed5662c34686bf40ba3c3579d869 in current term 1: Already voted for candidate 55a4dc153bf64de39e1c07251ef93c6b in this term.
I20260709 13:13:17.705314  2985 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869; no voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:17.705986  3188 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:17.710958  3188 raft_consensus.cc:2749] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:17.785169  3145 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.796015  3207 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:17.878026 26158 ts_manager.cc:295] Set tserver state for f5d71a6a22714023ac594f0c82a9a324 to MAINTENANCE_MODE
I20260709 13:13:17.878908 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
I20260709 13:13:17.903278 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:17.904083 26158 tablet_replica.cc:333] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.904708 26158 raft_consensus.cc:2243] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.905174 26158 raft_consensus.cc:2272] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.907095 26158 tablet_replica.cc:333] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.907702 26158 raft_consensus.cc:2243] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.908303 26158 pending_rounds.cc:70] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Trying to abort 1 pending ops.
I20260709 13:13:17.908500 26158 pending_rounds.cc:77] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637058810757120 op_type: NO_OP noop_request { }
I20260709 13:13:17.908838 26158 raft_consensus.cc:2889] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:17.909148 26158 raft_consensus.cc:2272] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.911594 26158 tablet_replica.cc:333] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.912317 26158 raft_consensus.cc:2243] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.912698 26158 raft_consensus.cc:2272] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.914254 26158 tablet_replica.cc:333] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.914870 26158 raft_consensus.cc:2243] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.915313 26158 raft_consensus.cc:2272] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.916941 26158 tablet_replica.cc:333] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.917459 26158 raft_consensus.cc:2243] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.918219 26158 raft_consensus.cc:2272] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.920246 26158 tablet_replica.cc:333] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.920779 26158 raft_consensus.cc:2243] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.921185 26158 raft_consensus.cc:2272] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.923448 26158 tablet_replica.cc:333] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.923957 26158 raft_consensus.cc:2243] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:17.924705 26158 raft_consensus.cc:2272] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.926959 26158 tablet_replica.cc:333] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.927524 26158 raft_consensus.cc:2243] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.928035 26158 raft_consensus.cc:2272] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:17.928269  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:17.930164 26158 tablet_replica.cc:333] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.930804 26158 raft_consensus.cc:2243] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.931213 26158 raft_consensus.cc:2272] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.932849 26158 tablet_replica.cc:333] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: stopping tablet replica
I20260709 13:13:17.933337 26158 raft_consensus.cc:2243] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:17.933717 26158 raft_consensus.cc:2272] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:17.938616  3207 consensus_queue.cc:1048] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:13:17.952504  2910 connection.cc:466] server connection from 127.0.0.1:50956 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50956 (request call id 10) could send its response
W20260709 13:13:17.953857  3059 consensus_peers.cc:597] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: recv got EOF from 127.25.139.129:36469 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:17.961542 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
W20260709 13:13:17.974731  2985 consensus_peers.cc:597] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.006623  2985 consensus_peers.cc:597] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.009244  2985 consensus_peers.cc:597] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.023195  2985 consensus_peers.cc:597] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.066193  3147 consensus_queue.cc:1048] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.066916  3188 consensus_queue.cc:1048] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.099740  3147 consensus_queue.cc:1048] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:18.170389  3147 consensus_queue.cc:1048] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:18.175328  3059 consensus_peers.cc:597] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:18.190932  2985 consensus_peers.cc:597] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:18.218463  3215 consensus_queue.cc:1048] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:18.929263  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:19.073179  3207 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.073825  3207 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.075680  3207 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:19.077018  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
W20260709 13:13:19.086356  3059 leader_election.cc:336] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.086696  3059 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b; no voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:19.087373  3207 raft_consensus.cc:2749] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.087568  3147 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.088186  3147 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.089880  3147 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.090982  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:19.091681  3093 raft_consensus.cc:2468] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:19.092708  2986 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:19.093442  3215 raft_consensus.cc:2804] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:19.093791  3215 raft_consensus.cc:493] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.094090  3215 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.099699  3215 raft_consensus.cc:515] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
W20260709 13:13:19.100965  2985 leader_election.cc:336] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.101341  3215 leader_election.cc:290] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.102411  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21f26a0a958e44899b50f88fd2414ae0" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:19.102897  3093 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:19.105474  2985 leader_election.cc:336] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.108453  3093 raft_consensus.cc:2468] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 2.
I20260709 13:13:19.109467  2986 leader_election.cc:304] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:19.110209  3215 raft_consensus.cc:2804] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.110661  3215 raft_consensus.cc:697] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:19.111434  3215 consensus_queue.cc:237] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.118422  2843 catalog_manager.cc:5697] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 1 to 2, leader changed from f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.173298  3207 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.173827  3207 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.175925  3207 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:19.177047  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "15a3ed5662c34686bf40ba3c3579d869" is_pre_election: true
W20260709 13:13:19.177526  2985 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111) [suppressed 130 similar messages]
I20260709 13:13:19.178390  3215 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.178906  3215 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
W20260709 13:13:19.180665  3059 leader_election.cc:336] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.181077  3215 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.181178  3059 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b; no voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:19.182183  3207 raft_consensus.cc:2749] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:19.182289  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:19.183100  3093 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:19.184450  2986 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
I20260709 13:13:19.185499  3215 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:19.185868  3215 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5d71a6a22714023ac594f0c82a9a324)
I20260709 13:13:19.186234  3215 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:19.186372  2985 leader_election.cc:336] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.191893  3215 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.193508  3215 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.194520  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:19.195243  3093 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:19.197330  2985 leader_election.cc:336] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.197623  3215 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:19.198110  3215 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.199911  3215 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.201016  3091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b" is_pre_election: true
I20260709 13:13:19.201450  3093 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 2.
I20260709 13:13:19.201638  3091 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 1.
I20260709 13:13:19.202558  2986 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:19.203291  3215 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.203750  3215 raft_consensus.cc:697] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:19.203708  2986 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: 
W20260709 13:13:19.204507  2985 leader_election.cc:336] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.204674  3147 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:19.205112  3147 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:19.204834  3215 consensus_queue.cc:237] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.205432  3147 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.212448  2843 catalog_manager.cc:5697] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 1 to 2, leader changed from f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.214052  3147 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.216144  3147 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:19.217314  3091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:19.217959  3091 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:19.220378  2985 leader_election.cc:336] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111)
I20260709 13:13:19.223903  3091 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 2.
I20260709 13:13:19.224843  2986 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, 55a4dc153bf64de39e1c07251ef93c6b; no voters: f5d71a6a22714023ac594f0c82a9a324
I20260709 13:13:19.225492  3147 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.225981  3147 raft_consensus.cc:697] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:19.226999  3147 consensus_queue.cc:237] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:19.233980  2843 catalog_manager.cc:5697] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 1 to 2, leader changed from f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.598604  3091 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.599858  3147 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:19.613296  2985 consensus_peers.cc:597] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:19.652650  2985 consensus_peers.cc:597] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.739249  3091 raft_consensus.cc:1275] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.740703  3147 consensus_queue.cc:1048] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:19.841950  2985 consensus_peers.cc:597] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:19.848160  3091 raft_consensus.cc:1275] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:19.849597  3235 consensus_queue.cc:1048] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:19.930277  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:20.321234  2985 consensus_peers.cc:597] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.321954  3059 consensus_peers.cc:597] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.438042  2985 consensus_peers.cc:597] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.488933  2985 consensus_peers.cc:597] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.528683  3059 consensus_peers.cc:597] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.863739  2985 consensus_peers.cc:597] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:20.931368  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:20.953254  2985 consensus_peers.cc:597] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:21.932435  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:22.000991  2985 consensus_peers.cc:597] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.234174  2985 consensus_peers.cc:597] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.337144  2985 consensus_peers.cc:597] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:22.749087  2985 consensus_peers.cc:597] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.872010  3059 consensus_peers.cc:597] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.909453  2985 consensus_peers.cc:597] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:22.933421  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:22.946550  3059 consensus_peers.cc:597] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:22.981593 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:22.988518  3241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:22.988714  3242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:22.992054  3244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:22.992260 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:22.994407 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:22.994601 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:22.994745 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602802994732 us; error 0 us; skew 500 ppm
I20260709 13:13:22.995267 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:22.997936 26158 webserver.cc:533] Webserver started at http://127.25.139.129:34287/ using document root <none> and password file <none>
I20260709 13:13:22.998540 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:22.998730 26158 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:23.007335 26158 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:23.011258  3250 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.012213 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:13:23.012665 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "f5d71a6a22714023ac594f0c82a9a324"
format_stamp: "Formatted at 2026-07-09 13:13:16 on dist-test-slave-v5z2"
I20260709 13:13:23.013101 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:23.035452 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:23.036712 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:23.038260 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:23.042786  3257 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:23.086104  2985 consensus_peers.cc:597] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:23.091266 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:23.091636 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:13:23.091971 26158 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:23.096374  3257 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.107303  3257 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.107966  3257 tablet_bootstrap.cc:492] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.108505  3257 ts_tablet_manager.cc:1403] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:13:23.110690  3257 raft_consensus.cc:359] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.111527  3257 raft_consensus.cc:740] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.112152  3257 consensus_queue.cc:260] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.114306  3257 ts_tablet_manager.cc:1434] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:23.115101  3257 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.126726  3257 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.127544  3257 tablet_bootstrap.cc:492] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.128132  3257 ts_tablet_manager.cc:1403] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.013s	user 0.002s	sys 0.009s
I20260709 13:13:23.130165  3257 raft_consensus.cc:359] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.130484 26158 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:23.130731  3257 raft_consensus.cc:740] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.130893 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.036s	sys 0.000s
I20260709 13:13:23.131548  3257 consensus_queue.cc:260] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.133844  3257 ts_tablet_manager.cc:1434] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.002s
I20260709 13:13:23.134683  3257 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.148592  3257 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.149336  3257 tablet_bootstrap.cc:492] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.149920  3257 ts_tablet_manager.cc:1403] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:23.152122  3257 raft_consensus.cc:359] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.152697  3257 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.153352  3257 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.155150  3257 ts_tablet_manager.cc:1434] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:13:23.155867  3257 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.168223  3257 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.168994  3257 tablet_bootstrap.cc:492] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.169562  3257 ts_tablet_manager.cc:1403] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:13:23.171474  3257 raft_consensus.cc:359] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.171991  3257 raft_consensus.cc:740] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.172606  3257 consensus_queue.cc:260] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.174096  3257 ts_tablet_manager.cc:1434] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:13:23.174708  3257 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.185988  3257 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.187019  3257 tablet_bootstrap.cc:492] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.187606  3257 ts_tablet_manager.cc:1403] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:13:23.189630  3257 raft_consensus.cc:359] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.190150  3257 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.190814  3257 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.192694  3257 ts_tablet_manager.cc:1434] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:23.193143 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:36469
I20260709 13:13:23.193298  3319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:36469 every 8 connection(s)
I20260709 13:13:23.193333  3257 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.197999 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:23.214103  3257 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.216653  3257 tablet_bootstrap.cc:492] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.217401  3257 ts_tablet_manager.cc:1403] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 13:13:23.219362  3257 raft_consensus.cc:359] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:23.220085  3257 raft_consensus.cc:740] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.220866  3257 consensus_queue.cc:260] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:23.223076  3257 ts_tablet_manager.cc:1434] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:23.223937  3257 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.233294  3320 heartbeater.cc:344] Connected to a master server at 127.25.139.190:41549
I20260709 13:13:23.233809  3320 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:23.234800  3320 heartbeater.cc:507] Master 127.25.139.190:41549 requested a full tablet report, sending...
I20260709 13:13:23.240303  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:23.241051  3019 raft_consensus.cc:606] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:23.241269  2843 ts_manager.cc:194] Re-registered known tserver with Master: f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469)
I20260709 13:13:23.243727  3257 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:23.243937  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:23.244531  3019 raft_consensus.cc:606] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:23.244818  3257 tablet_bootstrap.cc:492] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.245570  3257 ts_tablet_manager.cc:1403] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 13:13:23.247929  3257 raft_consensus.cc:359] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.248648  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:23.248762  3257 raft_consensus.cc:740] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.249356  3019 raft_consensus.cc:606] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:23.249655  3257 consensus_queue.cc:260] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.251582  3257 ts_tablet_manager.cc:1434] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:23.252424  3257 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.252777  2843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47166
I20260709 13:13:23.252882  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:23.253589  3019 raft_consensus.cc:606] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:23.254884 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:13:23.255542 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:23.256254 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:23.257061  3320 heartbeater.cc:499] Master 127.25.139.190:41549 was elected leader, sending a full tablet report...
I20260709 13:13:23.277426  3257 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.278357  3257 tablet_bootstrap.cc:492] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.278949  3257 ts_tablet_manager.cc:1403] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 13:13:23.280982  3257 raft_consensus.cc:359] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.281560  3257 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.282199  3257 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.284157  3257 ts_tablet_manager.cc:1434] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:23.284960  3257 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.296578  3257 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.297245  3257 tablet_bootstrap.cc:492] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.297717  3257 ts_tablet_manager.cc:1403] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:13:23.299520  3257 raft_consensus.cc:359] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.299974  3257 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.300462  3257 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.301807  3257 ts_tablet_manager.cc:1434] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:23.302644  3257 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap starting.
I20260709 13:13:23.314531  3257 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:23.315371  3257 tablet_bootstrap.cc:492] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Bootstrap complete.
I20260709 13:13:23.315918  3257 ts_tablet_manager.cc:1403] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 13:13:23.317836  3257 raft_consensus.cc:359] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.318333  3257 raft_consensus.cc:740] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d71a6a22714023ac594f0c82a9a324, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.318856  3257 consensus_queue.cc:260] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.320204  3257 ts_tablet_manager.cc:1434] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:23.395709  3248 raft_consensus.cc:993] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.396180  3235 raft_consensus.cc:1081] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.397607  3091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:23.398065  3091 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.398334  3091 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.404143  3091 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.404850  3248 raft_consensus.cc:993] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.405370  3235 raft_consensus.cc:1081] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.406823  3091 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:23.407002  3294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:23.407085  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:23.407344  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:23.407760  3294 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.407860  3093 raft_consensus.cc:493] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.407922  3019 raft_consensus.cc:3055] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:23.408596  3093 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.408648  3019 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:23.409693  3019 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.410883  3019 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:23.415535  3294 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:23.417032  3059 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:23.418118  3233 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:23.418298  3093 raft_consensus.cc:515] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.419265  3019 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:23.422061  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:23.422206  3233 raft_consensus.cc:697] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:23.422788  3292 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.423367  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:23.423305  3233 consensus_queue.cc:237] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.424405  3019 raft_consensus.cc:3055] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:23.424932  3019 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:23.427430  3093 leader_election.cc:290] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:23.429625  3019 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.431557  3019 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.431998  3292 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.433429  3059 leader_election.cc:304] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:23.433408  2843 catalog_manager.cc:5697] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 2 to 3, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 3 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.434522  3233 raft_consensus.cc:2804] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.435026  3233 raft_consensus.cc:697] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:23.435868  3233 consensus_queue.cc:237] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.441689  3019 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.459371  2842 catalog_manager.cc:5697] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 1 to 2, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 2 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.513899  3248 raft_consensus.cc:993] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.514354  3235 raft_consensus.cc:1081] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.515842  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:23.516280  3093 raft_consensus.cc:493] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.516588  3093 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.523706  3093 raft_consensus.cc:515] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.526062  3093 leader_election.cc:290] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:23.526420  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:23.526729  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2a43c8e559a42c8a41e6d7e5985fb13" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:23.527230  3292 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.527344  3019 raft_consensus.cc:3055] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:23.527747  3019 raft_consensus.cc:740] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:23.528577  3019 consensus_queue.cc:260] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.529907  3019 raft_consensus.cc:3060] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.532657  3293 raft_consensus.cc:3060] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.534705  3292 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.536281  3059 leader_election.cc:304] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:23.537544  3019 raft_consensus.cc:2468] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.538448  3233 raft_consensus.cc:2804] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.539002  3233 raft_consensus.cc:697] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:23.539862  3233 consensus_queue.cc:237] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.549436  2842 catalog_manager.cc:5697] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 1 to 2, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 2 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.811583  3293 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.817374  3293 pending_rounds.cc:85] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Aborting all ops after (but not including) 0
I20260709 13:13:23.817708  3293 pending_rounds.cc:107] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:23.818012  3248 raft_consensus.cc:993] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.818050  3293 raft_consensus.cc:2889] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:23.818717  3235 raft_consensus.cc:1081] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:23.820272  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:23.821162  3093 raft_consensus.cc:493] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:23.821624  3093 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.828128  3093 raft_consensus.cc:515] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.829838  3093 leader_election.cc:290] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:23.830427  3293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:23.830793  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:23.831087  3293 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.831426  3019 raft_consensus.cc:3055] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:23.831748  3019 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:23.832566  3019 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.833794  3019 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:23.838256  3293 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.839555  3059 leader_election.cc:304] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:23.840281  3233 raft_consensus.cc:2804] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:23.840684  3019 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:23.840706  3233 raft_consensus.cc:697] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:23.841778  3233 consensus_queue.cc:237] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:23.848677  2843 catalog_manager.cc:5697] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 1 to 2, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 2 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:23.888760  3019 raft_consensus.cc:1275] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.889262  3018 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.890059  3335 consensus_queue.cc:1048] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:23.890828  3233 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:23.918387  3292 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:23.920408  3293 raft_consensus.cc:1275] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:23.922966  3335 consensus_queue.cc:1048] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:23.927275  3355 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 13:13:23.934928  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:24.016502  3018 raft_consensus.cc:1275] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.017982  3357 consensus_queue.cc:1048] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:24.026760  3292 raft_consensus.cc:1275] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.028548  3353 consensus_queue.cc:1048] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:24.267730 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.283882  3093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3003943086b2494090eb24c491ef7b27"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
mode: GRACEFUL
new_leader_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:13:24.284372  3093 raft_consensus.cc:606] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Received request to transfer leadership to TS 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:24.286861  3093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
mode: GRACEFUL
new_leader_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:13:24.287328  3093 raft_consensus.cc:606] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Received request to transfer leadership to TS 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:24.288393 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:24.289014 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:24.289722 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:24.347950  3357 raft_consensus.cc:993] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: : Instructing follower 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:24.348461  3357 raft_consensus.cc:1081] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Signalling peer 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:24.349987  3018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3003943086b2494090eb24c491ef7b27"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:13:24.350548  3018 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.350943  3018 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:24.359550  3018 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.361399  3018 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:24.362294  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:24.362747  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:24.362865  3292 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:24.363315  3093 raft_consensus.cc:3055] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:24.363601  3093 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:24.364255  3093 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.365207  3093 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:24.368276  3292 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 2.
I20260709 13:13:24.369329  2985 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:24.370002  3362 raft_consensus.cc:2804] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:24.370390  3362 raft_consensus.cc:697] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:24.370465  3093 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 2.
I20260709 13:13:24.371148  3362 consensus_queue.cc:237] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.374305  3293 raft_consensus.cc:1275] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.376389  3357 consensus_queue.cc:1048] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:24.381348  2841 catalog_manager.cc:5697] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 1 to 2, leader changed from 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.385469  3018 raft_consensus.cc:1275] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.387986  3358 consensus_queue.cc:1048] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:24.525430  3358 raft_consensus.cc:993] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: : Instructing follower 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:24.525943  3357 raft_consensus.cc:1081] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Signalling peer 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:24.527546  3019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:13:24.528051  3019 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:24.528358  3019 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.534597  3019 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.536501  3019 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 4 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:24.537446  3293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:24.537779  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:24.538159  3293 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.538373  3093 raft_consensus.cc:3055] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:24.538877  3093 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:24.539762  3093 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.540704  3093 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:24.544253  3293 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 4.
I20260709 13:13:24.545646  2985 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:24.546149  3093 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 4.
I20260709 13:13:24.546427  3248 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:24.546962  3248 raft_consensus.cc:697] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:24.547811  3248 consensus_queue.cc:237] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:24.554054  2841 catalog_manager.cc:5697] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 3 to 4, leader changed from 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 4 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.871774  3293 raft_consensus.cc:1275] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.872984  3248 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:24.881699  3093 raft_consensus.cc:1275] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:24.883844  3362 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:24.935966  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:24.984215  3293 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 4 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.985720  3362 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:24.996340  3093 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 4 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:24.997965  3248 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:25.296864 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:25.304124  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3003943086b2494090eb24c491ef7b27"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:25.304719  3019 raft_consensus.cc:606] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:25.307431  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:25.308007  3019 raft_consensus.cc:606] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:25.308987 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:25.309469 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:25.310034 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:25.337585  3248 raft_consensus.cc:993] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:25.338347  3371 raft_consensus.cc:1081] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:25.339891  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:25.340339  3093 raft_consensus.cc:493] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:25.340597  3093 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.345209  3093 raft_consensus.cc:515] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:25.346697  3093 leader_election.cc:290] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:25.347743  3293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:25.347756  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb28f4235a99482fa4894bd5838c873c" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:25.348407  3293 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.348565  3019 raft_consensus.cc:3055] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:25.349025  3019 raft_consensus.cc:740] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:25.349845  3019 consensus_queue.cc:260] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:25.350894  3019 raft_consensus.cc:3060] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:25.353868  3293 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:25.355026  3059 leader_election.cc:304] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:25.355836  3357 raft_consensus.cc:2804] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:25.356881  3357 raft_consensus.cc:697] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:25.357618  3019 raft_consensus.cc:2468] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 2.
I20260709 13:13:25.357908  3357 consensus_queue.cc:237] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } }
I20260709 13:13:25.365478  2842 catalog_manager.cc:5697] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 1 to 2, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 2 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.378036  3362 raft_consensus.cc:993] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:25.378582  3371 raft_consensus.cc:1081] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:25.380112  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3003943086b2494090eb24c491ef7b27"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:25.380625  3093 raft_consensus.cc:493] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:25.380967  3093 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.386427  3093 raft_consensus.cc:515] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:25.387912  3093 leader_election.cc:290] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:25.388859  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:25.388837  3293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3003943086b2494090eb24c491ef7b27" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:25.389694  3019 raft_consensus.cc:3055] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:25.389853  3293 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.390069  3019 raft_consensus.cc:740] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:25.391296  3019 consensus_queue.cc:260] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:25.392733  3019 raft_consensus.cc:3060] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:25.395430  3293 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:25.396528  3059 leader_election.cc:304] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:25.397214  3357 raft_consensus.cc:2804] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:25.397239  3019 raft_consensus.cc:2468] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:25.397867  3357 raft_consensus.cc:697] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:25.398600  3357 consensus_queue.cc:237] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:25.406240  2842 catalog_manager.cc:5697] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 2 to 3, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 3 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.838240  3019 raft_consensus.cc:1275] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:25.839689  3357 consensus_queue.cc:1048] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:25.843147  3293 raft_consensus.cc:1275] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:25.845176  3357 consensus_queue.cc:1048] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:25.872774  3019 raft_consensus.cc:1275] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.873925  3357 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:25.880460  3293 raft_consensus.cc:1275] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:25.882156  3382 consensus_queue.cc:1048] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:13:25.936914  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:26.316434 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:26.323637  3093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
mode: GRACEFUL
new_leader_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:13:26.324147  3093 raft_consensus.cc:606] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Received request to transfer leadership to TS 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:26.326802  3093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
mode: GRACEFUL
new_leader_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:13:26.327296  3093 raft_consensus.cc:606] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Received request to transfer leadership to TS 15a3ed5662c34686bf40ba3c3579d869
I20260709 13:13:26.328293 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:26.328797 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:26.329353 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:26.449895  3376 raft_consensus.cc:993] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: : Instructing follower 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:26.450366  3376 raft_consensus.cc:1081] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Signalling peer 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:26.451866  3019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:13:26.452350  3019 raft_consensus.cc:493] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.452638  3019 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.457211  3019 raft_consensus.cc:515] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.458626  3019 leader_election.cc:290] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 3 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:26.459518  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:26.459656  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73e3401270bc41f98be1c411e4560fce" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:26.460237  3292 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.460371  3093 raft_consensus.cc:3055] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:26.460790  3093 raft_consensus.cc:740] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:26.461397  3093 consensus_queue.cc:260] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.462284  3093 raft_consensus.cc:3060] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.466393  3292 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 3.
I20260709 13:13:26.467602  2985 leader_election.cc:304] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:26.468114  3093 raft_consensus.cc:2468] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 3.
I20260709 13:13:26.468411  3371 raft_consensus.cc:2804] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:26.469440  3371 raft_consensus.cc:697] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 3 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:26.470333  3371 consensus_queue.cc:237] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.476805  2843 catalog_manager.cc:5697] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 2 to 3, leader changed from 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 3 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:26.784932  3382 raft_consensus.cc:993] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: : Instructing follower 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:26.785439  3376 raft_consensus.cc:1081] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Signalling peer 15a3ed5662c34686bf40ba3c3579d869 to start an election
I20260709 13:13:26.786970  3019 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
 from {username='slave'} at 127.0.0.1:34256
I20260709 13:13:26.787537  3019 raft_consensus.cc:493] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:26.787894  3019 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.793290  3019 raft_consensus.cc:515] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.794842  3019 leader_election.cc:290] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 3 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131:33859)
I20260709 13:13:26.795588  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:26.795768  3093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8affd57325ad483c9e4602b8cb764892" candidate_uuid: "15a3ed5662c34686bf40ba3c3579d869" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
I20260709 13:13:26.796207  3292 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.796399  3093 raft_consensus.cc:3055] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:26.796772  3093 raft_consensus.cc:740] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:26.797360  3093 consensus_queue.cc:260] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.798260  3093 raft_consensus.cc:3060] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:26.801414  3292 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 3.
I20260709 13:13:26.802513  2985 leader_election.cc:304] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a3ed5662c34686bf40ba3c3579d869, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:26.802557  3093 raft_consensus.cc:2468] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a3ed5662c34686bf40ba3c3579d869 in term 3.
I20260709 13:13:26.803247  3371 raft_consensus.cc:2804] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:26.803784  3371 raft_consensus.cc:697] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 LEADER]: Becoming Leader. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:26.804860  3371 consensus_queue.cc:237] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:26.851781  2843 catalog_manager.cc:5697] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 reported cstate change: term changed from 2 to 3, leader changed from 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131) to 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130). New cstate: current_term: 3 leader_uuid: "15a3ed5662c34686bf40ba3c3579d869" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:26.938365  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:27.036252  3093 raft_consensus.cc:1275] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.038110  3389 consensus_queue.cc:1048] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:27.052742  3292 raft_consensus.cc:1275] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.054934  3389 consensus_queue.cc:1048] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:27.331969  3292 raft_consensus.cc:1275] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.333504  3371 consensus_queue.cc:1048] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:27.336467 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.349020  3093 raft_consensus.cc:1275] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Refusing update from remote peer 15a3ed5662c34686bf40ba3c3579d869: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:27.350674  3389 consensus_queue.cc:1048] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:27.356127  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:27.357061  3019 raft_consensus.cc:606] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:27.360553  3019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e"
dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
mode: GRACEFUL
new_leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:35296
I20260709 13:13:27.361207  3019 raft_consensus.cc:606] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Received request to transfer leadership to TS 55a4dc153bf64de39e1c07251ef93c6b
I20260709 13:13:27.362553 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:27.363267 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:27.364110 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:27.549289  3371 raft_consensus.cc:993] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:27.549866  3389 raft_consensus.cc:1081] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:27.551694  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:27.552758  3093 raft_consensus.cc:493] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.553228  3093 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.564421  3093 raft_consensus.cc:515] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.566987  3093 leader_election.cc:290] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:27.568024  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:27.568949  3292 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.572233  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a0549abed4e01b40b7872d3b7e93e" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:27.572969  3019 raft_consensus.cc:3055] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:27.573230  3019 raft_consensus.cc:740] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:27.574187  3019 consensus_queue.cc:260] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.575408  3019 raft_consensus.cc:3060] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:27.580152  3292 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:27.581677  3019 raft_consensus.cc:2468] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 3.
I20260709 13:13:27.582011  3059 leader_election.cc:304] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:27.583102  3376 raft_consensus.cc:2804] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:27.584244  3376 raft_consensus.cc:697] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:27.585403  3376 consensus_queue.cc:237] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.592387  2842 catalog_manager.cc:5697] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 2 to 3, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 3 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:27.794127  3371 raft_consensus.cc:993] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: : Instructing follower 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:27.794641  3389 raft_consensus.cc:1081] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 LEADER]: Signalling peer 55a4dc153bf64de39e1c07251ef93c6b to start an election
I20260709 13:13:27.796063  3093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b31955de830248e58b5497fcd457f664"
dest_uuid: "55a4dc153bf64de39e1c07251ef93c6b"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:13:27.796519  3093 raft_consensus.cc:493] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:27.796821  3093 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.803238  3093 raft_consensus.cc:515] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.804659  3093 leader_election.cc:290] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 5 election: Requested vote from peers f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469), 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703)
I20260709 13:13:27.805457  3292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f5d71a6a22714023ac594f0c82a9a324"
I20260709 13:13:27.805670  3019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b31955de830248e58b5497fcd457f664" candidate_uuid: "55a4dc153bf64de39e1c07251ef93c6b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "15a3ed5662c34686bf40ba3c3579d869"
I20260709 13:13:27.806239  3292 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.806265  3019 raft_consensus.cc:3055] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:13:27.806937  3019 raft_consensus.cc:740] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 15a3ed5662c34686bf40ba3c3579d869, State: Running, Role: LEADER
I20260709 13:13:27.807723  3019 consensus_queue.cc:260] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.808684  3019 raft_consensus.cc:3060] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:13:27.812215  3292 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 5.
I20260709 13:13:27.813521  3059 leader_election.cc:304] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55a4dc153bf64de39e1c07251ef93c6b, f5d71a6a22714023ac594f0c82a9a324; no voters: 
I20260709 13:13:27.814380  3376 raft_consensus.cc:2804] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:13:27.814332  3019 raft_consensus.cc:2468] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55a4dc153bf64de39e1c07251ef93c6b in term 5.
I20260709 13:13:27.815227  3376 raft_consensus.cc:697] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 5 LEADER]: Becoming Leader. State: Replica: 55a4dc153bf64de39e1c07251ef93c6b, State: Running, Role: LEADER
I20260709 13:13:27.816358  3376 consensus_queue.cc:237] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } }
I20260709 13:13:27.823133  2842 catalog_manager.cc:5697] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b reported cstate change: term changed from 4 to 5, leader changed from 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130) to 55a4dc153bf64de39e1c07251ef93c6b (127.25.139.131). New cstate: current_term: 5 leader_uuid: "55a4dc153bf64de39e1c07251ef93c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55a4dc153bf64de39e1c07251ef93c6b" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 33859 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:27.939467  2891 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:27.984434  3019 raft_consensus.cc:1275] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:27.985970  3376 consensus_queue.cc:1048] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:27.996245  3292 raft_consensus.cc:1275] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:27.998036  3376 consensus_queue.cc:1048] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:28.349637  3292 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 5 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:28.351064  3376 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d71a6a22714023ac594f0c82a9a324" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 36469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:13:28.364711  3019 raft_consensus.cc:1275] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 5 FOLLOWER]: Refusing update from remote peer 55a4dc153bf64de39e1c07251ef93c6b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:13:28.366194  3419 consensus_queue.cc:1048] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a3ed5662c34686bf40ba3c3579d869" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 38703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:13:28.372236 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:28.408788 26158 tablet_server.cc:179] TabletServer@127.25.139.129:36469 shutting down...
I20260709 13:13:28.433987 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.434690 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.435639 26158 raft_consensus.cc:2243] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.436228 26158 raft_consensus.cc:2272] T 7aab83954ef142daac361e96c946080d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.438853 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.439590 26158 raft_consensus.cc:2243] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.440318 26158 raft_consensus.cc:2272] T 3003943086b2494090eb24c491ef7b27 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:28.442421  3059 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 84 similar messages]
I20260709 13:13:28.443938 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.444604 26158 raft_consensus.cc:2243] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.445216 26158 raft_consensus.cc:2272] T 8affd57325ad483c9e4602b8cb764892 P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:28.445830  3059 consensus_peers.cc:597] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.448726 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.449445 26158 raft_consensus.cc:2243] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.450109 26158 raft_consensus.cc:2272] T b46a0549abed4e01b40b7872d3b7e93e P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:28.451925  3059 consensus_peers.cc:597] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:28.454152  2985 consensus_peers.cc:597] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.454353 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.455135 26158 raft_consensus.cc:2243] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.455753 26158 raft_consensus.cc:2272] T cb28f4235a99482fa4894bd5838c873c P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.458225 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.458755 26158 raft_consensus.cc:2243] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.459319 26158 raft_consensus.cc:2272] T b31955de830248e58b5497fcd457f664 P f5d71a6a22714023ac594f0c82a9a324 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.462190 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.462761 26158 raft_consensus.cc:2243] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.463317 26158 raft_consensus.cc:2272] T e2a43c8e559a42c8a41e6d7e5985fb13 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.465775 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.466274 26158 raft_consensus.cc:2243] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.466684 26158 raft_consensus.cc:2272] T 73e3401270bc41f98be1c411e4560fce P f5d71a6a22714023ac594f0c82a9a324 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.468950 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.469393 26158 raft_consensus.cc:2243] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.469817 26158 raft_consensus.cc:2272] T 21f26a0a958e44899b50f88fd2414ae0 P f5d71a6a22714023ac594f0c82a9a324 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.472146 26158 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:28.472608 26158 raft_consensus.cc:2243] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.473037 26158 raft_consensus.cc:2272] T 28c4c3a1c1e54d2b82f027b79c4d740d P f5d71a6a22714023ac594f0c82a9a324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.507359 26158 tablet_server.cc:196] TabletServer@127.25.139.129:36469 shutdown complete.
I20260709 13:13:28.535681 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
I20260709 13:13:28.560320 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.561084 26158 tablet_replica.cc:333] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.562036 26158 raft_consensus.cc:2243] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.562633 26158 raft_consensus.cc:2272] T 3003943086b2494090eb24c491ef7b27 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:28.566089  3060 consensus_peers.cc:597] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b -> Peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Couldn't send request to peer 15a3ed5662c34686bf40ba3c3579d869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.566443 26158 tablet_replica.cc:333] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.567369 26158 raft_consensus.cc:2243] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:28.567512  3060 consensus_peers.cc:597] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b -> Peer 15a3ed5662c34686bf40ba3c3579d869 (127.25.139.130:38703): Couldn't send request to peer 15a3ed5662c34686bf40ba3c3579d869. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.568035 26158 raft_consensus.cc:2272] T 28c4c3a1c1e54d2b82f027b79c4d740d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.570401 26158 tablet_replica.cc:333] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.571043 26158 raft_consensus.cc:2243] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.571537 26158 raft_consensus.cc:2272] T b31955de830248e58b5497fcd457f664 P 15a3ed5662c34686bf40ba3c3579d869 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.574213 26158 tablet_replica.cc:333] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.574868 26158 raft_consensus.cc:2243] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.575773 26158 raft_consensus.cc:2272] T 21f26a0a958e44899b50f88fd2414ae0 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.577924 26158 tablet_replica.cc:333] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.578473 26158 raft_consensus.cc:2243] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.578892 26158 raft_consensus.cc:2272] T b46a0549abed4e01b40b7872d3b7e93e P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.581413 26158 tablet_replica.cc:333] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.581966 26158 raft_consensus.cc:2243] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.582752 26158 raft_consensus.cc:2272] T 8affd57325ad483c9e4602b8cb764892 P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.584975 26158 tablet_replica.cc:333] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.585489 26158 raft_consensus.cc:2243] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.585971 26158 raft_consensus.cc:2272] T cb28f4235a99482fa4894bd5838c873c P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.587965 26158 tablet_replica.cc:333] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.588459 26158 raft_consensus.cc:2243] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.589319 26158 raft_consensus.cc:2272] T 7aab83954ef142daac361e96c946080d P 15a3ed5662c34686bf40ba3c3579d869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.591393 26158 tablet_replica.cc:333] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.591864 26158 raft_consensus.cc:2243] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.592356 26158 raft_consensus.cc:2272] T e2a43c8e559a42c8a41e6d7e5985fb13 P 15a3ed5662c34686bf40ba3c3579d869 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.594386 26158 tablet_replica.cc:333] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869: stopping tablet replica
I20260709 13:13:28.594870 26158 raft_consensus.cc:2243] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.595726 26158 raft_consensus.cc:2272] T 73e3401270bc41f98be1c411e4560fce P 15a3ed5662c34686bf40ba3c3579d869 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.628628 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
I20260709 13:13:28.657248 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
W20260709 13:13:28.666621  3059 consensus_peers.cc:597] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b -> Peer f5d71a6a22714023ac594f0c82a9a324 (127.25.139.129:36469): Couldn't send request to peer f5d71a6a22714023ac594f0c82a9a324. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:36469: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:28.690864 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:28.691819 26158 tablet_replica.cc:333] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.692731 26158 raft_consensus.cc:2243] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.693214 26158 raft_consensus.cc:2272] T 7aab83954ef142daac361e96c946080d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.695508 26158 tablet_replica.cc:333] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.696077 26158 raft_consensus.cc:2243] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.696843 26158 raft_consensus.cc:2272] T cb28f4235a99482fa4894bd5838c873c P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.698735 26158 tablet_replica.cc:333] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.699290 26158 raft_consensus.cc:2243] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.700043 26158 raft_consensus.cc:2272] T 3003943086b2494090eb24c491ef7b27 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.701956 26158 tablet_replica.cc:333] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.702435 26158 raft_consensus.cc:2243] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.703126 26158 raft_consensus.cc:2272] T b46a0549abed4e01b40b7872d3b7e93e P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.706504 26158 tablet_replica.cc:333] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.707104 26158 raft_consensus.cc:2243] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.707633 26158 raft_consensus.cc:2272] T 8affd57325ad483c9e4602b8cb764892 P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.709698 26158 tablet_replica.cc:333] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.710209 26158 raft_consensus.cc:2243] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.711066 26158 raft_consensus.cc:2272] T e2a43c8e559a42c8a41e6d7e5985fb13 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.713371 26158 tablet_replica.cc:333] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.713886 26158 raft_consensus.cc:2243] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.714325 26158 raft_consensus.cc:2272] T 73e3401270bc41f98be1c411e4560fce P 55a4dc153bf64de39e1c07251ef93c6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.716688 26158 tablet_replica.cc:333] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.717319 26158 raft_consensus.cc:2243] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.718215 26158 raft_consensus.cc:2272] T b31955de830248e58b5497fcd457f664 P 55a4dc153bf64de39e1c07251ef93c6b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.721088 26158 tablet_replica.cc:333] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.721735 26158 raft_consensus.cc:2243] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.722698 26158 raft_consensus.cc:2272] T 28c4c3a1c1e54d2b82f027b79c4d740d P 55a4dc153bf64de39e1c07251ef93c6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.725147 26158 tablet_replica.cc:333] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b: stopping tablet replica
I20260709 13:13:28.725757 26158 raft_consensus.cc:2243] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:28.726404 26158 raft_consensus.cc:2272] T 21f26a0a958e44899b50f88fd2414ae0 P 55a4dc153bf64de39e1c07251ef93c6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.761451 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:13:28.786587 26158 master.cc:562] Master@127.25.139.190:41549 shutting down...
I20260709 13:13:28.812394 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:28.812995 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:28.813385 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P ef35a74d63fb4f2db20e952ce8aa8b75: stopping tablet replica
I20260709 13:13:28.836238 26158 master.cc:584] Master@127.25.139.190:41549 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13090 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:28.881649 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:35999
I20260709 13:13:28.882808 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:28.889639  3427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.889716  3426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:28.889839  3429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:28.891093 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:28.892047 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:28.892258 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:28.892424 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602808892391 us; error 0 us; skew 500 ppm
I20260709 13:13:28.893029 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:28.896083 26158 webserver.cc:533] Webserver started at http://127.25.139.190:39361/ using document root <none> and password file <none>
I20260709 13:13:28.896665 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:28.896867 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:28.897204 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:28.898454 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "223762a5c68b44bea599b47d5966b6d8"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-v5z2"
I20260709 13:13:28.903633 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:13:28.907398  3434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:28.908317 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:13:28.908677 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "223762a5c68b44bea599b47d5966b6d8"
format_stamp: "Formatted at 2026-07-09 13:13:28 on dist-test-slave-v5z2"
I20260709 13:13:28.909008 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:28.930371 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:28.931735 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:28.970732 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:35999
I20260709 13:13:28.970860  3485 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:35999 every 8 connection(s)
I20260709 13:13:28.974834  3486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:28.986678  3486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8: Bootstrap starting.
I20260709 13:13:28.991812  3486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:28.996373  3486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8: No bootstrap required, opened a new log
I20260709 13:13:28.998708  3486 raft_consensus.cc:359] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER }
I20260709 13:13:28.999095  3486 raft_consensus.cc:385] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:28.999377  3486 raft_consensus.cc:740] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223762a5c68b44bea599b47d5966b6d8, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.000062  3486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER }
I20260709 13:13:29.000543  3486 raft_consensus.cc:399] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:29.000749  3486 raft_consensus.cc:493] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:29.001060  3486 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.006101  3486 raft_consensus.cc:515] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER }
I20260709 13:13:29.006675  3486 leader_election.cc:304] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 223762a5c68b44bea599b47d5966b6d8; no voters: 
I20260709 13:13:29.007929  3486 leader_election.cc:290] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:29.008306  3489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.009817  3489 raft_consensus.cc:697] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 1 LEADER]: Becoming Leader. State: Replica: 223762a5c68b44bea599b47d5966b6d8, State: Running, Role: LEADER
I20260709 13:13:29.010600  3489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER }
I20260709 13:13:29.011021  3486 sys_catalog.cc:565] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:29.016036  3490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "223762a5c68b44bea599b47d5966b6d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER } }
I20260709 13:13:29.016952  3490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:29.017997  3491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 223762a5c68b44bea599b47d5966b6d8. Latest consensus state: current_term: 1 leader_uuid: "223762a5c68b44bea599b47d5966b6d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "223762a5c68b44bea599b47d5966b6d8" member_type: VOTER } }
I20260709 13:13:29.018698  3491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:29.019399  3497 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:29.025166  3497 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:29.029362 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:29.035236  3497 catalog_manager.cc:1383] Generated new cluster ID: e1025a7cbae3417fa845967ceae0af80
I20260709 13:13:29.035581  3497 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:29.058445  3497 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:29.059871  3497 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:29.074106  3497 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8: Generated new TSK 0
I20260709 13:13:29.074784  3497 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:29.096331 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:29.102514  3507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.103694  3508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.105918 26158 server_base.cc:1061] running on GCE node
W20260709 13:13:29.105865  3510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.107528 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:29.107757 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:29.107904 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602809107883 us; error 0 us; skew 500 ppm
I20260709 13:13:29.108428 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:29.111238 26158 webserver.cc:533] Webserver started at http://127.25.139.129:45703/ using document root <none> and password file <none>
I20260709 13:13:29.111735 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:29.111927 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:29.112159 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:29.113420 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "41ee12fb74f044c1aaf910457ae9153e"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.118551 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:29.122430  3515 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.123397 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:29.123736 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "41ee12fb74f044c1aaf910457ae9153e"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.124068 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:29.143648 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:29.145041 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:29.146641 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.149240 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.149494 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.149780 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.150002 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.194800 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:32915
I20260709 13:13:29.194897  3577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:32915 every 8 connection(s)
I20260709 13:13:29.200750 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:29.208680  3582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.215425  3583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.215801  3578 heartbeater.cc:344] Connected to a master server at 127.25.139.190:35999
I20260709 13:13:29.216413  3578 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:29.217221  3585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.217291 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:29.217492  3578 heartbeater.cc:507] Master 127.25.139.190:35999 requested a full tablet report, sending...
I20260709 13:13:29.219162 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:29.219483 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:29.219707 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602809219686 us; error 0 us; skew 500 ppm
I20260709 13:13:29.220337 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:29.220438  3451 ts_manager.cc:194] Registered new tserver with Master: 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915)
I20260709 13:13:29.222884  3451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42162
I20260709 13:13:29.223140 26158 webserver.cc:533] Webserver started at http://127.25.139.130:42719/ using document root <none> and password file <none>
I20260709 13:13:29.223832 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:29.224110 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:29.224524 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:29.226260 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "ef7ca81cb68a42628324453ef1ff01e6"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.230908 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:13:29.234423  3590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.235289 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:29.235620 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "ef7ca81cb68a42628324453ef1ff01e6"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.235872 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:29.246335 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:29.247669 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:29.249078 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.251379 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.251595 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.251873 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.252036 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.293519 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:46239
I20260709 13:13:29.293619  3652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:46239 every 8 connection(s)
I20260709 13:13:29.298581 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:29.306068  3656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.307310  3657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:29.310887  3659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:29.312214  3653 heartbeater.cc:344] Connected to a master server at 127.25.139.190:35999
I20260709 13:13:29.312892  3653 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:29.314090  3653 heartbeater.cc:507] Master 127.25.139.190:35999 requested a full tablet report, sending...
I20260709 13:13:29.315955 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:29.316504  3451 ts_manager.cc:194] Registered new tserver with Master: ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239)
I20260709 13:13:29.317101 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:29.317435 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:29.317637 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602809317618 us; error 0 us; skew 500 ppm
I20260709 13:13:29.318434 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:29.318451  3451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42174
I20260709 13:13:29.321270 26158 webserver.cc:533] Webserver started at http://127.25.139.131:46683/ using document root <none> and password file <none>
I20260709 13:13:29.321727 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:29.321880 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:29.322106 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:29.323323 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "a86510412ae340b5b2136af5495808db"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.327659 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:13:29.330842  3664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.331660 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:29.332010 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "a86510412ae340b5b2136af5495808db"
format_stamp: "Formatted at 2026-07-09 13:13:29 on dist-test-slave-v5z2"
I20260709 13:13:29.332285 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:29.346841 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:29.348114 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:29.349558 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:29.351836 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:29.352070 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.352317 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:29.352491 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:29.393353 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:34385
I20260709 13:13:29.393451  3726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:34385 every 8 connection(s)
I20260709 13:13:29.407660  3727 heartbeater.cc:344] Connected to a master server at 127.25.139.190:35999
I20260709 13:13:29.408075  3727 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:29.408792  3727 heartbeater.cc:507] Master 127.25.139.190:35999 requested a full tablet report, sending...
I20260709 13:13:29.410900  3451 ts_manager.cc:194] Registered new tserver with Master: a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.411532 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01474845s
I20260709 13:13:29.412449  3451 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42182
I20260709 13:13:29.438558  3451 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42192:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:29.440873  3451 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:29.485884  3618 tablet_service.cc:1511] Processing CreateTablet for tablet 21adf333c4984a7cbaf1c242a5cdde45 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.485991  3617 tablet_service.cc:1511] Processing CreateTablet for tablet db1ef0984de24169a88c12f80188ecb9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.487411  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21adf333c4984a7cbaf1c242a5cdde45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.488060  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ef0984de24169a88c12f80188ecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.498988  3692 tablet_service.cc:1511] Processing CreateTablet for tablet 21adf333c4984a7cbaf1c242a5cdde45 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.499238  3691 tablet_service.cc:1511] Processing CreateTablet for tablet db1ef0984de24169a88c12f80188ecb9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.500579  3692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21adf333c4984a7cbaf1c242a5cdde45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.500603  3543 tablet_service.cc:1511] Processing CreateTablet for tablet 21adf333c4984a7cbaf1c242a5cdde45 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.501394  3691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ef0984de24169a88c12f80188ecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.502123  3543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21adf333c4984a7cbaf1c242a5cdde45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.505832  3542 tablet_service.cc:1511] Processing CreateTablet for tablet db1ef0984de24169a88c12f80188ecb9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=9327a705cf1d4e43b3d87177b3f4dc59]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.507313  3542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db1ef0984de24169a88c12f80188ecb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.534950  3742 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: Bootstrap starting.
I20260709 13:13:29.540150  3743 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: Bootstrap starting.
I20260709 13:13:29.541122  3742 tablet_bootstrap.cc:654] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.541424  3744 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: Bootstrap starting.
I20260709 13:13:29.547108  3743 tablet_bootstrap.cc:654] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.548889  3744 tablet_bootstrap.cc:654] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.552260  3742 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: No bootstrap required, opened a new log
I20260709 13:13:29.552889  3742 ts_tablet_manager.cc:1403] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:13:29.554394  3743 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: No bootstrap required, opened a new log
I20260709 13:13:29.554863  3743 ts_tablet_manager.cc:1403] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:29.555040  3744 tablet_bootstrap.cc:492] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: No bootstrap required, opened a new log
I20260709 13:13:29.555564  3744 ts_tablet_manager.cc:1403] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:13:29.555960  3742 raft_consensus.cc:359] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.556770  3742 raft_consensus.cc:385] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.557062  3742 raft_consensus.cc:740] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.557432  3743 raft_consensus.cc:359] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.558130  3743 raft_consensus.cc:385] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.557858  3742 consensus_queue.cc:260] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.558409  3743 raft_consensus.cc:740] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86510412ae340b5b2136af5495808db, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.558502  3744 raft_consensus.cc:359] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.559309  3744 raft_consensus.cc:385] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.559252  3743 consensus_queue.cc:260] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.559723  3744 raft_consensus.cc:740] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.560962  3653 heartbeater.cc:499] Master 127.25.139.190:35999 was elected leader, sending a full tablet report...
I20260709 13:13:29.560724  3744 consensus_queue.cc:260] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.561475  3742 ts_tablet_manager.cc:1434] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:29.562463  3742 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: Bootstrap starting.
I20260709 13:13:29.569393  3742 tablet_bootstrap.cc:654] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.570950  3743 ts_tablet_manager.cc:1434] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:13:29.572005  3727 heartbeater.cc:499] Master 127.25.139.190:35999 was elected leader, sending a full tablet report...
I20260709 13:13:29.589980  3742 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: No bootstrap required, opened a new log
I20260709 13:13:29.589982  3743 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: Bootstrap starting.
I20260709 13:13:29.590696  3742 ts_tablet_manager.cc:1403] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.016s
I20260709 13:13:29.593218  3742 raft_consensus.cc:359] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.593817  3742 raft_consensus.cc:385] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.594169  3742 raft_consensus.cc:740] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.595310  3578 heartbeater.cc:499] Master 127.25.139.190:35999 was elected leader, sending a full tablet report...
I20260709 13:13:29.595227  3742 consensus_queue.cc:260] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.596844  3744 ts_tablet_manager.cc:1434] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.024s
I20260709 13:13:29.598030  3744 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: Bootstrap starting.
I20260709 13:13:29.598851  3743 tablet_bootstrap.cc:654] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.599512  3742 ts_tablet_manager.cc:1434] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:13:29.603926  3744 tablet_bootstrap.cc:654] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.609452  3744 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: No bootstrap required, opened a new log
I20260709 13:13:29.609942  3744 ts_tablet_manager.cc:1403] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:13:29.610111  3743 tablet_bootstrap.cc:492] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: No bootstrap required, opened a new log
I20260709 13:13:29.610746  3743 ts_tablet_manager.cc:1403] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 13:13:29.613039  3744 raft_consensus.cc:359] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.613673  3744 raft_consensus.cc:385] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.613950  3744 raft_consensus.cc:740] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.613771  3743 raft_consensus.cc:359] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.614713  3743 raft_consensus.cc:385] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.615187  3743 raft_consensus.cc:740] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86510412ae340b5b2136af5495808db, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.614749  3744 consensus_queue.cc:260] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.615967  3743 consensus_queue.cc:260] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.617197  3744 ts_tablet_manager.cc:1434] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:29.617987  3743 ts_tablet_manager.cc:1434] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:29.634296  3748 raft_consensus.cc:493] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.634889  3748 raft_consensus.cc:515] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.637321  3748 leader_election.cc:290] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.647248  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e" is_pre_election: true
I20260709 13:13:29.648098  3553 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.648636  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db" is_pre_election: true
I20260709 13:13:29.649255  3702 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.649379  3593 leader_election.cc:304] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.650296  3748 raft_consensus.cc:2804] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.650655  3748 raft_consensus.cc:493] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.650911  3748 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.656350  3748 raft_consensus.cc:515] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.658008  3748 leader_election.cc:290] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Requested vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.658967  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:29.658926  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
I20260709 13:13:29.659813  3702 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.659909  3553 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.665787  3553 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:29.665915  3702 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:29.667029  3593 leader_election.cc:304] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.667953  3748 raft_consensus.cc:2804] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.669297  3748 raft_consensus.cc:697] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Leader. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:29.670210  3748 consensus_queue.cc:237] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.679322  3449 catalog_manager.cc:5697] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "ef7ca81cb68a42628324453ef1ff01e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.700268  3748 raft_consensus.cc:493] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.700949  3748 raft_consensus.cc:515] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.702744  3748 leader_election.cc:290] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.703739  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e" is_pre_election: true
I20260709 13:13:29.703819  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db" is_pre_election: true
I20260709 13:13:29.704532  3553 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.704599  3702 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.705931  3591 leader_election.cc:304] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86510412ae340b5b2136af5495808db, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.706691  3748 raft_consensus.cc:2804] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.707089  3748 raft_consensus.cc:493] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.707464  3748 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.712805  3748 raft_consensus.cc:515] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.714865  3748 leader_election.cc:290] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Requested vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.715695  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
I20260709 13:13:29.716084  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:29.716411  3553 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.716677  3702 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.723697  3702 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:29.723697  3553 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:29.724956  3593 leader_election.cc:304] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.725703  3748 raft_consensus.cc:2804] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.726218  3748 raft_consensus.cc:697] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Leader. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:29.726871  3748 consensus_queue.cc:237] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.733551  3449 catalog_manager.cc:5697] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "ef7ca81cb68a42628324453ef1ff01e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:29.781060  3449 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42198:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:29.783129  3449 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:29.807237  3543 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.808729  3543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.809120  3617 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.810518  3617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.810622  3691 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:29.811964  3691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc3e629ff9d40fb98f60a0c7498a2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.816175  3692 tablet_service.cc:1511] Processing CreateTablet for tablet ce9e5ecdbbee425ab64e4eb400b8565e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.817651  3692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9e5ecdbbee425ab64e4eb400b8565e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.817544  3542 tablet_service.cc:1511] Processing CreateTablet for tablet ce9e5ecdbbee425ab64e4eb400b8565e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.820812  3618 tablet_service.cc:1511] Processing CreateTablet for tablet ce9e5ecdbbee425ab64e4eb400b8565e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=25501c6d7755445b9f99a42b7483833b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:29.822199  3618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9e5ecdbbee425ab64e4eb400b8565e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.819062  3542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9e5ecdbbee425ab64e4eb400b8565e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:29.825779  3744 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: Bootstrap starting.
I20260709 13:13:29.829145  3743 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: Bootstrap starting.
I20260709 13:13:29.833617  3744 tablet_bootstrap.cc:654] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.835990  3743 tablet_bootstrap.cc:654] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.847550  3744 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: No bootstrap required, opened a new log
I20260709 13:13:29.848387  3744 ts_tablet_manager.cc:1403] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:13:29.852792  3744 raft_consensus.cc:359] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.853957  3744 raft_consensus.cc:385] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.854442  3744 raft_consensus.cc:740] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.855729  3744 consensus_queue.cc:260] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.859077  3744 ts_tablet_manager.cc:1434] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:29.861655  3744 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: Bootstrap starting.
I20260709 13:13:29.865175  3742 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: Bootstrap starting.
I20260709 13:13:29.870513  3744 tablet_bootstrap.cc:654] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.873440  3742 tablet_bootstrap.cc:654] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.881044  3743 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: No bootstrap required, opened a new log
I20260709 13:13:29.881047  3742 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: No bootstrap required, opened a new log
I20260709 13:13:29.881909  3743 ts_tablet_manager.cc:1403] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.035s
I20260709 13:13:29.882009  3742 ts_tablet_manager.cc:1403] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:13:29.885640  3742 raft_consensus.cc:359] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.885766  3743 raft_consensus.cc:359] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.886598  3742 raft_consensus.cc:385] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.886719  3743 raft_consensus.cc:385] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.887055  3744 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: No bootstrap required, opened a new log
I20260709 13:13:29.887236  3743 raft_consensus.cc:740] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86510412ae340b5b2136af5495808db, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.887140  3742 raft_consensus.cc:740] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.887928  3744 ts_tablet_manager.cc:1403] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.014s
I20260709 13:13:29.888406  3743 consensus_queue.cc:260] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.888790  3742 consensus_queue.cc:260] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.890722  3743 ts_tablet_manager.cc:1434] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:29.891206  3742 ts_tablet_manager.cc:1434] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:29.891155  3744 raft_consensus.cc:359] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.891821  3743 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: Bootstrap starting.
I20260709 13:13:29.892068  3744 raft_consensus.cc:385] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.892405  3744 raft_consensus.cc:740] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.892532  3742 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Bootstrap starting.
I20260709 13:13:29.893342  3744 consensus_queue.cc:260] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.895685  3744 ts_tablet_manager.cc:1434] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:29.900692  3743 tablet_bootstrap.cc:654] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.900719  3742 tablet_bootstrap.cc:654] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:29.914427  3743 tablet_bootstrap.cc:492] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: No bootstrap required, opened a new log
I20260709 13:13:29.914433  3742 tablet_bootstrap.cc:492] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: No bootstrap required, opened a new log
I20260709 13:13:29.915192  3742 ts_tablet_manager.cc:1403] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:13:29.915192  3743 ts_tablet_manager.cc:1403] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 13:13:29.918641  3742 raft_consensus.cc:359] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.918835  3743 raft_consensus.cc:359] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.919564  3742 raft_consensus.cc:385] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.919736  3743 raft_consensus.cc:385] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:29.920003  3742 raft_consensus.cc:740] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.920154  3743 raft_consensus.cc:740] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86510412ae340b5b2136af5495808db, State: Initialized, Role: FOLLOWER
I20260709 13:13:29.920930  3742 consensus_queue.cc:260] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.921147  3743 consensus_queue.cc:260] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.923550  3743 ts_tablet_manager.cc:1434] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:29.923550  3742 ts_tablet_manager.cc:1434] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:29.928771  3750 raft_consensus.cc:493] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.929411  3750 raft_consensus.cc:515] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.932241  3750 leader_election.cc:290] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.933068  3748 raft_consensus.cc:493] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.933619  3748 raft_consensus.cc:515] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.936517  3748 leader_election.cc:290] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.936764  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e" is_pre_election: true
I20260709 13:13:29.937558  3553 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.937949  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db" is_pre_election: true
I20260709 13:13:29.938452  3749 raft_consensus.cc:493] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:29.939049  3749 raft_consensus.cc:515] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.940176  3702 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 0.
I20260709 13:13:29.941895  3749 leader_election.cc:290] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239)
I20260709 13:13:29.942101  3591 leader_election.cc:304] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86510412ae340b5b2136af5495808db, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.942981  3748 raft_consensus.cc:2804] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.943384  3748 raft_consensus.cc:493] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.943738  3748 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.948112  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6" is_pre_election: true
I20260709 13:13:29.948836  3628 raft_consensus.cc:2468] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 0.
I20260709 13:13:29.950125  3518 leader_election.cc:304] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.950937  3750 raft_consensus.cc:2804] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:29.951351  3750 raft_consensus.cc:493] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:29.951717  3750 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.953329  3748 raft_consensus.cc:515] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.957363  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
I20260709 13:13:29.957959  3553 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.959929  3750 raft_consensus.cc:515] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.963229  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
I20260709 13:13:29.963828  3628 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.967923  3553 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:29.969197  3593 leader_election.cc:304] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.970037  3755 raft_consensus.cc:2804] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.972869  3628 raft_consensus.cc:2468] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 1.
I20260709 13:13:29.975852  3518 leader_election.cc:304] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:29.979954  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:29.980909  3702 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:29.974423  3750 leader_election.cc:290] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 1 election: Requested vote from peers ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.981889  3750 raft_consensus.cc:2804] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:29.982333  3750 raft_consensus.cc:697] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 LEADER]: Becoming Leader. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Running, Role: LEADER
I20260709 13:13:29.983036  3750 consensus_queue.cc:237] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:29.992062  3748 leader_election.cc:290] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 1 election: Requested vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:29.996315  3702 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 1.
I20260709 13:13:30.001107  3755 raft_consensus.cc:697] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Leader. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:30.002597  3755 consensus_queue.cc:237] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.008981  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "a86510412ae340b5b2136af5495808db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6" is_pre_election: true
I20260709 13:13:30.012256  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "a86510412ae340b5b2136af5495808db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41ee12fb74f044c1aaf910457ae9153e" is_pre_election: true
I20260709 13:13:30.012384  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db" is_pre_election: true
I20260709 13:13:30.012949  3701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:30.013098  3553 raft_consensus.cc:2393] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a86510412ae340b5b2136af5495808db in current term 1: Already voted for candidate ef7ca81cb68a42628324453ef1ff01e6 in this term.
I20260709 13:13:30.013202  3702 raft_consensus.cc:2468] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 0.
I20260709 13:13:30.014001  3451 catalog_manager.cc:5697] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e reported cstate change: term changed from 0 to 1, leader changed from <none> to 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129). New cstate: current_term: 1 leader_uuid: "41ee12fb74f044c1aaf910457ae9153e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.015055  3667 leader_election.cc:304] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a86510412ae340b5b2136af5495808db; no voters: 41ee12fb74f044c1aaf910457ae9153e, ef7ca81cb68a42628324453ef1ff01e6
I20260709 13:13:30.016440  3749 raft_consensus.cc:2749] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:30.023216  3499 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:30.023437  3449 catalog_manager.cc:5697] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130). New cstate: current_term: 1 leader_uuid: "ef7ca81cb68a42628324453ef1ff01e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.079867  3628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45"
dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
mode: GRACEFUL
new_leader_uuid: "41ee12fb74f044c1aaf910457ae9153e"
 from {username='slave'} at 127.0.0.1:54596
I20260709 13:13:30.080377  3628 raft_consensus.cc:606] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Received request to transfer leadership to TS 41ee12fb74f044c1aaf910457ae9153e
I20260709 13:13:30.085728  3628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9"
dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
mode: GRACEFUL
new_leader_uuid: "a86510412ae340b5b2136af5495808db"
 from {username='slave'} at 127.0.0.1:54596
I20260709 13:13:30.086195  3628 raft_consensus.cc:606] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Received request to transfer leadership to TS a86510412ae340b5b2136af5495808db
I20260709 13:13:30.093917  3628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e"
dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
mode: GRACEFUL
new_leader_uuid: "41ee12fb74f044c1aaf910457ae9153e"
 from {username='slave'} at 127.0.0.1:54596
I20260709 13:13:30.094380  3628 raft_consensus.cc:606] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Received request to transfer leadership to TS 41ee12fb74f044c1aaf910457ae9153e
I20260709 13:13:30.163543  3755 consensus_queue.cc:1048] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.177804  3755 consensus_queue.cc:1048] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.188040  3755 raft_consensus.cc:993] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: : Instructing follower 41ee12fb74f044c1aaf910457ae9153e to start an election
I20260709 13:13:30.188659  3773 raft_consensus.cc:1081] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Signalling peer 41ee12fb74f044c1aaf910457ae9153e to start an election
I20260709 13:13:30.190174  3553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45"
dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
 from {username='slave'} at 127.0.0.1:59266
I20260709 13:13:30.190670  3553 raft_consensus.cc:493] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.190979  3553 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.196367  3553 raft_consensus.cc:515] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.198419  3553 leader_election.cc:290] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 2 election: Requested vote from peers ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:30.199134  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
I20260709 13:13:30.199554  3702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21adf333c4984a7cbaf1c242a5cdde45" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:30.199877  3628 raft_consensus.cc:3055] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.200220  3702 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.200248  3628 raft_consensus.cc:740] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:30.201269  3628 consensus_queue.cc:260] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.202581  3628 raft_consensus.cc:3060] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.207782  3702 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 2.
I20260709 13:13:30.209081  3516 leader_election.cc:304] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, a86510412ae340b5b2136af5495808db; no voters: 
I20260709 13:13:30.209376  3628 raft_consensus.cc:2468] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 2.
I20260709 13:13:30.209810  3750 raft_consensus.cc:2804] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.210345  3750 raft_consensus.cc:697] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 2 LEADER]: Becoming Leader. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Running, Role: LEADER
I20260709 13:13:30.211112  3750 consensus_queue.cc:237] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.217188  3451 catalog_manager.cc:5697] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e reported cstate change: term changed from 1 to 2, leader changed from ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130) to 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "41ee12fb74f044c1aaf910457ae9153e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.260030  3773 consensus_queue.cc:1048] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.266494  3748 raft_consensus.cc:993] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: : Instructing follower a86510412ae340b5b2136af5495808db to start an election
I20260709 13:13:30.266958  3755 raft_consensus.cc:1081] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Signalling peer a86510412ae340b5b2136af5495808db to start an election
I20260709 13:13:30.269234  3701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9"
dest_uuid: "a86510412ae340b5b2136af5495808db"
 from {username='slave'} at 127.0.0.1:58454
I20260709 13:13:30.269802  3701 raft_consensus.cc:493] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.270167  3701 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.272728  3755 consensus_queue.cc:1048] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.280779  3701 raft_consensus.cc:515] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.283043  3701 leader_election.cc:290] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [CANDIDATE]: Term 2 election: Requested vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239)
I20260709 13:13:30.284456  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "a86510412ae340b5b2136af5495808db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
I20260709 13:13:30.284564  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db1ef0984de24169a88c12f80188ecb9" candidate_uuid: "a86510412ae340b5b2136af5495808db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
I20260709 13:13:30.285257  3628 raft_consensus.cc:3055] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.285739  3628 raft_consensus.cc:740] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:30.286752  3628 consensus_queue.cc:260] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.287858  3628 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.285753  3553 raft_consensus.cc:3060] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.293337  3628 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a86510412ae340b5b2136af5495808db in term 2.
I20260709 13:13:30.294384  3667 leader_election.cc:304] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86510412ae340b5b2136af5495808db, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:30.295301  3749 raft_consensus.cc:2804] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.296456  3749 raft_consensus.cc:697] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 2 LEADER]: Becoming Leader. State: Replica: a86510412ae340b5b2136af5495808db, State: Running, Role: LEADER
I20260709 13:13:30.297292  3749 consensus_queue.cc:237] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.298918  3553 raft_consensus.cc:2468] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a86510412ae340b5b2136af5495808db in term 2.
I20260709 13:13:30.306535  3451 catalog_manager.cc:5697] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db reported cstate change: term changed from 1 to 2, leader changed from ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130) to a86510412ae340b5b2136af5495808db (127.25.139.131). New cstate: current_term: 2 leader_uuid: "a86510412ae340b5b2136af5495808db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:30.384189  3701 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:30.392541  3750 consensus_queue.cc:1048] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.405686  3774 consensus_queue.cc:1048] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.464740  3755 consensus_queue.cc:1048] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.474974  3773 consensus_queue.cc:1048] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:30.482730  3748 raft_consensus.cc:993] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: : Instructing follower 41ee12fb74f044c1aaf910457ae9153e to start an election
I20260709 13:13:30.483296  3773 raft_consensus.cc:1081] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Signalling peer 41ee12fb74f044c1aaf910457ae9153e to start an election
I20260709 13:13:30.484941  3553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e"
dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
 from {username='slave'} at 127.0.0.1:59266
I20260709 13:13:30.485433  3553 raft_consensus.cc:493] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.485754  3553 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.490723  3553 raft_consensus.cc:515] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.493000  3553 leader_election.cc:290] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 2 election: Requested vote from peers ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:30.493409  3628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
I20260709 13:13:30.493568  3701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9e5ecdbbee425ab64e4eb400b8565e" candidate_uuid: "41ee12fb74f044c1aaf910457ae9153e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:30.494156  3628 raft_consensus.cc:3055] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.494196  3701 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.494621  3628 raft_consensus.cc:740] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:30.495491  3628 consensus_queue.cc:260] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.497051  3628 raft_consensus.cc:3060] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.502342  3701 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 2.
I20260709 13:13:30.503654  3516 leader_election.cc:304] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41ee12fb74f044c1aaf910457ae9153e, a86510412ae340b5b2136af5495808db; no voters: 
I20260709 13:13:30.504438  3774 raft_consensus.cc:2804] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.504438  3628 raft_consensus.cc:2468] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41ee12fb74f044c1aaf910457ae9153e in term 2.
I20260709 13:13:30.505275  3774 raft_consensus.cc:697] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 2 LEADER]: Becoming Leader. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Running, Role: LEADER
I20260709 13:13:30.506158  3774 consensus_queue.cc:237] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.512004  3451 catalog_manager.cc:5697] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e reported cstate change: term changed from 1 to 2, leader changed from ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130) to 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129). New cstate: current_term: 2 leader_uuid: "41ee12fb74f044c1aaf910457ae9153e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:30.552343 26158 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:30.553902 26158 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:30.554304 26158 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:30.566207  3553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb"
dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
mode: GRACEFUL
new_leader_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
 from {username='slave'} at 127.0.0.1:49086
I20260709 13:13:30.566748  3553 raft_consensus.cc:606] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 LEADER]: Received request to transfer leadership to TS ef7ca81cb68a42628324453ef1ff01e6
I20260709 13:13:30.567903 26158 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:30.619364  3701 raft_consensus.cc:1275] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Refusing update from remote peer 41ee12fb74f044c1aaf910457ae9153e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.620777  3774 consensus_queue.cc:1048] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.628644  3628 raft_consensus.cc:1275] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Refusing update from remote peer 41ee12fb74f044c1aaf910457ae9153e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.630237  3787 consensus_queue.cc:1048] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.676916  3553 raft_consensus.cc:1275] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Refusing update from remote peer a86510412ae340b5b2136af5495808db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.678295  3749 consensus_queue.cc:1048] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [LEADER]: Connected to new peer: Peer: permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:30.686771  3628 raft_consensus.cc:1275] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Refusing update from remote peer a86510412ae340b5b2136af5495808db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:30.688946  3793 consensus_queue.cc:1048] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:30.967437  3750 raft_consensus.cc:993] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: : Instructing follower ef7ca81cb68a42628324453ef1ff01e6 to start an election
I20260709 13:13:30.968076  3787 raft_consensus.cc:1081] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 LEADER]: Signalling peer ef7ca81cb68a42628324453ef1ff01e6 to start an election
I20260709 13:13:30.969882  3628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb"
dest_uuid: "ef7ca81cb68a42628324453ef1ff01e6"
 from {username='slave'} at 127.0.0.1:54578
I20260709 13:13:30.970537  3628 raft_consensus.cc:493] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:30.970904  3628 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.978272  3628 raft_consensus.cc:515] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.980621  3628 leader_election.cc:290] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 2 election: Requested vote from peers 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129:32915), a86510412ae340b5b2136af5495808db (127.25.139.131:34385)
I20260709 13:13:30.981468  3553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41ee12fb74f044c1aaf910457ae9153e"
I20260709 13:13:30.981878  3701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc3e629ff9d40fb98f60a0c7498a2fb" candidate_uuid: "ef7ca81cb68a42628324453ef1ff01e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a86510412ae340b5b2136af5495808db"
I20260709 13:13:30.982106  3553 raft_consensus.cc:3055] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:30.982522  3553 raft_consensus.cc:740] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41ee12fb74f044c1aaf910457ae9153e, State: Running, Role: LEADER
I20260709 13:13:30.982543  3701 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.983292  3553 consensus_queue.cc:260] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.984259  3553 raft_consensus.cc:3060] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:30.988498  3701 raft_consensus.cc:2468] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 2.
I20260709 13:13:30.989223  3553 raft_consensus.cc:2468] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7ca81cb68a42628324453ef1ff01e6 in term 2.
I20260709 13:13:30.989923  3591 leader_election.cc:304] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86510412ae340b5b2136af5495808db, ef7ca81cb68a42628324453ef1ff01e6; no voters: 
I20260709 13:13:30.990711  3773 raft_consensus.cc:2804] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:30.991220  3773 raft_consensus.cc:697] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 LEADER]: Becoming Leader. State: Replica: ef7ca81cb68a42628324453ef1ff01e6, State: Running, Role: LEADER
I20260709 13:13:30.992012  3773 consensus_queue.cc:237] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } }
I20260709 13:13:30.997768  3451 catalog_manager.cc:5697] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 reported cstate change: term changed from 1 to 2, leader changed from 41ee12fb74f044c1aaf910457ae9153e (127.25.139.129) to ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130). New cstate: current_term: 2 leader_uuid: "ef7ca81cb68a42628324453ef1ff01e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41ee12fb74f044c1aaf910457ae9153e" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 32915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.081588  3701 raft_consensus.cc:1275] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Refusing update from remote peer 41ee12fb74f044c1aaf910457ae9153e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.082911  3787 consensus_queue.cc:1048] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86510412ae340b5b2136af5495808db" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 34385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.090871  3628 raft_consensus.cc:1275] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Refusing update from remote peer 41ee12fb74f044c1aaf910457ae9153e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.092371  3787 consensus_queue.cc:1048] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7ca81cb68a42628324453ef1ff01e6" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:31.182650 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
I20260709 13:13:31.205237 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:31.205895 26158 tablet_replica.cc:333] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e: stopping tablet replica
I20260709 13:13:31.206599 26158 raft_consensus.cc:2243] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.207553 26158 raft_consensus.cc:2272] T ce9e5ecdbbee425ab64e4eb400b8565e P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.209969 26158 tablet_replica.cc:333] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e: stopping tablet replica
I20260709 13:13:31.210502 26158 raft_consensus.cc:2243] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.211030 26158 raft_consensus.cc:2272] T 4bc3e629ff9d40fb98f60a0c7498a2fb P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.213630 26158 tablet_replica.cc:333] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e: stopping tablet replica
I20260709 13:13:31.214181 26158 raft_consensus.cc:2243] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.214610 26158 raft_consensus.cc:2272] T db1ef0984de24169a88c12f80188ecb9 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.216881 26158 tablet_replica.cc:333] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e: stopping tablet replica
I20260709 13:13:31.217381 26158 raft_consensus.cc:2243] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.218149 26158 raft_consensus.cc:2272] T 21adf333c4984a7cbaf1c242a5cdde45 P 41ee12fb74f044c1aaf910457ae9153e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.242062 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
I20260709 13:13:31.254024 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
W20260709 13:13:31.275986  3667 consensus_peers.cc:597] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db -> Peer ef7ca81cb68a42628324453ef1ff01e6 (127.25.139.130:46239): Couldn't send request to peer ef7ca81cb68a42628324453ef1ff01e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:31.277305 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:31.278107 26158 tablet_replica.cc:333] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: stopping tablet replica
I20260709 13:13:31.278728 26158 raft_consensus.cc:2243] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.279443 26158 pending_rounds.cc:70] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Trying to abort 1 pending ops.
I20260709 13:13:31.279628 26158 pending_rounds.cc:77] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637113830514688 op_type: NO_OP noop_request { }
I20260709 13:13:31.279892 26158 raft_consensus.cc:2889] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:31.280148 26158 raft_consensus.cc:2272] T 4bc3e629ff9d40fb98f60a0c7498a2fb P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.282590 26158 tablet_replica.cc:333] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6: stopping tablet replica
I20260709 13:13:31.283104 26158 raft_consensus.cc:2243] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.283599 26158 raft_consensus.cc:2272] T ce9e5ecdbbee425ab64e4eb400b8565e P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.285696 26158 tablet_replica.cc:333] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6: stopping tablet replica
I20260709 13:13:31.286194 26158 raft_consensus.cc:2243] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.286590 26158 raft_consensus.cc:2272] T db1ef0984de24169a88c12f80188ecb9 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.288818 26158 tablet_replica.cc:333] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6: stopping tablet replica
I20260709 13:13:31.289289 26158 raft_consensus.cc:2243] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.289670 26158 raft_consensus.cc:2272] T 21adf333c4984a7cbaf1c242a5cdde45 P ef7ca81cb68a42628324453ef1ff01e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.302973 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
I20260709 13:13:31.314429 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
I20260709 13:13:31.333056 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:31.333747 26158 tablet_replica.cc:333] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db: stopping tablet replica
I20260709 13:13:31.334405 26158 raft_consensus.cc:2243] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.334946 26158 raft_consensus.cc:2272] T ce9e5ecdbbee425ab64e4eb400b8565e P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.337666 26158 tablet_replica.cc:333] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db: stopping tablet replica
I20260709 13:13:31.338212 26158 raft_consensus.cc:2243] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.338627 26158 raft_consensus.cc:2272] T 4bc3e629ff9d40fb98f60a0c7498a2fb P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.340891 26158 tablet_replica.cc:333] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db: stopping tablet replica
I20260709 13:13:31.341379 26158 raft_consensus.cc:2243] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.342156 26158 raft_consensus.cc:2272] T db1ef0984de24169a88c12f80188ecb9 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.344300 26158 tablet_replica.cc:333] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db: stopping tablet replica
I20260709 13:13:31.344769 26158 raft_consensus.cc:2243] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:31.345191 26158 raft_consensus.cc:2272] T 21adf333c4984a7cbaf1c242a5cdde45 P a86510412ae340b5b2136af5495808db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.358623 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:13:31.370301 26158 master.cc:562] Master@127.25.139.190:35999 shutting down...
I20260709 13:13:31.387432 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:31.387948 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:31.388219 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P 223762a5c68b44bea599b47d5966b6d8: stopping tablet replica
I20260709 13:13:31.406538 26158 master.cc:584] Master@127.25.139.190:35999 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2554 ms)
[----------] 6 tests from LeaderRebalancerTest (335457 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:31.435863 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:39493
I20260709 13:13:31.436898 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.441952  3798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.442414  3799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.445156 26158 server_base.cc:1061] running on GCE node
W20260709 13:13:31.445117  3801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.446473 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.446784 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.446977 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602811446956 us; error 0 us; skew 500 ppm
I20260709 13:13:31.447726 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.450261 26158 webserver.cc:533] Webserver started at http://127.25.139.190:39407/ using document root <none> and password file <none>
I20260709 13:13:31.450786 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.450990 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.451315 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.452399 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "340bd6f2019e476d9a8678e32fee9dd9"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.456898 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:31.460361  3806 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.461438 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:31.461711 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "340bd6f2019e476d9a8678e32fee9dd9"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.461987 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.490706 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.491801 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.529729 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:39493
I20260709 13:13:31.529822  3857 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:39493 every 8 connection(s)
I20260709 13:13:31.533828  3858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:31.545625  3858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: Bootstrap starting.
I20260709 13:13:31.550561  3858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:31.554782  3858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: No bootstrap required, opened a new log
I20260709 13:13:31.557127  3858 raft_consensus.cc:359] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER }
I20260709 13:13:31.557583  3858 raft_consensus.cc:385] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:31.557830  3858 raft_consensus.cc:740] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 340bd6f2019e476d9a8678e32fee9dd9, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.558552  3858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER }
I20260709 13:13:31.559074  3858 raft_consensus.cc:399] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:31.559388  3858 raft_consensus.cc:493] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:31.559680  3858 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:31.564875  3858 raft_consensus.cc:515] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER }
I20260709 13:13:31.565451  3858 leader_election.cc:304] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 340bd6f2019e476d9a8678e32fee9dd9; no voters: 
I20260709 13:13:31.566677  3858 leader_election.cc:290] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:31.566998  3861 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:31.568486  3861 raft_consensus.cc:697] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 1 LEADER]: Becoming Leader. State: Replica: 340bd6f2019e476d9a8678e32fee9dd9, State: Running, Role: LEADER
I20260709 13:13:31.569226  3861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER }
I20260709 13:13:31.569933  3858 sys_catalog.cc:565] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:31.572299  3862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "340bd6f2019e476d9a8678e32fee9dd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER } }
I20260709 13:13:31.572340  3863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 340bd6f2019e476d9a8678e32fee9dd9. Latest consensus state: current_term: 1 leader_uuid: "340bd6f2019e476d9a8678e32fee9dd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "340bd6f2019e476d9a8678e32fee9dd9" member_type: VOTER } }
I20260709 13:13:31.573159  3862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:31.573168  3863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:31.576326  3867 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:31.581262  3867 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:31.590307 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:31.592650  3867 catalog_manager.cc:1383] Generated new cluster ID: 9c67bf11c6c74465a39d9ad998b8d83c
I20260709 13:13:31.592975  3867 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:31.676347  3867 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:31.677867  3867 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:31.690790  3867 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: Generated new TSK 0
I20260709 13:13:31.691525  3867 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:31.721999 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.727952  3879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.729426  3880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.730811  3882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.731367 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:31.732225 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.732450 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.732620 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602811732598 us; error 0 us; skew 500 ppm
I20260709 13:13:31.733177 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.735683 26158 webserver.cc:533] Webserver started at http://127.25.139.129:39215/ using document root <none> and password file <none>
I20260709 13:13:31.736232 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.736457 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.736764 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.737974 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "e80d9cbe545f430db37e3e1785b63752"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.743034 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:13:31.746538  3887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.747367 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:13:31.747680 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "e80d9cbe545f430db37e3e1785b63752"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.747989 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.767345 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.768522 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.769908 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.772537 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.772773 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.773013 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.773187 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.812034 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:33479
I20260709 13:13:31.812136  3949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:33479 every 8 connection(s)
I20260709 13:13:31.816993 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.823558  3954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.825393  3955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.827358  3957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.827690 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:31.828774  3950 heartbeater.cc:344] Connected to a master server at 127.25.139.190:39493
I20260709 13:13:31.829191  3950 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.829555 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.829829 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.829932  3950 heartbeater.cc:507] Master 127.25.139.190:39493 requested a full tablet report, sending...
I20260709 13:13:31.830014 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602811829980 us; error 0 us; skew 500 ppm
I20260709 13:13:31.830926 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.832708  3823 ts_manager.cc:194] Registered new tserver with Master: e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479)
I20260709 13:13:31.833832 26158 webserver.cc:533] Webserver started at http://127.25.139.130:43467/ using document root <none> and password file <none>
I20260709 13:13:31.834564 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.834815 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.835103 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.835256  3823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52604
I20260709 13:13:31.836656 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.841042 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:31.844269  3962 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.844961 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:31.845256 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.845541 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.856050 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.857131 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.858549 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.860762 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.860985 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.861232 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.861409 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.899041 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:46065
I20260709 13:13:31.899156  4024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:46065 every 8 connection(s)
I20260709 13:13:31.904006 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.911931  4029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.912837  4028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.914008  4031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.915225 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:31.916168 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.916441 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.916649 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602811916631 us; error 0 us; skew 500 ppm
I20260709 13:13:31.917014  4025 heartbeater.cc:344] Connected to a master server at 127.25.139.190:39493
I20260709 13:13:31.917369 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.917477  4025 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.918493  4025 heartbeater.cc:507] Master 127.25.139.190:39493 requested a full tablet report, sending...
I20260709 13:13:31.920367 26158 webserver.cc:533] Webserver started at http://127.25.139.131:38587/ using document root <none> and password file <none>
I20260709 13:13:31.920657  3823 ts_manager.cc:194] Registered new tserver with Master: aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:31.920977 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.921260 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:31.921527 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:31.922191  3823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52608
I20260709 13:13:31.922628 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "2ec90502e3764edea9b2d92b64c9ab68"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.927018 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:13:31.930210  4036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.930999 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:13:31.931342 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "2ec90502e3764edea9b2d92b64c9ab68"
format_stamp: "Formatted at 2026-07-09 13:13:31 on dist-test-slave-v5z2"
I20260709 13:13:31.931639 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.961956 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.963052 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.964285 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.966437 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:31.966674 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.966917 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:31.967090 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:32.006209 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:43285
I20260709 13:13:32.006313  4098 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:43285 every 8 connection(s)
I20260709 13:13:32.019678  4099 heartbeater.cc:344] Connected to a master server at 127.25.139.190:39493
I20260709 13:13:32.020068  4099 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:32.020809  4099 heartbeater.cc:507] Master 127.25.139.190:39493 requested a full tablet report, sending...
I20260709 13:13:32.022909  3823 ts_manager.cc:194] Registered new tserver with Master: 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.023141 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013683395s
I20260709 13:13:32.024359  3823 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52612
I20260709 13:13:32.047238  3823 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52626:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:32.049871  3823 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:32.112818  3990 tablet_service.cc:1511] Processing CreateTablet for tablet d3661e39f4f7452b8ecd34862d1ba641 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:32.113420  3989 tablet_service.cc:1511] Processing CreateTablet for tablet e164608b4e1843498a96d8f0c1a2c832 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:32.114205  3990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3661e39f4f7452b8ecd34862d1ba641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.115214  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164608b4e1843498a96d8f0c1a2c832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.117303  3988 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1f140580f943c3966975f4733f5d13 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:32.118688  3988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1f140580f943c3966975f4733f5d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.126760  3987 tablet_service.cc:1511] Processing CreateTablet for tablet ace111d9adbe4f8a9bfbdef1e500df8d (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:32.128222  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace111d9adbe4f8a9bfbdef1e500df8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.138423  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 11050dd72827424f9b2b3a22f625054f (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:32.140318  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1a52bf4f46c8b10bd29b70231ee6 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:32.141217  4062 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1f140580f943c3966975f4733f5d13 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:32.142632  4062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1f140580f943c3966975f4733f5d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.142347  4064 tablet_service.cc:1511] Processing CreateTablet for tablet d3661e39f4f7452b8ecd34862d1ba641 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:32.143667  4064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3661e39f4f7452b8ecd34862d1ba641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.144213  4060 tablet_service.cc:1511] Processing CreateTablet for tablet 11050dd72827424f9b2b3a22f625054f (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:32.145512  4060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11050dd72827424f9b2b3a22f625054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.146252  4063 tablet_service.cc:1511] Processing CreateTablet for tablet e164608b4e1843498a96d8f0c1a2c832 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:32.147580  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164608b4e1843498a96d8f0c1a2c832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.148231  4058 tablet_service.cc:1511] Processing CreateTablet for tablet a70d383f5a564baaad673830ebc1bf41 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:32.149507  4058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70d383f5a564baaad673830ebc1bf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.152448  3909 tablet_service.cc:1511] Processing CreateTablet for tablet a70d383f5a564baaad673830ebc1bf41 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:32.152721  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 6d1f140580f943c3966975f4733f5d13 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:32.153136  3908 tablet_service.cc:1511] Processing CreateTablet for tablet 8a836cc25c084483998ab7eaae78e234 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:32.153810  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70d383f5a564baaad673830ebc1bf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.154430  3908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a836cc25c084483998ab7eaae78e234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.154940  3912 tablet_service.cc:1511] Processing CreateTablet for tablet ace111d9adbe4f8a9bfbdef1e500df8d (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:32.156291  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace111d9adbe4f8a9bfbdef1e500df8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.156183  3914 tablet_service.cc:1511] Processing CreateTablet for tablet e164608b4e1843498a96d8f0c1a2c832 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:32.157684  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e164608b4e1843498a96d8f0c1a2c832. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.157366  3911 tablet_service.cc:1511] Processing CreateTablet for tablet 11050dd72827424f9b2b3a22f625054f (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:32.158715  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11050dd72827424f9b2b3a22f625054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.159453  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc5915361e46239d97a9960e0028cb (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:32.160211  3915 tablet_service.cc:1511] Processing CreateTablet for tablet d3661e39f4f7452b8ecd34862d1ba641 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:32.160658  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc5915361e46239d97a9960e0028cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.161440  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3661e39f4f7452b8ecd34862d1ba641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.156301  3910 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1a52bf4f46c8b10bd29b70231ee6 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:32.164584  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1a52bf4f46c8b10bd29b70231ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.164247  4061 tablet_service.cc:1511] Processing CreateTablet for tablet ace111d9adbe4f8a9bfbdef1e500df8d (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:32.165596  4061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace111d9adbe4f8a9bfbdef1e500df8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.167909  4059 tablet_service.cc:1511] Processing CreateTablet for tablet 79eb1a52bf4f46c8b10bd29b70231ee6 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:32.169216  4059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1a52bf4f46c8b10bd29b70231ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.171216  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1f140580f943c3966975f4733f5d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.172605  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 8a836cc25c084483998ab7eaae78e234 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:32.173871  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a836cc25c084483998ab7eaae78e234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.140089  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11050dd72827424f9b2b3a22f625054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.176198  4056 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc5915361e46239d97a9960e0028cb (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:32.177467  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc5915361e46239d97a9960e0028cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.180485  3984 tablet_service.cc:1511] Processing CreateTablet for tablet a70d383f5a564baaad673830ebc1bf41 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:32.180902  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 8a836cc25c084483998ab7eaae78e234 (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:32.181855  3984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a70d383f5a564baaad673830ebc1bf41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.183061  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 80bc5915361e46239d97a9960e0028cb (DEFAULT_TABLE table=test-workload [id=00c459b7f6784aef9595538a9efda474]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:32.184466  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bc5915361e46239d97a9960e0028cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.187433  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79eb1a52bf4f46c8b10bd29b70231ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.188102  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a836cc25c084483998ab7eaae78e234. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:32.211771  4114 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.225281  4114 tablet_bootstrap.cc:654] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.274964  4115 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.308981  4117 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.310487  4114 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.311028  4114 ts_tablet_manager.cc:1403] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.023s
I20260709 13:13:32.312587  4115 tablet_bootstrap.cc:654] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.313962  4114 raft_consensus.cc:359] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.314839  4114 raft_consensus.cc:385] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.315200  4114 raft_consensus.cc:740] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.315738  4117 tablet_bootstrap.cc:654] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.316735  4115 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.316257  4114 consensus_queue.cc:260] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.317236  4115 ts_tablet_manager.cc:1403] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.043s	user 0.004s	sys 0.006s
I20260709 13:13:32.318791  4025 heartbeater.cc:499] Master 127.25.139.190:39493 was elected leader, sending a full tablet report...
I20260709 13:13:32.319464  4114 ts_tablet_manager.cc:1434] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:32.320521  4114 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.321306  4117 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.321379  4115 raft_consensus.cc:359] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.321969  4117 ts_tablet_manager.cc:1403] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:13:32.322331  4115 raft_consensus.cc:385] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.322741  4115 raft_consensus.cc:740] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.323549  4115 consensus_queue.cc:260] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.325904  3950 heartbeater.cc:499] Master 127.25.139.190:39493 was elected leader, sending a full tablet report...
I20260709 13:13:32.326426  4115 ts_tablet_manager.cc:1434] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:13:32.326493  4114 tablet_bootstrap.cc:654] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.327795  4115 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.334142  4115 tablet_bootstrap.cc:654] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.336102  4117 raft_consensus.cc:359] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.340377  4117 raft_consensus.cc:385] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.340723  4117 raft_consensus.cc:740] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.341595  4117 consensus_queue.cc:260] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.342057  4115 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.342733  4115 ts_tablet_manager.cc:1403] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:32.347132  4115 raft_consensus.cc:359] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.349502  4115 raft_consensus.cc:385] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.349967  4115 raft_consensus.cc:740] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.350986  4114 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.351773  4114 ts_tablet_manager.cc:1403] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.015s
I20260709 13:13:32.350947  4115 consensus_queue.cc:260] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.354526  4115 ts_tablet_manager.cc:1434] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:32.355086  4114 raft_consensus.cc:359] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.355834  4115 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.355969  4114 raft_consensus.cc:385] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.356603  4114 raft_consensus.cc:740] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.357646  4114 consensus_queue.cc:260] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.360477  4114 ts_tablet_manager.cc:1434] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:13:32.361773  4114 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.364337  4115 tablet_bootstrap.cc:654] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.368213  4114 tablet_bootstrap.cc:654] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.381469  4099 heartbeater.cc:499] Master 127.25.139.190:39493 was elected leader, sending a full tablet report...
I20260709 13:13:32.382130  4117 ts_tablet_manager.cc:1434] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.060s	user 0.027s	sys 0.017s
I20260709 13:13:32.383118  4117 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.384680  4115 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.385272  4115 ts_tablet_manager.cc:1403] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 13:13:32.388180  4115 raft_consensus.cc:359] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.388986  4114 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.389226  4117 tablet_bootstrap.cc:654] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.388984  4115 raft_consensus.cc:385] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.389779  4114 ts_tablet_manager.cc:1403] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.012s
I20260709 13:13:32.389966  4115 raft_consensus.cc:740] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.391029  4115 consensus_queue.cc:260] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.393256  4114 raft_consensus.cc:359] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.394191  4114 raft_consensus.cc:385] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.394533  4114 raft_consensus.cc:740] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.395520  4114 consensus_queue.cc:260] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.398044  4114 ts_tablet_manager.cc:1434] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:32.398188  4115 ts_tablet_manager.cc:1434] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:13:32.399281  4114 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.399468  4115 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.400863  4117 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.401439  4117 ts_tablet_manager.cc:1403] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:13:32.404255  4117 raft_consensus.cc:359] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.405112  4117 raft_consensus.cc:385] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.405452  4117 raft_consensus.cc:740] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.406088  4115 tablet_bootstrap.cc:654] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.406527  4117 consensus_queue.cc:260] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.408308  4114 tablet_bootstrap.cc:654] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.409400  4117 ts_tablet_manager.cc:1434] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:13:32.410763  4117 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.417793  4115 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.418072  4117 tablet_bootstrap.cc:654] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.418494  4115 ts_tablet_manager.cc:1403] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 13:13:32.420583  4114 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.421295  4114 ts_tablet_manager.cc:1403] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:13:32.422186  4115 raft_consensus.cc:359] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.423267  4115 raft_consensus.cc:385] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.423834  4115 raft_consensus.cc:740] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.424715  4114 raft_consensus.cc:359] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.425639  4114 raft_consensus.cc:385] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.425081  4115 consensus_queue.cc:260] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.426067  4114 raft_consensus.cc:740] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.427201  4114 consensus_queue.cc:260] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.428783  4115 ts_tablet_manager.cc:1434] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:13:32.431876  4114 ts_tablet_manager.cc:1434] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:13:32.432461  4115 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.433192  4114 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.441216  4115 tablet_bootstrap.cc:654] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.442202  4114 tablet_bootstrap.cc:654] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.443763  4117 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.444507  4117 ts_tablet_manager.cc:1403] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.015s
I20260709 13:13:32.448832  4117 raft_consensus.cc:359] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.449903  4117 raft_consensus.cc:385] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.450289  4117 raft_consensus.cc:740] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.451288  4117 consensus_queue.cc:260] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.452790  4115 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.453425  4115 ts_tablet_manager.cc:1403] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 13:13:32.454011  4117 ts_tablet_manager.cc:1434] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:32.455189  4117 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.456578  4115 raft_consensus.cc:359] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.457525  4115 raft_consensus.cc:385] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.457912  4115 raft_consensus.cc:740] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.458863  4115 consensus_queue.cc:260] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.461556  4115 ts_tablet_manager.cc:1434] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:32.462433  4117 tablet_bootstrap.cc:654] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.462641  4115 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.471256  4115 tablet_bootstrap.cc:654] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.474596  4117 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.475446  4117 ts_tablet_manager.cc:1403] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:13:32.476377  4121 raft_consensus.cc:493] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.476934  4121 raft_consensus.cc:515] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.478694  4117 raft_consensus.cc:359] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.479660  4117 raft_consensus.cc:385] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.480038  4117 raft_consensus.cc:740] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.480979  4117 consensus_queue.cc:260] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.486876  4117 ts_tablet_manager.cc:1434] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:32.487318  4121 leader_election.cc:290] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.488237  4117 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.504964  4117 tablet_bootstrap.cc:654] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.507036  4114 tablet_bootstrap.cc:492] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.507814  4114 ts_tablet_manager.cc:1403] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.075s	user 0.040s	sys 0.032s
I20260709 13:13:32.509291  4115 tablet_bootstrap.cc:492] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.513339  4117 tablet_bootstrap.cc:492] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.515488  4115 ts_tablet_manager.cc:1403] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.011s
I20260709 13:13:32.515600  4117 ts_tablet_manager.cc:1403] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.000s
I20260709 13:13:32.513399  4114 raft_consensus.cc:359] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.516849  4114 raft_consensus.cc:385] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.517256  4114 raft_consensus.cc:740] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.518376  4114 consensus_queue.cc:260] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.518839  4117 raft_consensus.cc:359] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.519691  4117 raft_consensus.cc:385] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.520066  4117 raft_consensus.cc:740] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.520864  4117 consensus_queue.cc:260] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.521402  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
W20260709 13:13:32.523065  3891 leader_election.cc:343] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.523221  4117 ts_tablet_manager.cc:1434] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:13:32.524384  4117 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.525383  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
W20260709 13:13:32.527048  3889 leader_election.cc:343] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.527580  3889 leader_election.cc:304] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:32.527951  4114 ts_tablet_manager.cc:1434] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 13:13:32.528409  4121 raft_consensus.cc:2749] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.529243  4121 raft_consensus.cc:493] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.529657  4121 raft_consensus.cc:515] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.530913  4115 raft_consensus.cc:359] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.531548  4114 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.531672  4115 raft_consensus.cc:385] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.531746  4121 leader_election.cc:290] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.533090  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
W20260709 13:13:32.534837  3889 leader_election.cc:343] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.532202  4115 raft_consensus.cc:740] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.535540  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.535941  4117 tablet_bootstrap.cc:654] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:32.537500  3891 leader_election.cc:343] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.538118  3891 leader_election.cc:304] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:32.538973  4121 raft_consensus.cc:2749] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:32.537189  4115 consensus_queue.cc:260] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.540108  4114 tablet_bootstrap.cc:654] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.542256  4115 ts_tablet_manager.cc:1434] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:13:32.543351  4115 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.543990  4119 raft_consensus.cc:493] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.544703  4119 raft_consensus.cc:515] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.551783  4115 tablet_bootstrap.cc:654] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.552889  4117 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.553735  4117 ts_tablet_manager.cc:1403] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.012s
I20260709 13:13:32.558043  4117 raft_consensus.cc:359] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.558770  4119 leader_election.cc:290] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285), e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479)
I20260709 13:13:32.559032  4117 raft_consensus.cc:385] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.564234  4117 raft_consensus.cc:740] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.566736  4117 consensus_queue.cc:260] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.569555  4117 ts_tablet_manager.cc:1434] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:13:32.567768  4114 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.570577  4114 ts_tablet_manager.cc:1403] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 13:13:32.570844  4117 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.573487  4115 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.574203  4115 ts_tablet_manager.cc:1403] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.011s
I20260709 13:13:32.573783  4114 raft_consensus.cc:359] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.574751  4114 raft_consensus.cc:385] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.581756  4114 raft_consensus.cc:740] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.582602  4117 tablet_bootstrap.cc:654] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.582809  4114 consensus_queue.cc:260] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.577891  4115 raft_consensus.cc:359] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.584049  4115 raft_consensus.cc:385] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.580286  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.584506  4115 raft_consensus.cc:740] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.584743  4074 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.585319  4114 ts_tablet_manager.cc:1434] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:13:32.585392  4115 consensus_queue.cc:260] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.586491  4114 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
W20260709 13:13:32.584797  3871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:32.593556  4115 ts_tablet_manager.cc:1434] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:13:32.594833  4115 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.595743  3966 leader_election.cc:304] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:32.596859  4119 raft_consensus.cc:2804] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.597312  4119 raft_consensus.cc:493] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.597692  4119 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.600874  4114 tablet_bootstrap.cc:654] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.606774  4119 raft_consensus.cc:515] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.612488  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.613128  4074 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.616659  4115 tablet_bootstrap.cc:654] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.621889  4074 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.638131  3966 leader_election.cc:304] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:32.636124  4119 leader_election.cc:290] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285), e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479)
I20260709 13:13:32.651954  4119 raft_consensus.cc:493] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.652721  4119 raft_consensus.cc:515] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.660763  4119 leader_election.cc:290] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.672948  4119 raft_consensus.cc:493] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.666790  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.668666  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.676891  4117 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.677588  4117 ts_tablet_manager.cc:1403] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.107s	user 0.033s	sys 0.053s
I20260709 13:13:32.678148  4114 tablet_bootstrap.cc:492] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.670542  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.678715  4114 ts_tablet_manager.cc:1403] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.092s	user 0.037s	sys 0.045s
I20260709 13:13:32.678974  3923 raft_consensus.cc:2468] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.676918  3925 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.680814  4117 raft_consensus.cc:359] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.681707  4117 raft_consensus.cc:385] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.671613  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.682139  4117 raft_consensus.cc:740] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.681782  4114 raft_consensus.cc:359] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.682678  4074 raft_consensus.cc:2468] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.682690  4114 raft_consensus.cc:385] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.683524  4114 raft_consensus.cc:740] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.684657  3966 leader_election.cc:304] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:32.684515  4114 consensus_queue.cc:260] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.683130  4117 consensus_queue.cc:260] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.663403  4146 raft_consensus.cc:2804] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.691493  4121 raft_consensus.cc:493] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.692167  4121 raft_consensus.cc:515] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.692574  4147 raft_consensus.cc:2804] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.693109  4147 raft_consensus.cc:493] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.693539  4147 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.693198  4119 raft_consensus.cc:515] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.694607  4121 leader_election.cc:290] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.697393  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:32.698192  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.699051  4074 raft_consensus.cc:2468] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 0.
W20260709 13:13:32.699957  3889 leader_election.cc:343] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.700718  3891 leader_election.cc:304] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:32.701490  4117 ts_tablet_manager.cc:1434] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:13:32.702805  4117 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.702608  4121 raft_consensus.cc:2804] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.704171  4121 raft_consensus.cc:493] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.704694  4121 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.718739  4149 raft_consensus.cc:493] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.722231  4149 raft_consensus.cc:515] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.687613  4114 ts_tablet_manager.cc:1434] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.002s
I20260709 13:13:32.725304  4114 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.725353  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.726446  4115 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.727025  4115 ts_tablet_manager.cc:1403] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.132s	user 0.057s	sys 0.045s
W20260709 13:13:32.727085  3965 leader_election.cc:343] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.727258  4117 tablet_bootstrap.cc:654] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.729660  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70d383f5a564baaad673830ebc1bf41" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.729882  4115 raft_consensus.cc:359] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.730273  3925 raft_consensus.cc:2468] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.730618  4115 raft_consensus.cc:385] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.730890  4115 raft_consensus.cc:740] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.731494  3965 leader_election.cc:304] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.731698  4115 consensus_queue.cc:260] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.734895  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70d383f5a564baaad673830ebc1bf41" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.735867  4074 raft_consensus.cc:2468] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.736620  4147 raft_consensus.cc:515] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.721545  4146 raft_consensus.cc:697] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.738617  4124 raft_consensus.cc:493] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.739259  4148 raft_consensus.cc:2804] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.739153  4124 raft_consensus.cc:515] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.740753  4148 raft_consensus.cc:493] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.741328  4148 raft_consensus.cc:3060] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.732920  4119 leader_election.cc:290] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.738384  4146 consensus_queue.cc:237] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:32.748438  4147 leader_election.cc:290] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.748927  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.749828  4074 raft_consensus.cc:2468] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.739648  4117 tablet_bootstrap.cc:492] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:32.748522  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.751483  4117 ts_tablet_manager.cc:1403] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.013s
I20260709 13:13:32.752008  3925 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.756366  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.757300  4074 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.760870  3966 leader_election.cc:304] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:32.768538  4147 raft_consensus.cc:2804] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.769160  4147 raft_consensus.cc:493] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.769695  4147 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.770568  4119 raft_consensus.cc:493] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.771302  4119 raft_consensus.cc:515] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.775233  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.775666  4119 leader_election.cc:290] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.776086  3923 raft_consensus.cc:2468] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.777860  3965 leader_election.cc:304] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.778888  4119 raft_consensus.cc:2804] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.779415  4119 raft_consensus.cc:493] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.779876  4119 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.790213  4121 raft_consensus.cc:515] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.792567  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.795464  4149 leader_election.cc:290] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.793815  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
W20260709 13:13:32.796553  3966 leader_election.cc:343] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.797556  4115 ts_tablet_manager.cc:1434] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.070s	user 0.025s	sys 0.035s
W20260709 13:13:32.797868  3889 leader_election.cc:343] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.794726  4114 tablet_bootstrap.cc:654] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.791896  4117 raft_consensus.cc:359] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.799605  4117 raft_consensus.cc:385] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.799907  4117 raft_consensus.cc:740] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.800333  4121 leader_election.cc:290] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.792915  4124 leader_election.cc:290] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:32.802328  4154 raft_consensus.cc:493] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.802933  4154 raft_consensus.cc:515] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.803851  4149 raft_consensus.cc:493] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.804473  4149 raft_consensus.cc:515] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.805796  4115 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:32.806385  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.807073  4073 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.807371  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.813751  4115 tablet_bootstrap.cc:654] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.815110  3923 raft_consensus.cc:2468] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.816114  4073 raft_consensus.cc:2468] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 1.
I20260709 13:13:32.823210  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.823882  3891 leader_election.cc:304] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:32.824014  3923 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 0.
I20260709 13:13:32.825080  4115 tablet_bootstrap.cc:492] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:32.825243  3965 leader_election.cc:304] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.825599  4115 ts_tablet_manager.cc:1403] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:13:32.826203  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:32.826941  3923 raft_consensus.cc:2468] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 0.
I20260709 13:13:32.827641  4114 tablet_bootstrap.cc:492] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:32.828148  4114 ts_tablet_manager.cc:1403] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.007s
I20260709 13:13:32.828521  4115 raft_consensus.cc:359] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.828889  4117 consensus_queue.cc:260] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.829488  4115 raft_consensus.cc:385] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.829873  4115 raft_consensus.cc:740] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.831022  4115 consensus_queue.cc:260] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.831135  4114 raft_consensus.cc:359] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.831192  4121 raft_consensus.cc:2804] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.832152  4114 raft_consensus.cc:385] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:32.832535  4114 raft_consensus.cc:740] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:32.833424  4115 ts_tablet_manager.cc:1434] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:32.833302  4114 consensus_queue.cc:260] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.835145  4121 raft_consensus.cc:697] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:32.840663  4121 consensus_queue.cc:237] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.839582  4146 raft_consensus.cc:2804] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.824630  4119 raft_consensus.cc:515] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.841964  3822 catalog_manager.cc:5697] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.843405  4146 raft_consensus.cc:493] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.844195  4146 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.845335  4119 leader_election.cc:290] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.844240  4117 ts_tablet_manager.cc:1434] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.092s	user 0.011s	sys 0.002s
I20260709 13:13:32.828588  4039 leader_election.cc:304] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.846932  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.847941  4124 raft_consensus.cc:2804] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.848114  3923 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.848404  4124 raft_consensus.cc:493] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.848846  4124 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.853223  4117 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:32.852200  4149 leader_election.cc:290] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.854524  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.855792  4072 raft_consensus.cc:2468] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:32.857339  4151 raft_consensus.cc:493] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:32.855060  4154 leader_election.cc:290] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:32.857931  4151 raft_consensus.cc:515] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.860809  4151 leader_election.cc:290] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.860929  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:32.862887  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:32.863621  4072 raft_consensus.cc:2468] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 0.
I20260709 13:13:32.854005  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.864804  3891 leader_election.cc:304] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
W20260709 13:13:32.865427  3966 leader_election.cc:343] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.866686  4124 raft_consensus.cc:515] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.867395  4151 raft_consensus.cc:2804] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.868633  4151 raft_consensus.cc:493] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.868993  4151 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.869207  3925 raft_consensus.cc:2468] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.869503  4124 leader_election.cc:290] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:32.863453  4039 leader_election.cc:304] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.870456  3965 leader_election.cc:304] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.871284  3923 raft_consensus.cc:2468] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.871431  4149 raft_consensus.cc:2804] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.872282  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.872792  3965 leader_election.cc:304] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:32.873028  3924 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.872845  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:32.873317  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:32.873872  4119 raft_consensus.cc:2804] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.873919  3999 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 0.
I20260709 13:13:32.874454  4119 raft_consensus.cc:697] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.875507  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
W20260709 13:13:32.875829  4038 leader_election.cc:343] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.876168  3999 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.875828  4119 consensus_queue.cc:237] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.864967  4114 ts_tablet_manager.cc:1434] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:13:32.878232  4114 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:32.858570  4147 raft_consensus.cc:515] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.879031  4149 raft_consensus.cc:697] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.882997  4074 raft_consensus.cc:2468] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.884289  4149 consensus_queue.cc:237] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.885007  3924 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 1.
I20260709 13:13:32.886073  4039 leader_election.cc:304] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.887053  4154 raft_consensus.cc:2804] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.887670  4000 raft_consensus.cc:2393] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in this term.
I20260709 13:13:32.891669  4114 tablet_bootstrap.cc:654] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.881265  4124 raft_consensus.cc:2804] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:32.894115  4124 raft_consensus.cc:493] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:32.901531  4124 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.900976  4154 raft_consensus.cc:697] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:32.891800  4148 raft_consensus.cc:515] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.907064  4148 leader_election.cc:290] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.907847  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70d383f5a564baaad673830ebc1bf41" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.908499  3924 raft_consensus.cc:3060] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.908867  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a70d383f5a564baaad673830ebc1bf41" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.909498  4074 raft_consensus.cc:3060] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.909794  4146 raft_consensus.cc:515] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.916270  4117 tablet_bootstrap.cc:654] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:32.917210  4154 consensus_queue.cc:237] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.922930  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.922784  4147 leader_election.cc:290] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.917972  3999 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 1.
I20260709 13:13:32.925434  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.925251  4074 raft_consensus.cc:2468] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.934909  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.938905  3923 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.939553  3966 leader_election.cc:304] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:32.941200  4147 raft_consensus.cc:2804] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.941951  3924 raft_consensus.cc:2468] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.942121  4147 raft_consensus.cc:697] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.941372  4124 raft_consensus.cc:515] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.935490  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:32.935972  4073 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.935312  4146 leader_election.cc:290] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:32.943409  4147 consensus_queue.cc:237] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.944895  4072 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:32.950765  3923 raft_consensus.cc:2468] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.952153  3965 leader_election.cc:304] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:32.953060  4146 raft_consensus.cc:2804] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.953769  4146 raft_consensus.cc:697] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.954661  4146 consensus_queue.cc:237] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.963462  4151 raft_consensus.cc:515] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:32.964743  3925 raft_consensus.cc:2393] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in current term 1: Already voted for candidate e80d9cbe545f430db37e3e1785b63752 in this term.
I20260709 13:13:32.970067  4073 raft_consensus.cc:2468] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.969168  3820 catalog_manager.cc:5697] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:32.976783  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:32.971742  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:32.978048  3923 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:32.978814  4038 leader_election.cc:343] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:32.974318  4072 raft_consensus.cc:2468] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:32.979308  3821 catalog_manager.cc:5697] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 0 to 1, leader changed from <none> to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:32.975687  4124 leader_election.cc:290] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:32.995297  3923 raft_consensus.cc:2468] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 1.
I20260709 13:13:32.996903  3966 leader_election.cc:304] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:32.997146  4039 leader_election.cc:304] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:32.997897  4147 raft_consensus.cc:2804] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.998025  4124 raft_consensus.cc:2804] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:32.998430  4147 raft_consensus.cc:697] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:32.999056  4124 raft_consensus.cc:697] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:32.999382  4147 consensus_queue.cc:237] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.006940  4151 leader_election.cc:290] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.007764  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.019986  4114 tablet_bootstrap.cc:492] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:33.020743  4114 ts_tablet_manager.cc:1403] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.011s
I20260709 13:13:33.022274  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.022706  4117 tablet_bootstrap.cc:492] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:33.023093  4073 raft_consensus.cc:2393] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in this term.
I20260709 13:13:33.023197  4117 ts_tablet_manager.cc:1403] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.036s
I20260709 13:13:33.024803  3891 leader_election.cc:304] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:33.026384  4117 raft_consensus.cc:359] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.027364  4117 raft_consensus.cc:385] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.027694  4117 raft_consensus.cc:740] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.027990  4114 raft_consensus.cc:359] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.028127  3822 catalog_manager.cc:5697] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.029165  4114 raft_consensus.cc:385] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:33.028566  4117 consensus_queue.cc:260] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.029608  4114 raft_consensus.cc:740] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:33.000011  4124 consensus_queue.cc:237] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.031105  4117 ts_tablet_manager.cc:1434] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:33.030592  4114 consensus_queue.cc:260] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.031755  4151 raft_consensus.cc:2749] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.030179  3822 catalog_manager.cc:5697] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.039294  4114 ts_tablet_manager.cc:1434] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 13:13:33.036172  3822 catalog_manager.cc:5697] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.040592  3822 catalog_manager.cc:5697] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.044302  3821 catalog_manager.cc:5697] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.060117  3821 catalog_manager.cc:5697] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.105383  4147 raft_consensus.cc:493] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.105923  4147 raft_consensus.cc:515] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.107704  4147 leader_election.cc:290] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.108789  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:33.108922  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:33.109649  4073 raft_consensus.cc:2393] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in current term 1: Already voted for candidate e80d9cbe545f430db37e3e1785b63752 in this term.
I20260709 13:13:33.110749  3966 leader_election.cc:304] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.111511  4147 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.116293  4147 raft_consensus.cc:2749] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.243146  3923 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.250311  4147 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.250733  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:33.251415  3999 raft_consensus.cc:606] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.257853  4146 raft_consensus.cc:993] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.258031  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:33.258410  4146 raft_consensus.cc:1081] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.258731  3999 raft_consensus.cc:606] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.261300  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:33.261840  3925 raft_consensus.cc:493] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.262161  3925 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.262928  4072 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.264118  4149 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.270816  3925 raft_consensus.cc:515] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:33.271708  4147 consensus_queue.cc:1048] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.272359  3923 raft_consensus.cc:1240] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Rejecting Update request from peer aba9e4a9b8c14b4b9f8db3f9b8d0227f for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.273542  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:33.273916  4147 consensus_queue.cc:1059] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.274528  3999 raft_consensus.cc:606] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.274896  4149 raft_consensus.cc:3055] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.275156  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.275390  4149 raft_consensus.cc:740] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.276232  4149 consensus_queue.cc:260] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:33.276719  3925 leader_election.cc:290] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.277190  4149 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.277552  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.300662  4147 consensus_queue.cc:1048] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.301970  4072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:40298
I20260709 13:13:33.302824  4072 raft_consensus.cc:606] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.310784  4073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
mode: GRACEFUL
new_leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:40298
I20260709 13:13:33.310940  4000 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.311487  4073 raft_consensus.cc:606] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Received request to transfer leadership to TS aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:33.312841  3889 leader_election.cc:304] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:33.314113  4151 raft_consensus.cc:2804] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.314597  4151 raft_consensus.cc:697] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:33.315006  4147 raft_consensus.cc:993] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.316022  4147 raft_consensus.cc:1081] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.315454  4151 consensus_queue.cc:237] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:33.317595  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:33.318161  3925 raft_consensus.cc:493] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.318512  3925 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.325292  3925 raft_consensus.cc:515] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.328202  3925 leader_election.cc:290] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.329587  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.329584  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d1f140580f943c3966975f4733f5d13" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.330421  4073 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.330497  4000 raft_consensus.cc:3055] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.330919  4000 raft_consensus.cc:740] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.331884  4000 consensus_queue.cc:260] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.333117  4000 raft_consensus.cc:3060] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.334928  4124 consensus_queue.cc:1048] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.337006  3822 catalog_manager.cc:5697] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.341352  4000 raft_consensus.cc:2468] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.343077  4073 raft_consensus.cc:2468] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.344504  3891 leader_election.cc:304] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:33.345311  4151 raft_consensus.cc:2804] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.345785  4151 raft_consensus.cc:697] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:33.346494  4151 consensus_queue.cc:237] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.347456  3923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
mode: GRACEFUL
new_leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:39870
I20260709 13:13:33.347882  4154 raft_consensus.cc:993] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.348279  3923 raft_consensus.cc:606] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Received request to transfer leadership to TS aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:33.348368  4154 raft_consensus.cc:1081] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.350206  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39862
I20260709 13:13:33.350961  3924 raft_consensus.cc:493] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.351378  3924 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.353924  4163 consensus_queue.cc:1048] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.356833  4147 consensus_queue.cc:1048] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.366523  3924 raft_consensus.cc:515] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.369143  4000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:33.370373  4000 raft_consensus.cc:606] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:33.369524  4160 raft_consensus.cc:993] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.371574  4119 raft_consensus.cc:1081] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:33.376005  3925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:33.376593  3925 raft_consensus.cc:493] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.377008  3925 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.377600  4119 consensus_queue.cc:1048] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.377779  4000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.378448  4000 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.380656  3821 catalog_manager.cc:5697] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.387450  3925 raft_consensus.cc:515] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.387821  3924 leader_election.cc:290] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.388984  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace111d9adbe4f8a9bfbdef1e500df8d" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.389616  4072 raft_consensus.cc:3055] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.389940  4072 raft_consensus.cc:740] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:33.390728  3925 leader_election.cc:290] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.391111  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.393620  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e164608b4e1843498a96d8f0c1a2c832" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.390758  4072 consensus_queue.cc:260] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.394194  3999 raft_consensus.cc:3055] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.394520  3999 raft_consensus.cc:740] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.394865  4072 raft_consensus.cc:3060] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.395340  3999 consensus_queue.cc:260] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.396504  3999 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.402210  4119 raft_consensus.cc:493] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:33.402745  4119 raft_consensus.cc:515] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.404914  4119 leader_election.cc:290] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.405779  4119 consensus_queue.cc:1048] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.408892  4000 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.410775  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:33.413187  3925 raft_consensus.cc:2393] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in current term 1: Already voted for candidate 2ec90502e3764edea9b2d92b64c9ab68 in this term.
I20260709 13:13:33.413419  3889 leader_election.cc:304] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:33.409767  3999 raft_consensus.cc:2468] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.414240  4119 consensus_queue.cc:1048] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:33.411909  4072 raft_consensus.cc:2468] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:33.415772  3889 leader_election.cc:304] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:33.416551  4121 raft_consensus.cc:2804] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.410214  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:33.414633  4151 raft_consensus.cc:2804] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.418213  3966 leader_election.cc:304] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.419747  4119 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:33.425460  4121 raft_consensus.cc:697] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:33.424268  4192 consensus_queue.cc:1048] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:33.426492  4121 consensus_queue.cc:237] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.431321  4119 raft_consensus.cc:2749] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:33.441969  4148 consensus_queue.cc:1048] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.444459  4151 raft_consensus.cc:697] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:33.445609  4151 consensus_queue.cc:237] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.450606  4121 raft_consensus.cc:993] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: : Instructing follower aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:33.451315  4121 raft_consensus.cc:1081] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Signalling peer aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:33.453218  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:13:33.454442  3999 raft_consensus.cc:493] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.454924  3999 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.461853  4149 raft_consensus.cc:993] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:33.462399  4119 raft_consensus.cc:1081] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:33.461174  3822 catalog_manager.cc:5697] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.466843  4074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40296
I20260709 13:13:33.467536  4074 raft_consensus.cc:493] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.466475  4193 consensus_queue.cc:1048] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:33.467974  4074 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.471437  3999 raft_consensus.cc:515] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.472625  3998 raft_consensus.cc:1240] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Rejecting Update request from peer e80d9cbe545f430db37e3e1785b63752 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.474464  4119 consensus_queue.cc:1048] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.476119  4074 raft_consensus.cc:515] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.477298  4072 raft_consensus.cc:1240] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Rejecting Update request from peer aba9e4a9b8c14b4b9f8db3f9b8d0227f for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:33.479082  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:33.466254  3822 catalog_manager.cc:5697] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.479316  4193 consensus_queue.cc:1059] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.479985  4119 consensus_queue.cc:1059] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.480829  4119 raft_consensus.cc:3055] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.481141  4119 raft_consensus.cc:740] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.481649  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:33.482038  4119 consensus_queue.cc:260] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.484489  3924 raft_consensus.cc:3055] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.484922  3924 raft_consensus.cc:740] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:33.484978  4074 leader_election.cc:290] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:33.485848  3924 consensus_queue.cc:260] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.486795  3924 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.483021  4119 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.488900  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80bc5915361e46239d97a9960e0028cb" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:33.499845  3999 leader_election.cc:290] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.501192  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a836cc25c084483998ab7eaae78e234" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.501936  4073 raft_consensus.cc:3060] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.503332  3924 raft_consensus.cc:2468] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
W20260709 13:13:33.503938  4151 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:33.506000  3965 leader_election.cc:304] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:33.508090  3998 raft_consensus.cc:2468] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 2.
I20260709 13:13:33.510123  4038 leader_election.cc:304] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:33.511405  4119 raft_consensus.cc:2804] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.511583  4163 raft_consensus.cc:2804] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.512315  4163 raft_consensus.cc:697] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:33.512354  4119 raft_consensus.cc:697] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.513188  4073 raft_consensus.cc:2468] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:33.513536  4119 consensus_queue.cc:237] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.513422  4163 consensus_queue.cc:237] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.523371  4119 consensus_queue.cc:1048] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.523145  3819 catalog_manager.cc:5697] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 1 to 2, leader changed from e80d9cbe545f430db37e3e1785b63752 (127.25.139.129) to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 2 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.523373  3822 catalog_manager.cc:5697] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:33.541880  4160 consensus_queue.cc:1048] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.587332  4163 consensus_queue.cc:1048] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.594856  4154 raft_consensus.cc:993] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: : Instructing follower aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:33.595435  4154 raft_consensus.cc:1081] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Signalling peer aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:33.601627  4154 consensus_queue.cc:1048] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:33.602874  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:33.603551  3998 raft_consensus.cc:493] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.603951  3998 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.611611  3998 raft_consensus.cc:515] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.613466  3998 leader_election.cc:290] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:33.614454  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:33.614759  4073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11050dd72827424f9b2b3a22f625054f" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:33.615232  3924 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.615422  4073 raft_consensus.cc:3055] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.615880  4073 raft_consensus.cc:740] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:33.616596  4073 consensus_queue.cc:260] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.617580  4073 raft_consensus.cc:3060] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.620692  3924 raft_consensus.cc:2468] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:33.621809  3965 leader_election.cc:304] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:33.622527  4160 raft_consensus.cc:2804] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.622982  4160 raft_consensus.cc:697] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:33.623114  4073 raft_consensus.cc:2468] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:33.623881  4160 consensus_queue.cc:237] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:33.631323  3819 catalog_manager.cc:5697] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 1 to 2, leader changed from 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131) to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 2 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.842082  4073 raft_consensus.cc:3060] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.847970  4073 raft_consensus.cc:1275] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.849277  4151 consensus_queue.cc:1048] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.851460  4073 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.858394  3998 raft_consensus.cc:1275] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.859095  4073 raft_consensus.cc:1275] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.860045  4072 raft_consensus.cc:1275] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.861101  4193 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.861879  4191 consensus_queue.cc:1048] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.862488  4193 consensus_queue.cc:1048] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.874073  3998 raft_consensus.cc:1275] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.875957  4192 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.876497  3998 raft_consensus.cc:1275] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.878830  4192 consensus_queue.cc:1048] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.889082  4074 raft_consensus.cc:1275] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.891409  4193 consensus_queue.cc:1048] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.901862  3998 raft_consensus.cc:1275] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.904409  4191 consensus_queue.cc:1048] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.907534  3924 raft_consensus.cc:3060] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.914779  3924 raft_consensus.cc:1275] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.917775  4154 consensus_queue.cc:1048] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.930119  3998 raft_consensus.cc:1275] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.932057  4154 consensus_queue.cc:1048] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.975821  4072 raft_consensus.cc:1275] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.977244  4160 consensus_queue.cc:1048] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.977733  3925 raft_consensus.cc:1275] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.979411  4160 consensus_queue.cc:1048] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.124184  3925 raft_consensus.cc:1275] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.125325  4072 raft_consensus.cc:1275] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.125602  4160 consensus_queue.cc:1048] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.126864  4149 consensus_queue.cc:1048] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.407863  3821 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52638:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:36.410223  3821 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:36.460965  3911 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac7f7f63f446ccbe676b3da9549ad2 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:36.462077  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac7f7f63f446ccbe676b3da9549ad2 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:36.462450  3911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac7f7f63f446ccbe676b3da9549ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.463434  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac7f7f63f446ccbe676b3da9549ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.463786  4062 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac7f7f63f446ccbe676b3da9549ad2 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:36.465168  4062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac7f7f63f446ccbe676b3da9549ad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.469405  3983 tablet_service.cc:1511] Processing CreateTablet for tablet a3e252b051f24e88ae0cc0118379659e (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:36.470757  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e252b051f24e88ae0cc0118379659e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.475679  3910 tablet_service.cc:1511] Processing CreateTablet for tablet a3e252b051f24e88ae0cc0118379659e (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:36.477246  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e252b051f24e88ae0cc0118379659e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.487176  4056 tablet_service.cc:1511] Processing CreateTablet for tablet a3e252b051f24e88ae0cc0118379659e (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:36.488611  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3e252b051f24e88ae0cc0118379659e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.492841  3913 tablet_service.cc:1511] Processing CreateTablet for tablet 5b42566975eb42c2828605a69a3bcd77 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:36.494381  3913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b42566975eb42c2828605a69a3bcd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.504338  4218 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.511600  3914 tablet_service.cc:1511] Processing CreateTablet for tablet 54816fa582994d498763a814fc93f2dd (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:36.513712  4219 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.513824  4218 tablet_bootstrap.cc:654] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.514091  3914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54816fa582994d498763a814fc93f2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.520344  3986 tablet_service.cc:1511] Processing CreateTablet for tablet 5b42566975eb42c2828605a69a3bcd77 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:36.522679  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b42566975eb42c2828605a69a3bcd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.528823  3983 tablet_service.cc:1511] Processing CreateTablet for tablet 54816fa582994d498763a814fc93f2dd (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:36.529145  4056 tablet_service.cc:1511] Processing CreateTablet for tablet 54816fa582994d498763a814fc93f2dd (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:36.529944  3915 tablet_service.cc:1511] Processing CreateTablet for tablet 1b166f25ed8046d6bf500a38ed7beaf9 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:36.530387  3983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54816fa582994d498763a814fc93f2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.530515  4056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54816fa582994d498763a814fc93f2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.531378  3915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b166f25ed8046d6bf500a38ed7beaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.531584  3987 tablet_service.cc:1511] Processing CreateTablet for tablet 1b166f25ed8046d6bf500a38ed7beaf9 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:36.532793  3987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b166f25ed8046d6bf500a38ed7beaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.524092  4062 tablet_service.cc:1511] Processing CreateTablet for tablet 5b42566975eb42c2828605a69a3bcd77 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:36.535326  4062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b42566975eb42c2828605a69a3bcd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.537043  4063 tablet_service.cc:1511] Processing CreateTablet for tablet 1b166f25ed8046d6bf500a38ed7beaf9 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:36.538519  4063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b166f25ed8046d6bf500a38ed7beaf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.538918  3982 tablet_service.cc:1511] Processing CreateTablet for tablet 26e0a1a581cb42a2803664a59fadae65 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:36.541724  3907 tablet_service.cc:1511] Processing CreateTablet for tablet 26e0a1a581cb42a2803664a59fadae65 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:36.543146  3907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e0a1a581cb42a2803664a59fadae65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.544757  3909 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc3a12b45894e08863b2c904c067778 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:36.547335  4060 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc3a12b45894e08863b2c904c067778 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:36.544147  3989 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc3a12b45894e08863b2c904c067778 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:36.550303  3912 tablet_service.cc:1511] Processing CreateTablet for tablet 0681d227da934bf984101f9369cfc8d4 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:36.547767  3982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e0a1a581cb42a2803664a59fadae65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.551554  3909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc3a12b45894e08863b2c904c067778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.551555  4060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc3a12b45894e08863b2c904c067778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.543217  4061 tablet_service.cc:1511] Processing CreateTablet for tablet 26e0a1a581cb42a2803664a59fadae65 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:36.553798  3912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0681d227da934bf984101f9369cfc8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.554045  4061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e0a1a581cb42a2803664a59fadae65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.555656  4220 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:36.552498  3989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc3a12b45894e08863b2c904c067778. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.573817  4219 tablet_bootstrap.cc:654] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.593864  3985 tablet_service.cc:1511] Processing CreateTablet for tablet 0681d227da934bf984101f9369cfc8d4 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:36.595522  3985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0681d227da934bf984101f9369cfc8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.596300  4057 tablet_service.cc:1511] Processing CreateTablet for tablet 0681d227da934bf984101f9369cfc8d4 (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:36.597739  4057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0681d227da934bf984101f9369cfc8d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.600653  3910 tablet_service.cc:1511] Processing CreateTablet for tablet ddd830f066a74da68969f19dc20be7ae (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:36.602066  3910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd830f066a74da68969f19dc20be7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.593753  4218 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.610773  4218 ts_tablet_manager.cc:1403] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.004s
I20260709 13:13:36.617347  4058 tablet_service.cc:1511] Processing CreateTablet for tablet ddd830f066a74da68969f19dc20be7ae (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:36.618887  4058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd830f066a74da68969f19dc20be7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.627292  4220 tablet_bootstrap.cc:654] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:36.630847  3871 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:36.631553  4218 raft_consensus.cc:359] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.636150  4219 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.636917  4219 ts_tablet_manager.cc:1403] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.001s
I20260709 13:13:36.646832  4218 raft_consensus.cc:385] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.647472  4218 raft_consensus.cc:740] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.648563  4218 consensus_queue.cc:260] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.655881  4218 ts_tablet_manager.cc:1434] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:13:36.657507  4218 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.664198  4219 raft_consensus.cc:359] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.665107  4219 raft_consensus.cc:385] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.665479  4219 raft_consensus.cc:740] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.666293  4219 consensus_queue.cc:260] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.678009  4219 ts_tablet_manager.cc:1434] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:13:36.680189  4218 tablet_bootstrap.cc:654] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.686733  4219 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
W20260709 13:13:36.683975  3965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:33479, user_credentials={real_user=slave}} blocked reactor thread for 75855us
I20260709 13:13:36.697983  3986 tablet_service.cc:1511] Processing CreateTablet for tablet ddd830f066a74da68969f19dc20be7ae (DEFAULT_TABLE table=soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:36.699239  4220 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:36.699610  3986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddd830f066a74da68969f19dc20be7ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.699803  4220 ts_tablet_manager.cc:1403] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.010s
I20260709 13:13:36.702687  4220 raft_consensus.cc:359] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.710455  4219 tablet_bootstrap.cc:654] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.710902  4220 raft_consensus.cc:385] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.711380  4220 raft_consensus.cc:740] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.712427  4220 consensus_queue.cc:260] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.721236  4220 ts_tablet_manager.cc:1434] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:13:36.723068  4219 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.723219  4220 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:36.723865  4219 ts_tablet_manager.cc:1403] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.006s
I20260709 13:13:36.724436  4218 tablet_bootstrap.cc:492] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.725046  4218 ts_tablet_manager.cc:1403] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.004s
I20260709 13:13:36.728032  4219 raft_consensus.cc:359] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.728950  4219 raft_consensus.cc:385] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.729328  4219 raft_consensus.cc:740] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.730186  4220 tablet_bootstrap.cc:654] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.730171  4219 consensus_queue.cc:260] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.730186  4218 raft_consensus.cc:359] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.731242  4218 raft_consensus.cc:385] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.731601  4218 raft_consensus.cc:740] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.732620  4219 ts_tablet_manager.cc:1434] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:13:36.732488  4218 consensus_queue.cc:260] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.734169  4219 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.736142  4218 ts_tablet_manager.cc:1434] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:13:36.737545  4218 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.742304  4219 tablet_bootstrap.cc:654] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.746623  4218 tablet_bootstrap.cc:654] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.770239  4218 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.770677  4218 ts_tablet_manager.cc:1403] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.010s
I20260709 13:13:36.770756  4219 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.770896  4220 tablet_bootstrap.cc:492] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:36.771497  4220 ts_tablet_manager.cc:1403] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.025s
I20260709 13:13:36.771520  4219 ts_tablet_manager.cc:1403] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.020s
I20260709 13:13:36.773335  4218 raft_consensus.cc:359] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.773924  4218 raft_consensus.cc:385] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.774164  4218 raft_consensus.cc:740] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.774573  4220 raft_consensus.cc:359] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.774791  4219 raft_consensus.cc:359] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.774931  4218 consensus_queue.cc:260] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.775409  4220 raft_consensus.cc:385] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.775583  4219 raft_consensus.cc:385] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.775879  4220 raft_consensus.cc:740] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.775943  4219 raft_consensus.cc:740] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.776727  4220 consensus_queue.cc:260] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.777410  4218 ts_tablet_manager.cc:1434] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:13:36.777158  4219 consensus_queue.cc:260] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.778442  4218 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.779594  4219 ts_tablet_manager.cc:1434] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:36.781517  4220 ts_tablet_manager.cc:1434] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:13:36.782642  4220 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:36.784555  4147 raft_consensus.cc:493] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.785051  4147 raft_consensus.cc:515] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.786065  4218 tablet_bootstrap.cc:654] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.787081  4147 leader_election.cc:290] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:36.788717  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:36.789366  4219 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.789806  4220 tablet_bootstrap.cc:654] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.790613  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:36.791328  4072 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:36.795750  3966 leader_election.cc:304] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:36.796747  4219 tablet_bootstrap.cc:654] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.798668  4218 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.799399  4218 ts_tablet_manager.cc:1403] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:13:36.789400  3925 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:36.803540  4218 raft_consensus.cc:359] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.804618  4218 raft_consensus.cc:385] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.805006  4218 raft_consensus.cc:740] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.806022  4218 consensus_queue.cc:260] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.818487  4224 raft_consensus.cc:2804] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.818991  4224 raft_consensus.cc:493] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.819366  4224 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.819919  4218 ts_tablet_manager.cc:1434] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:13:36.821041  4218 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.828557  4218 tablet_bootstrap.cc:654] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.835722  4220 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:36.836452  4220 ts_tablet_manager.cc:1403] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.011s
I20260709 13:13:36.839764  4224 raft_consensus.cc:515] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.843660  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:36.844277  3925 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.844480  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:36.849531  4219 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.849628  4072 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.850152  4224 leader_election.cc:290] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:36.849215  4220 raft_consensus.cc:359] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.850345  4219 ts_tablet_manager.cc:1403] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.021s
I20260709 13:13:36.850797  4220 raft_consensus.cc:385] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.851290  4220 raft_consensus.cc:740] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.852018  4220 consensus_queue.cc:260] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.853681  3925 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:36.854847  3965 leader_election.cc:304] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:36.855363  4220 ts_tablet_manager.cc:1434] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:13:36.855736  4218 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.856335  4218 ts_tablet_manager.cc:1403] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.013s
I20260709 13:13:36.856410  4220 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:36.856112  4219 raft_consensus.cc:359] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.857031  4219 raft_consensus.cc:385] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.857429  4219 raft_consensus.cc:740] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.858269  4219 consensus_queue.cc:260] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.859699  4218 raft_consensus.cc:359] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.860467  4218 raft_consensus.cc:385] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.860767  4218 raft_consensus.cc:740] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.860916  4219 ts_tablet_manager.cc:1434] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:13:36.861567  4218 consensus_queue.cc:260] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.862123  4219 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.855733  4224 raft_consensus.cc:2804] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:36.869498  4219 tablet_bootstrap.cc:654] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.870999  4072 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:36.871482  4218 ts_tablet_manager.cc:1434] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:13:36.872650  4218 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.869474  4224 raft_consensus.cc:697] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:36.878043  4224 consensus_queue.cc:237] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.880515  4219 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.881125  4219 ts_tablet_manager.cc:1403] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:13:36.884871  4219 raft_consensus.cc:359] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.885694  4219 raft_consensus.cc:385] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.886026  4219 raft_consensus.cc:740] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.887058  4218 tablet_bootstrap.cc:654] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.886983  4219 consensus_queue.cc:260] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.889686  4219 ts_tablet_manager.cc:1434] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:36.891006  4219 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.892939  4220 tablet_bootstrap.cc:654] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.900925  4219 tablet_bootstrap.cc:654] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.904049  4218 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.904664  4218 ts_tablet_manager.cc:1403] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.005s
I20260709 13:13:36.908595  4218 raft_consensus.cc:359] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.909555  4218 raft_consensus.cc:385] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.909919  4218 raft_consensus.cc:740] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.911199  4224 raft_consensus.cc:493] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.911703  4224 raft_consensus.cc:515] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.914041  4224 leader_election.cc:290] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:36.913997  4219 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.915094  4219 ts_tablet_manager.cc:1403] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 13:13:36.915807  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
W20260709 13:13:36.917819  3965 leader_election.cc:343] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:36.918211  4219 raft_consensus.cc:359] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.918311  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:36.919251  4219 raft_consensus.cc:385] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.919668  4219 raft_consensus.cc:740] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.904112  3820 catalog_manager.cc:5697] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:36.920493  4219 consensus_queue.cc:260] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.921725  4072 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:36.921223  4218 consensus_queue.cc:260] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.923664  4219 ts_tablet_manager.cc:1434] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:13:36.923992  4220 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:36.924015  4218 ts_tablet_manager.cc:1434] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:13:36.923702  3966 leader_election.cc:304] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:36.924726  4220 ts_tablet_manager.cc:1403] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.003s
I20260709 13:13:36.924927  4219 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:36.925365  4218 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:36.925433  4224 raft_consensus.cc:2804] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:36.926108  4224 raft_consensus.cc:493] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:36.926472  4224 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.928376  4220 raft_consensus.cc:359] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.929271  4220 raft_consensus.cc:385] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.929582  4220 raft_consensus.cc:740] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.930469  4220 consensus_queue.cc:260] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.933272  4220 ts_tablet_manager.cc:1434] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:36.934079  4218 tablet_bootstrap.cc:654] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.934607  4220 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:36.935437  4219 tablet_bootstrap.cc:654] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.940680  4224 raft_consensus.cc:515] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.975051  4147 raft_consensus.cc:493] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.976985  4147 raft_consensus.cc:515] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.981056  4147 leader_election.cc:290] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:36.986550  4224 leader_election.cc:290] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:36.986296  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:36.982158  4205 raft_consensus.cc:493] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:36.991377  4205 raft_consensus.cc:515] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:36.993772  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:36.994315  4219 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:36.995949  4219 ts_tablet_manager.cc:1403] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.011s
I20260709 13:13:36.995961  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:36.996423  4218 tablet_bootstrap.cc:492] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:36.997201  4074 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:36.997572  4218 ts_tablet_manager.cc:1403] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.012s
I20260709 13:13:36.997656  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:36.999361  4224 raft_consensus.cc:493] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:36.999740  4039 leader_election.cc:343] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:37.001897  3966 leader_election.cc:343] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:37.002839  3965 leader_election.cc:343] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.003613  3965 leader_election.cc:304] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.004503  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.005376  4222 raft_consensus.cc:2749] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.006518  4205 leader_election.cc:290] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:37.007304  4147 raft_consensus.cc:493] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.008155  4147 raft_consensus.cc:515] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.008550  4218 raft_consensus.cc:359] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.009610  4218 raft_consensus.cc:385] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.009547  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.010452  4147 leader_election.cc:290] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.010653  3998 raft_consensus.cc:2468] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 0.
I20260709 13:13:37.011243  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:37.011895  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.012079  4224 raft_consensus.cc:515] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.012830  4072 raft_consensus.cc:2468] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.013036  4038 leader_election.cc:304] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.010105  4218 raft_consensus.cc:740] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.014199  3966 leader_election.cc:304] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.014635  4224 leader_election.cc:290] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.014297  4218 consensus_queue.cc:260] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.017346  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.018873  4072 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.020517  3966 leader_election.cc:304] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.020349  4219 raft_consensus.cc:359] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.021378  4219 raft_consensus.cc:385] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.021735  4219 raft_consensus.cc:740] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
W20260709 13:13:37.022192  3965 leader_election.cc:343] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:37.022975  3965 leader_election.cc:343] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.022660  4219 consensus_queue.cc:260] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.025233  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:37.026377  3925 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.027616  4147 raft_consensus.cc:2804] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.028260  4218 ts_tablet_manager.cc:1434] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.008s
I20260709 13:13:37.028182  4147 raft_consensus.cc:493] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.030202  4205 raft_consensus.cc:2804] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.030282  4147 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.015417  4224 raft_consensus.cc:2804] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.030326  4218 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
I20260709 13:13:37.032266  4224 raft_consensus.cc:493] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.033814  4224 raft_consensus.cc:3060] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.041049  4220 tablet_bootstrap.cc:654] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.031893  4205 raft_consensus.cc:493] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.049829  4205 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.053848  4218 tablet_bootstrap.cc:654] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.060879  4074 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.066180  4224 raft_consensus.cc:515] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.068739  4224 leader_election.cc:290] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.068751  3966 leader_election.cc:304] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.069932  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.071496  4219 ts_tablet_manager.cc:1434] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.075s	user 0.020s	sys 0.025s
I20260709 13:13:37.071777  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
W20260709 13:13:37.071825  3965 leader_election.cc:343] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.072891  4074 raft_consensus.cc:3060] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.073177  4219 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:37.075944  4147 raft_consensus.cc:515] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.076675  4222 raft_consensus.cc:2804] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.077389  4222 raft_consensus.cc:697] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.078608  4222 consensus_queue.cc:237] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.081869  4074 raft_consensus.cc:2468] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.082195  4205 raft_consensus.cc:515] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.083297  3966 leader_election.cc:304] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.084694  4246 raft_consensus.cc:2804] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.089782  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.094259  3924 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.081894  4220 tablet_bootstrap.cc:492] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:37.104560  4220 ts_tablet_manager.cc:1403] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.010s
I20260709 13:13:37.107343  3925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
W20260709 13:13:37.109261  4039 leader_election.cc:343] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.110375  4219 tablet_bootstrap.cc:654] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.113538  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:37.114360  3998 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.120081  4220 raft_consensus.cc:359] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.121024  4220 raft_consensus.cc:385] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.121326  4220 raft_consensus.cc:740] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.122117  4220 consensus_queue.cc:260] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.123709  4147 leader_election.cc:290] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.129765  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.130560  4072 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.130692  4218 tablet_bootstrap.cc:492] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:37.131342  4218 ts_tablet_manager.cc:1403] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.102s	user 0.004s	sys 0.027s
I20260709 13:13:37.131851  4231 raft_consensus.cc:493] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.132613  4231 raft_consensus.cc:515] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.134961  4220 ts_tablet_manager.cc:1434] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.029s	user 0.000s	sys 0.009s
I20260709 13:13:37.113775  4205 leader_election.cc:290] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:37.139359  4220 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:37.163118  4246 raft_consensus.cc:697] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.147652  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.160831  3998 raft_consensus.cc:2468] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 1.
I20260709 13:13:37.170977  4246 consensus_queue.cc:237] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.139616  4231 leader_election.cc:290] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.172955  4038 leader_election.cc:304] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.174441  4205 raft_consensus.cc:2804] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.161928  4218 raft_consensus.cc:359] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.175186  4205 raft_consensus.cc:697] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:37.141822  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.176342  4074 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 0.
I20260709 13:13:37.175482  4218 raft_consensus.cc:385] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.177220  4218 raft_consensus.cc:740] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.177834  3891 leader_election.cc:304] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.178052  4218 consensus_queue.cc:260] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.178669  4220 tablet_bootstrap.cc:654] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.179066  4231 raft_consensus.cc:2804] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.179675  4231 raft_consensus.cc:493] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.180151  4231 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.180652  4218 ts_tablet_manager.cc:1434] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 13:13:37.181913  4218 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Bootstrap starting.
W20260709 13:13:37.182381  3965 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:33479, user_credentials={real_user=slave}} blocked reactor thread for 97616.3us
I20260709 13:13:37.183429  3999 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 0.
I20260709 13:13:37.185173  4224 raft_consensus.cc:493] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.185676  4224 raft_consensus.cc:515] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.190028  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.190755  4074 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.192281  3966 leader_election.cc:304] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.193348  4218 tablet_bootstrap.cc:654] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.193897  4251 raft_consensus.cc:2804] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.195016  4251 raft_consensus.cc:493] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.195528  4251 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.145938  4219 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:37.198283  4219 ts_tablet_manager.cc:1403] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.005s
I20260709 13:13:37.197526  4224 leader_election.cc:290] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.204756  3923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:37.205713  3923 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.176748  4205 consensus_queue.cc:237] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.209564  4219 raft_consensus.cc:359] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.210588  4219 raft_consensus.cc:385] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.199393  4072 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.166038  3924 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.215996  3966 leader_election.cc:304] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.217149  4224 raft_consensus.cc:2804] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.217757  4224 raft_consensus.cc:697] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.210917  4219 raft_consensus.cc:740] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.219025  4224 consensus_queue.cc:237] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.232292  4219 consensus_queue.cc:260] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.239373  4251 raft_consensus.cc:515] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.240805  4220 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:37.241572  4220 ts_tablet_manager.cc:1403] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.104s	user 0.039s	sys 0.014s
I20260709 13:13:37.241940  4251 leader_election.cc:290] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.242902  4219 ts_tablet_manager.cc:1434] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:13:37.243059  4231 raft_consensus.cc:515] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.244201  4219 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: Bootstrap starting.
I20260709 13:13:37.244498  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.245198  4072 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.245445  4231 leader_election.cc:290] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.245599  4220 raft_consensus.cc:359] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.246636  4220 raft_consensus.cc:385] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.246987  4220 raft_consensus.cc:740] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.247974  4220 consensus_queue.cc:260] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.242733  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.248551  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:37.249100  3924 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.249802  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.250432  4074 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.251061  4220 ts_tablet_manager.cc:1434] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:37.251853  4219 tablet_bootstrap.cc:654] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.252419  4220 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:37.262418  4220 tablet_bootstrap.cc:654] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.249221  3999 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.276571  4220 tablet_bootstrap.cc:492] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:37.277292  4220 ts_tablet_manager.cc:1403] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.010s
I20260709 13:13:37.280398  4220 raft_consensus.cc:359] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.281263  4220 raft_consensus.cc:385] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.281663  4220 raft_consensus.cc:740] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.282107  4072 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.282442  4220 consensus_queue.cc:260] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.284901  3966 leader_election.cc:304] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.285218  4220 ts_tablet_manager.cc:1434] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:37.286721  4191 raft_consensus.cc:493] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.287230  4191 raft_consensus.cc:515] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.287990  4218 tablet_bootstrap.cc:492] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: No bootstrap required, opened a new log
I20260709 13:13:37.288458  4218 ts_tablet_manager.cc:1403] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent bootstrapping tablet: real 0.107s	user 0.008s	sys 0.017s
I20260709 13:13:37.289434  4191 leader_election.cc:290] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.289629  3924 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.291334  4218 raft_consensus.cc:359] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.292018  4218 raft_consensus.cc:385] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.292277  4218 raft_consensus.cc:740] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.292722  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.293037  4218 consensus_queue.cc:260] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.293578  3998 raft_consensus.cc:2393] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate 2ec90502e3764edea9b2d92b64c9ab68 in this term.
I20260709 13:13:37.295449  4246 raft_consensus.cc:2804] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.296022  4246 raft_consensus.cc:697] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.297292  4246 consensus_queue.cc:237] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.299626  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.300455  4218 ts_tablet_manager.cc:1434] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:37.301654  4220 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:37.303248  3891 leader_election.cc:304] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.305276  4191 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.307502  3820 catalog_manager.cc:5697] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.310173  4220 tablet_bootstrap.cc:654] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.316394  4220 tablet_bootstrap.cc:492] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:37.316915  4220 ts_tablet_manager.cc:1403] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 13:13:37.317394  4074 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 1.
I20260709 13:13:37.320394  4220 raft_consensus.cc:359] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.321162  4220 raft_consensus.cc:385] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.321461  4220 raft_consensus.cc:740] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.322204  4220 consensus_queue.cc:260] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.324043  3999 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 1.
I20260709 13:13:37.327658  3891 leader_election.cc:304] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.332537  4191 raft_consensus.cc:2749] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.333349  4191 raft_consensus.cc:2804] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.333880  4191 raft_consensus.cc:697] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:37.334867  4191 consensus_queue.cc:237] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.337798  4224 consensus_queue.cc:1048] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.349677  4219 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: No bootstrap required, opened a new log
I20260709 13:13:37.352903  4219 ts_tablet_manager.cc:1403] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent bootstrapping tablet: real 0.109s	user 0.043s	sys 0.033s
I20260709 13:13:37.360164  4219 raft_consensus.cc:359] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.360971  4219 raft_consensus.cc:385] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.361336  4219 raft_consensus.cc:740] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.365260  4219 consensus_queue.cc:260] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.368898  4219 ts_tablet_manager.cc:1434] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:13:37.372803  4205 raft_consensus.cc:493] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.373523  4205 raft_consensus.cc:515] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.376966  4205 leader_election.cc:290] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:37.377746  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:37.378929  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
W20260709 13:13:37.379572  4039 leader_election.cc:343] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.379794  3999 raft_consensus.cc:2468] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 0.
I20260709 13:13:37.381881  4038 leader_election.cc:304] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.383388  4205 raft_consensus.cc:2804] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.383821  4205 raft_consensus.cc:493] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.365238  3819 catalog_manager.cc:5697] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.384243  4205 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.392210  4224 consensus_queue.cc:1048] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.397166  4205 raft_consensus.cc:515] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.400733  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
W20260709 13:13:37.401971  4039 leader_election.cc:343] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:37.404248  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:37.405059  3999 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.403070  4205 leader_election.cc:290] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:37.386265  3819 catalog_manager.cc:5697] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.410298  3819 catalog_manager.cc:5697] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.416374  4220 ts_tablet_manager.cc:1434] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.099s	user 0.035s	sys 0.048s
I20260709 13:13:37.416018  3819 catalog_manager.cc:5697] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.417912  4220 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: Bootstrap starting.
I20260709 13:13:37.416723  3999 raft_consensus.cc:2468] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 1.
I20260709 13:13:37.420053  4038 leader_election.cc:304] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.420926  4205 raft_consensus.cc:2804] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.421433  4205 raft_consensus.cc:697] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:37.422480  4205 consensus_queue.cc:237] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.425045  4220 tablet_bootstrap.cc:654] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.436308  4220 tablet_bootstrap.cc:492] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: No bootstrap required, opened a new log
I20260709 13:13:37.436862  4220 ts_tablet_manager.cc:1403] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:13:37.436937  3821 catalog_manager.cc:5697] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 0 to 1, leader changed from <none> to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 1 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.439821  4220 raft_consensus.cc:359] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.440526  4220 raft_consensus.cc:385] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.440809  4220 raft_consensus.cc:740] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.441509  4220 consensus_queue.cc:260] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.443593  4220 ts_tablet_manager.cc:1434] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:37.447641  3822 catalog_manager.cc:5697] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.457065  4265 raft_consensus.cc:493] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.457777  4265 raft_consensus.cc:515] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.460892  4265 leader_election.cc:290] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.461129  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.461921  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b166f25ed8046d6bf500a38ed7beaf9" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.462680  4074 raft_consensus.cc:2393] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in this term.
I20260709 13:13:37.463711  3891 leader_election.cc:304] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.464491  4265 raft_consensus.cc:3060] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.471130  4265 raft_consensus.cc:2749] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.473268  4265 raft_consensus.cc:493] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.473667  4265 raft_consensus.cc:515] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.475274  4265 leader_election.cc:290] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.476037  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.476208  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.476981  4074 raft_consensus.cc:2393] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in this term.
I20260709 13:13:37.477880  3891 leader_election.cc:304] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.478473  4265 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.483297  4265 raft_consensus.cc:2749] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.510886  4246 raft_consensus.cc:493] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.511557  4246 raft_consensus.cc:515] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.513607  4246 leader_election.cc:290] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.514186  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752" is_pre_election: true
I20260709 13:13:37.514669  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.514940  3924 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.515353  4074 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 0.
I20260709 13:13:37.516140  3965 leader_election.cc:304] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.516906  4246 raft_consensus.cc:2804] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.517297  4246 raft_consensus.cc:493] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.517565  4246 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.524560  4246 raft_consensus.cc:515] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.526870  4246 leader_election.cc:290] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.527076  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.527468  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.527797  3924 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.528057  4074 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.535349  4074 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.535650  3924 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 1.
I20260709 13:13:37.537214  3965 leader_election.cc:304] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.538395  4246 raft_consensus.cc:2804] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.538756  4246 raft_consensus.cc:697] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.539443  4246 consensus_queue.cc:237] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.546285  3821 catalog_manager.cc:5697] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 0 to 1, leader changed from <none> to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 1 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.553869  4246 consensus_queue.cc:1048] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.564873  4246 consensus_queue.cc:1048] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.619493  4246 consensus_queue.cc:1048] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.635918  4246 consensus_queue.cc:1048] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.654136  4250 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.666200  4252 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.711256  4205 consensus_queue.cc:1048] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.726550  4283 consensus_queue.cc:1048] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:37.742311  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:37.742966  3999 raft_consensus.cc:606] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.748502  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:37.749039  3999 raft_consensus.cc:606] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.753754  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:37.754232  3999 raft_consensus.cc:606] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.758780  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54816fa582994d498763a814fc93f2dd"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:37.759310  3999 raft_consensus.cc:606] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS e80d9cbe545f430db37e3e1785b63752
I20260709 13:13:37.766642  4074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
mode: GRACEFUL
new_leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:40298
I20260709 13:13:37.767278  4074 raft_consensus.cc:606] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Received request to transfer leadership to TS aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.772657  3924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
mode: GRACEFUL
new_leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:39870
I20260709 13:13:37.773162  3924 raft_consensus.cc:606] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Received request to transfer leadership to TS aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.777961  4074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
mode: GRACEFUL
new_leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:40298
I20260709 13:13:37.778510  4074 raft_consensus.cc:606] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Received request to transfer leadership to TS aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.783785  3999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:13:37.784382  3999 raft_consensus.cc:606] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:37.805023  4251 raft_consensus.cc:993] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:37.805485  4252 raft_consensus.cc:1081] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:37.806895  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:37.807418  3924 raft_consensus.cc:493] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.807683  3924 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.812736  3924 raft_consensus.cc:515] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.814388  3924 leader_election.cc:290] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.815536  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.815640  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac7f7f63f446ccbe676b3da9549ad2" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:37.816251  4074 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.816313  3999 raft_consensus.cc:3055] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.816762  3999 raft_consensus.cc:740] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.817437  3999 consensus_queue.cc:260] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.818387  3999 raft_consensus.cc:3060] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.821496  4074 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:37.822701  3891 leader_election.cc:304] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.823467  4265 raft_consensus.cc:2804] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.823350  3999 raft_consensus.cc:2468] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:37.824075  4265 raft_consensus.cc:697] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:37.824950  4265 consensus_queue.cc:237] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.831552  3819 catalog_manager.cc:5697] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.835212  4252 consensus_queue.cc:1048] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.846102  4252 consensus_queue.cc:1048] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.854270  4250 raft_consensus.cc:993] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:37.854808  4252 raft_consensus.cc:1081] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:37.856287  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:37.856784  3924 raft_consensus.cc:493] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.857082  3924 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.862272  3924 raft_consensus.cc:515] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.865054  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:37.865720  3999 raft_consensus.cc:3055] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.865772  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b42566975eb42c2828605a69a3bcd77" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.866110  3999 raft_consensus.cc:740] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.866483  4074 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.867038  3999 consensus_queue.cc:260] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.868276  3999 raft_consensus.cc:3060] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.872675  4265 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:37.874382  4074 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:37.865059  3924 leader_election.cc:290] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.875877  3891 leader_election.cc:304] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:37.877318  4265 raft_consensus.cc:2804] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.878656  4265 raft_consensus.cc:697] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:37.879624  4265 consensus_queue.cc:237] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.883272  3999 raft_consensus.cc:2468] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:37.886133  4265 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.889678  4191 raft_consensus.cc:993] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: : Instructing follower aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:37.890193  4231 raft_consensus.cc:1081] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Signalling peer aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:37.890141  3821 catalog_manager.cc:5697] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.894686  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:53270
I20260709 13:13:37.897970  3998 raft_consensus.cc:493] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.898382  3998 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.899397  4265 raft_consensus.cc:493] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.899940  4265 raft_consensus.cc:515] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.902041  4265 leader_election.cc:290] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.904626  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" is_pre_election: true
I20260709 13:13:37.905493  3999 raft_consensus.cc:2393] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e80d9cbe545f430db37e3e1785b63752 in current term 1: Already voted for candidate 2ec90502e3764edea9b2d92b64c9ab68 in this term.
I20260709 13:13:37.905910  3998 raft_consensus.cc:515] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.907418  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68" is_pre_election: true
I20260709 13:13:37.909247  3891 leader_election.cc:304] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e80d9cbe545f430db37e3e1785b63752; no voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f
I20260709 13:13:37.910706  4265 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.912297  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.912595  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.912930  3924 raft_consensus.cc:3055] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.913200  4074 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.913347  3924 raft_consensus.cc:740] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:37.914288  3924 consensus_queue.cc:260] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.917218  3924 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.919106  4265 raft_consensus.cc:2749] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:37.920128  4074 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:37.921025  3998 leader_election.cc:290] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.921554  3966 leader_election.cc:304] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.922379  4252 raft_consensus.cc:2804] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:37.922770  4252 raft_consensus.cc:697] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:37.923614  4252 consensus_queue.cc:237] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.924777  3924 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:37.932356  3819 catalog_manager.cc:5697] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 1 to 2, leader changed from e80d9cbe545f430db37e3e1785b63752 (127.25.139.129) to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 2 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.958125  4205 consensus_queue.cc:1048] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.966068  4284 consensus_queue.cc:1048] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.969157  4245 raft_consensus.cc:993] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: : Instructing follower aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:37.969653  4245 raft_consensus.cc:1081] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Signalling peer aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:37.972349  3998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:37.972891  3998 raft_consensus.cc:493] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:37.973238  3998 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.980948  3998 raft_consensus.cc:515] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.984618  3998 leader_election.cc:290] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:37.986299  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:37.986899  4072 raft_consensus.cc:3055] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:37.987258  4072 raft_consensus.cc:740] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:37.988080  4072 consensus_queue.cc:260] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:37.989406  4072 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.991413  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0681d227da934bf984101f9369cfc8d4" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:37.992023  4246 consensus_queue.cc:1048] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:37.994211  3922 raft_consensus.cc:3060] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:37.997258  4072 raft_consensus.cc:2468] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:37.998800  3966 leader_election.cc:304] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:37.999557  4246 raft_consensus.cc:2804] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.000067  4246 raft_consensus.cc:697] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:38.000808  3922 raft_consensus.cc:2468] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:38.000953  4246 consensus_queue.cc:237] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.008843  4251 consensus_queue.cc:1048] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.011821  3822 catalog_manager.cc:5697] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 1 to 2, leader changed from 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131) to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 2 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.018647  4251 raft_consensus.cc:993] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:38.019227  4224 raft_consensus.cc:1081] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:38.020975  4072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40296
I20260709 13:13:38.021504  4072 raft_consensus.cc:493] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.022511  4072 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.027279  4072 raft_consensus.cc:515] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.028709  4072 leader_election.cc:290] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:38.029842  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:38.029764  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddd830f066a74da68969f19dc20be7ae" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:38.030556  3924 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.030649  3998 raft_consensus.cc:3055] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.031055  3998 raft_consensus.cc:740] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:38.031876  3998 consensus_queue.cc:260] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.033155  3998 raft_consensus.cc:3060] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.037647  3924 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 2.
I20260709 13:13:38.038971  4039 leader_election.cc:304] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:38.039860  4205 raft_consensus.cc:2804] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.040019  3998 raft_consensus.cc:2468] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 2.
I20260709 13:13:38.040372  4205 raft_consensus.cc:697] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:38.041235  4205 consensus_queue.cc:237] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.047317  3822 catalog_manager.cc:5697] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:38.067440  4251 raft_consensus.cc:993] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:38.068058  4224 raft_consensus.cc:1081] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:38.069598  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54816fa582994d498763a814fc93f2dd"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:38.070024  3924 raft_consensus.cc:493] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.070256  3924 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.075268  3924 raft_consensus.cc:515] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.076876  3924 leader_election.cc:290] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:38.077786  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:38.077996  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:38.078416  3998 raft_consensus.cc:3055] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.078490  4074 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.078805  3998 raft_consensus.cc:740] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:38.079638  3998 consensus_queue.cc:260] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.080840  3998 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.085016  4074 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:38.086082  3891 leader_election.cc:304] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:38.086829  4265 raft_consensus.cc:2804] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.087270  4265 raft_consensus.cc:697] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:38.087668  3998 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:38.088073  4265 consensus_queue.cc:237] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.094380  3822 catalog_manager.cc:5697] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.234515  4074 raft_consensus.cc:1275] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.235687  4265 consensus_queue.cc:1048] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.243538  3998 raft_consensus.cc:1275] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.245314  4191 consensus_queue.cc:1048] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.249980  4250 raft_consensus.cc:993] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:38.250523  4250 raft_consensus.cc:1081] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer e80d9cbe545f430db37e3e1785b63752 to start an election
I20260709 13:13:38.254405  3924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
 from {username='slave'} at 127.0.0.1:39860
I20260709 13:13:38.254954  3924 raft_consensus.cc:493] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.255010  4245 raft_consensus.cc:993] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: : Instructing follower aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:38.255358  3924 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.255532  4245 raft_consensus.cc:1081] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Signalling peer aba9e4a9b8c14b4b9f8db3f9b8d0227f to start an election
I20260709 13:13:38.258754  3999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
 from {username='slave'} at 127.0.0.1:53272
I20260709 13:13:38.259402  3999 raft_consensus.cc:493] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.259995  3999 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.261955  3924 raft_consensus.cc:515] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.264480  3924 leader_election.cc:290] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:38.265031  4074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:38.265583  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3e252b051f24e88ae0cc0118379659e" candidate_uuid: "e80d9cbe545f430db37e3e1785b63752" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:38.265664  4074 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.266299  3998 raft_consensus.cc:3055] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.266662  3998 raft_consensus.cc:740] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:38.267467  3998 consensus_queue.cc:260] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.268741  3998 raft_consensus.cc:3060] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.273288  4074 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:38.273356  3999 raft_consensus.cc:515] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.274631  3998 raft_consensus.cc:2468] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e80d9cbe545f430db37e3e1785b63752 in term 2.
I20260709 13:13:38.274519  3891 leader_election.cc:304] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:38.275502  4268 raft_consensus.cc:2804] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.275975  4268 raft_consensus.cc:697] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Leader. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:38.276753  3924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:38.277343  3924 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.276865  4268 consensus_queue.cc:237] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.278570  3999 leader_election.cc:290] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131:43285)
I20260709 13:13:38.279230  4072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26e0a1a581cb42a2803664a59fadae65" candidate_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
I20260709 13:13:38.279853  4072 raft_consensus.cc:3055] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.280194  4072 raft_consensus.cc:740] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:38.280802  4074 raft_consensus.cc:1275] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.280965  4072 consensus_queue.cc:260] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.282305  4072 raft_consensus.cc:3060] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.282830  4268 consensus_queue.cc:1048] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.284695  3924 raft_consensus.cc:2468] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:38.285933  3965 leader_election.cc:304] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aba9e4a9b8c14b4b9f8db3f9b8d0227f, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:38.287573  3819 catalog_manager.cc:5697] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to e80d9cbe545f430db37e3e1785b63752 (127.25.139.129). New cstate: current_term: 2 leader_uuid: "e80d9cbe545f430db37e3e1785b63752" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.289248  4224 raft_consensus.cc:2804] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.289863  4224 raft_consensus.cc:697] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Leader. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:38.290900  4224 consensus_queue.cc:237] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:38.291577  3999 raft_consensus.cc:1275] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.289222  4072 raft_consensus.cc:2468] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aba9e4a9b8c14b4b9f8db3f9b8d0227f in term 2.
I20260709 13:13:38.293146  4268 consensus_queue.cc:1048] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.306521  3819 catalog_manager.cc:5697] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f reported cstate change: term changed from 1 to 2, leader changed from 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131) to aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130). New cstate: current_term: 2 leader_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.393977  3924 raft_consensus.cc:1275] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.395184  4224 consensus_queue.cc:1048] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.404513  4074 raft_consensus.cc:1275] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.405925  4224 consensus_queue.cc:1048] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.435130  3999 raft_consensus.cc:1275] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.436630  4284 consensus_queue.cc:1048] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.444988  3924 raft_consensus.cc:1275] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.446619  4284 consensus_queue.cc:1048] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.500248  4074 raft_consensus.cc:1275] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.501577  4224 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.510057  3924 raft_consensus.cc:1275] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.512593  4224 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.519975  4074 raft_consensus.cc:1275] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.521539  4268 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.529594  3999 raft_consensus.cc:1275] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.530902  4265 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.729197  3924 raft_consensus.cc:1275] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.730370  4246 consensus_queue.cc:1048] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.739334  4074 raft_consensus.cc:1275] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer aba9e4a9b8c14b4b9f8db3f9b8d0227f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.741353  4224 consensus_queue.cc:1048] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.748575  4072 raft_consensus.cc:1275] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.750253  4268 consensus_queue.cc:1048] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:38.760697  3999 raft_consensus.cc:1275] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer e80d9cbe545f430db37e3e1785b63752: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:38.762650  4191 consensus_queue.cc:1048] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:40.787652  3822 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52638:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:40.807957  3822 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52638:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:40.924266 26158 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:40.939693  4322 tablet.cc:1724] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:40.962858  4329 tablet.cc:1724] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:40.976442  3951 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:a3e252b051f24e88ae0cc0118379659e)
W20260709 13:13:40.998240  3951 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:a3e252b051f24e88ae0cc0118379659e)
W20260709 13:13:41.013237  3951 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:a3e252b051f24e88ae0cc0118379659e)
W20260709 13:13:41.019994  3891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:43285, user_credentials={real_user=slave}} blocked reactor thread for 103332us
W20260709 13:13:41.055862  4326 log.cc:927] Time spent T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:13:41.057292  4332 log.cc:927] Time spent T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:13:41.076126  4348 tablet.cc:1724] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.139976  4351 tablet.cc:1724] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.162859  4354 tablet.cc:1724] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.174664  4357 tablet.cc:1724] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:41.211027  3891 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:43285, user_credentials={real_user=slave}} blocked reactor thread for 119245us
I20260709 13:13:41.243451  4358 tablet.cc:1724] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.149755  4322 tablet.cc:1724] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:41.236680  4336 log.cc:927] Time spent T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Append to log took a long time: real 0.230s	user 0.008s	sys 0.004s
I20260709 13:13:41.224103  4355 tablet.cc:1724] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.262313  4329 tablet.cc:1724] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.281435  4364 tablet.cc:1724] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.290162  4329 tablet.cc:1724] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.307976  4367 tablet.cc:1724] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.271637  4368 tablet.cc:1724] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.344594  4364 tablet.cc:1724] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:41.363252  3966 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:43285, user_credentials={real_user=slave}} blocked reactor thread for 62597.6us
I20260709 13:13:41.307989  4354 tablet.cc:1724] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.377490  4372 tablet.cc:1724] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.381611  4348 tablet.cc:1724] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.398694  4322 tablet.cc:1724] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.400429  4358 tablet.cc:1724] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.403764  4355 tablet.cc:1724] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.409929  4357 tablet.cc:1724] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.420050  4364 tablet.cc:1724] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.424221  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:53620
I20260709 13:13:41.424942  3998 raft_consensus.cc:606] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:41.426755  4357 tablet.cc:1724] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.424242  4351 tablet.cc:1724] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.438858  4368 tablet.cc:1724] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.474646  4372 tablet.cc:1724] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:41.493965  3922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54816fa582994d498763a814fc93f2dd"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:54092
I20260709 13:13:41.494560  3922 raft_consensus.cc:606] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:41.496277 26158 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:41.496901 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:41.506682  3821 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: soft_deleted_table [id=01da3a728fc9468c868dcfd36fad29f8] alter complete (version 1)
I20260709 13:13:41.506736  3998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6"
dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:53620
I20260709 13:13:41.507582  3998 raft_consensus.cc:606] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:41.510877  3922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641"
dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
mode: GRACEFUL
new_leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:54092
I20260709 13:13:41.511458  3922 raft_consensus.cc:606] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Received request to transfer leadership to TS 2ec90502e3764edea9b2d92b64c9ab68
I20260709 13:13:41.512714 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:41.513159 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:41.555295  4375 raft_consensus.cc:993] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.555869  4374 raft_consensus.cc:1081] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.557315  4071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40296
I20260709 13:13:41.557731  4071 raft_consensus.cc:493] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.557969  4071 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.563519  4071 raft_consensus.cc:515] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.565505  4071 leader_election.cc:290] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:41.566236  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:41.566392  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79eb1a52bf4f46c8b10bd29b70231ee6" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:41.566965  3922 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.567021  3998 raft_consensus.cc:3055] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.567544  3998 raft_consensus.cc:740] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:41.568171  3998 consensus_queue.cc:260] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.569168  3998 raft_consensus.cc:3060] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.572475  3922 raft_consensus.cc:2468] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 2.
I20260709 13:13:41.573770  3998 raft_consensus.cc:2468] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 2.
I20260709 13:13:41.573712  4039 leader_election.cc:304] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:41.574877  4366 raft_consensus.cc:2804] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.575359  4366 raft_consensus.cc:697] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:41.576133  4366 consensus_queue.cc:237] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.585940  3822 catalog_manager.cc:5697] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 1 to 2, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.707832  4331 raft_consensus.cc:993] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.708452  4323 raft_consensus.cc:1081] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.710093  4071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40282
I20260709 13:13:41.711001  4071 raft_consensus.cc:493] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.711449  4071 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.717602  4071 raft_consensus.cc:515] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:41.719723  4071 leader_election.cc:290] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Requested vote from peers aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065), e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479)
I20260709 13:13:41.720419  3998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:41.720782  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3661e39f4f7452b8ecd34862d1ba641" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:41.721158  3998 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.721478  3922 raft_consensus.cc:3055] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:41.721887  3922 raft_consensus.cc:740] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:41.722744  3922 consensus_queue.cc:260] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:41.724200  3922 raft_consensus.cc:3060] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.727825  3998 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.728878  4038 leader_election.cc:304] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:41.729621  4366 raft_consensus.cc:2804] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.730111  4366 raft_consensus.cc:697] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:41.731199  3922 raft_consensus.cc:2468] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.731036  4366 consensus_queue.cc:237] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } }
I20260709 13:13:41.738893  3822 catalog_manager.cc:5697] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 2 to 3, leader changed from e80d9cbe545f430db37e3e1785b63752 (127.25.139.129) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.880823  4375 raft_consensus.cc:993] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.881258  4374 raft_consensus.cc:1081] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.882911  4071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40296
I20260709 13:13:41.883515  4071 raft_consensus.cc:493] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.884941  4071 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.889917  4071 raft_consensus.cc:515] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.891709  4071 leader_election.cc:290] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:41.892357  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:41.892767  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc3a12b45894e08863b2c904c067778" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:41.893018  3922 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.893307  3999 raft_consensus.cc:3055] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:41.893641  3999 raft_consensus.cc:740] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aba9e4a9b8c14b4b9f8db3f9b8d0227f, State: Running, Role: LEADER
I20260709 13:13:41.894284  3999 consensus_queue.cc:260] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.895119  3999 raft_consensus.cc:3060] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.898993  3922 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.899539  4331 raft_consensus.cc:993] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: : Instructing follower 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.900059  4323 raft_consensus.cc:1081] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Signalling peer 2ec90502e3764edea9b2d92b64c9ab68 to start an election
I20260709 13:13:41.900429  4039 leader_election.cc:304] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, e80d9cbe545f430db37e3e1785b63752; no voters: 
I20260709 13:13:41.901273  4366 raft_consensus.cc:2804] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.901459  3999 raft_consensus.cc:2468] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.901569  4071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54816fa582994d498763a814fc93f2dd"
dest_uuid: "2ec90502e3764edea9b2d92b64c9ab68"
 from {username='slave'} at 127.0.0.1:40282
I20260709 13:13:41.901837  4366 raft_consensus.cc:697] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:41.902309  4071 raft_consensus.cc:493] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.902935  4366 consensus_queue.cc:237] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.903362  4071 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.910910  4071 raft_consensus.cc:515] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.911218  3822 catalog_manager.cc:5697] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 2 to 3, leader changed from aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.913097  4071 leader_election.cc:290] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Requested vote from peers e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479), aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065)
I20260709 13:13:41.914075  3922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e80d9cbe545f430db37e3e1785b63752"
I20260709 13:13:41.914744  3999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54816fa582994d498763a814fc93f2dd" candidate_uuid: "2ec90502e3764edea9b2d92b64c9ab68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f"
I20260709 13:13:41.914748  3922 raft_consensus.cc:3055] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:41.915448  3999 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.915472  3922 raft_consensus.cc:740] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e80d9cbe545f430db37e3e1785b63752, State: Running, Role: LEADER
I20260709 13:13:41.916961  3922 consensus_queue.cc:260] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.918174  3922 raft_consensus.cc:3060] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:41.922813  3999 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.924177  4038 leader_election.cc:304] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ec90502e3764edea9b2d92b64c9ab68, aba9e4a9b8c14b4b9f8db3f9b8d0227f; no voters: 
I20260709 13:13:41.924839  4366 raft_consensus.cc:2804] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:41.924896  3922 raft_consensus.cc:2468] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ec90502e3764edea9b2d92b64c9ab68 in term 3.
I20260709 13:13:41.925266  4366 raft_consensus.cc:697] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Becoming Leader. State: Replica: 2ec90502e3764edea9b2d92b64c9ab68, State: Running, Role: LEADER
I20260709 13:13:41.926275  4366 consensus_queue.cc:237] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } }
I20260709 13:13:41.933364  3822 catalog_manager.cc:5697] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 reported cstate change: term changed from 2 to 3, leader changed from e80d9cbe545f430db37e3e1785b63752 (127.25.139.129) to 2ec90502e3764edea9b2d92b64c9ab68 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "2ec90502e3764edea9b2d92b64c9ab68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ec90502e3764edea9b2d92b64c9ab68" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:42.048213  3999 raft_consensus.cc:1275] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.049558  4366 consensus_queue.cc:1048] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.059201  3922 raft_consensus.cc:1275] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.060932  4343 consensus_queue.cc:1048] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.111541  3999 raft_consensus.cc:1275] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:42.112812  4343 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:42.123097  3922 raft_consensus.cc:1275] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:42.125468  4390 consensus_queue.cc:1048] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:42.402702  3922 raft_consensus.cc:1275] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:42.403973  4390 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:42.406569  3999 raft_consensus.cc:1275] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:42.407939  4343 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:42.421132  3999 raft_consensus.cc:1275] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:42.423436  4343 consensus_queue.cc:1048] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aba9e4a9b8c14b4b9f8db3f9b8d0227f" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:42.431746  3922 raft_consensus.cc:1275] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Refusing update from remote peer 2ec90502e3764edea9b2d92b64c9ab68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:42.435567  4343 consensus_queue.cc:1048] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e80d9cbe545f430db37e3e1785b63752" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 33479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:42.579311 26158 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:42.584862 26158 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:42.585271 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:42.590214 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:42.590580 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:43.620632 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:13:43.643877  4039 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:43.651929  4039 consensus_peers.cc:597] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.656327 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:43.657017 26158 tablet_replica.cc:333] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.657713 26158 raft_consensus.cc:2243] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.658227 26158 raft_consensus.cc:2272] T 54816fa582994d498763a814fc93f2dd P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.660815 26158 tablet_replica.cc:333] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.661703 26158 raft_consensus.cc:2243] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.662230 26158 raft_consensus.cc:2272] T ddd830f066a74da68969f19dc20be7ae P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.664222 26158 tablet_replica.cc:333] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.664831 26158 raft_consensus.cc:2243] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.665552 26158 raft_consensus.cc:2272] T 5b42566975eb42c2828605a69a3bcd77 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.667477 26158 tablet_replica.cc:333] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.668118 26158 raft_consensus.cc:2243] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.668661 26158 raft_consensus.cc:2272] T 0681d227da934bf984101f9369cfc8d4 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.670388 26158 tablet_replica.cc:333] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.670953 26158 raft_consensus.cc:2243] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.671479 26158 raft_consensus.cc:2272] T 1b166f25ed8046d6bf500a38ed7beaf9 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.672804  3965 consensus_peers.cc:597] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.673512 26158 tablet_replica.cc:333] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.674167 26158 raft_consensus.cc:2243] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.674606 26158 raft_consensus.cc:2272] T 3dc3a12b45894e08863b2c904c067778 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.676983 26158 tablet_replica.cc:333] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.677556 26158 raft_consensus.cc:2243] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.677959 26158 raft_consensus.cc:2272] T d3661e39f4f7452b8ecd34862d1ba641 P e80d9cbe545f430db37e3e1785b63752 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.680090 26158 tablet_replica.cc:333] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.680655 26158 raft_consensus.cc:2243] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.681569 26158 raft_consensus.cc:2272] T a3e252b051f24e88ae0cc0118379659e P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.683533 26158 tablet_replica.cc:333] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.684110 26158 raft_consensus.cc:2243] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.684571 26158 raft_consensus.cc:2272] T 79eb1a52bf4f46c8b10bd29b70231ee6 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.686939 26158 tablet_replica.cc:333] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.687680 26158 raft_consensus.cc:2243] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.688264 26158 raft_consensus.cc:2272] T 80bc5915361e46239d97a9960e0028cb P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.690678 26158 tablet_replica.cc:333] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.691533 26158 raft_consensus.cc:2243] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:43.692274  3965 consensus_peers.cc:597] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.692641 26158 raft_consensus.cc:2272] T e164608b4e1843498a96d8f0c1a2c832 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.695030 26158 tablet_replica.cc:333] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.695565 26158 raft_consensus.cc:2243] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.695922 26158 raft_consensus.cc:2272] T 26e0a1a581cb42a2803664a59fadae65 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.697620 26158 tablet_replica.cc:333] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.698101 26158 raft_consensus.cc:2243] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.698454 26158 raft_consensus.cc:2272] T 11050dd72827424f9b2b3a22f625054f P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.700350 26158 tablet_replica.cc:333] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.700826 26158 raft_consensus.cc:2243] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.701512 26158 raft_consensus.cc:2272] T ace111d9adbe4f8a9bfbdef1e500df8d P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.703590 26158 tablet_replica.cc:333] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.704150 26158 raft_consensus.cc:2243] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.704919 26158 raft_consensus.cc:2272] T 6d1f140580f943c3966975f4733f5d13 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.706909 26158 tablet_replica.cc:333] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.707455 26158 raft_consensus.cc:2243] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.707832 26158 raft_consensus.cc:2272] T a70d383f5a564baaad673830ebc1bf41 P e80d9cbe545f430db37e3e1785b63752 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.709815 26158 tablet_replica.cc:333] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.710234 26158 raft_consensus.cc:2243] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.710888 26158 raft_consensus.cc:2272] T 07ac7f7f63f446ccbe676b3da9549ad2 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.712895 26158 tablet_replica.cc:333] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752: stopping tablet replica
I20260709 13:13:43.713307 26158 raft_consensus.cc:2243] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.713689 26158 raft_consensus.cc:2272] T 8a836cc25c084483998ab7eaae78e234 P e80d9cbe545f430db37e3e1785b63752 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.753713 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
W20260709 13:13:43.755991  3965 consensus_peers.cc:597] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.789232 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
I20260709 13:13:43.822558 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:43.823333 26158 tablet_replica.cc:333] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.823994 26158 raft_consensus.cc:2243] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.824520 26158 raft_consensus.cc:2272] T ddd830f066a74da68969f19dc20be7ae P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.826491 26158 tablet_replica.cc:333] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.827117 26158 raft_consensus.cc:2243] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.827647 26158 raft_consensus.cc:2272] T 5b42566975eb42c2828605a69a3bcd77 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.829591 26158 tablet_replica.cc:333] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.830161 26158 raft_consensus.cc:2243] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.830601 26158 raft_consensus.cc:2272] T 3dc3a12b45894e08863b2c904c067778 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.832451 26158 tablet_replica.cc:333] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.833173 26158 raft_consensus.cc:2243] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.833954 26158 raft_consensus.cc:2272] T 0681d227da934bf984101f9369cfc8d4 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.836149 26158 tablet_replica.cc:333] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.836727 26158 raft_consensus.cc:2243] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.837546 26158 raft_consensus.cc:2272] T 1b166f25ed8046d6bf500a38ed7beaf9 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.839618 26158 tablet_replica.cc:333] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.840191 26158 raft_consensus.cc:2243] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.840670 26158 raft_consensus.cc:2272] T 54816fa582994d498763a814fc93f2dd P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.842662 26158 tablet_replica.cc:333] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.843314 26158 raft_consensus.cc:2243] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.843787 26158 raft_consensus.cc:2272] T d3661e39f4f7452b8ecd34862d1ba641 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.846263 26158 tablet_replica.cc:333] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.847069 26158 raft_consensus.cc:2243] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.847723 26158 raft_consensus.cc:2272] T a3e252b051f24e88ae0cc0118379659e P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.849850 26158 tablet_replica.cc:333] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.850445 26158 raft_consensus.cc:2243] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.850925 26158 raft_consensus.cc:2272] T 07ac7f7f63f446ccbe676b3da9549ad2 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.853029 26158 tablet_replica.cc:333] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.853781 26158 raft_consensus.cc:2243] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.854669 26158 raft_consensus.cc:2272] T 8a836cc25c084483998ab7eaae78e234 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.857575 26158 tablet_replica.cc:333] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.858367 26158 raft_consensus.cc:2243] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.859233 26158 raft_consensus.cc:2272] T 26e0a1a581cb42a2803664a59fadae65 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.861265 26158 tablet_replica.cc:333] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.861842 26158 raft_consensus.cc:2243] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.862640 26158 raft_consensus.cc:2272] T 11050dd72827424f9b2b3a22f625054f P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.864979 26158 tablet_replica.cc:333] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.865648 26158 raft_consensus.cc:2243] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.866088 26158 raft_consensus.cc:2272] T ace111d9adbe4f8a9bfbdef1e500df8d P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.868271 26158 tablet_replica.cc:333] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.868829 26158 raft_consensus.cc:2243] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.869251 26158 raft_consensus.cc:2272] T 79eb1a52bf4f46c8b10bd29b70231ee6 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.871508 26158 tablet_replica.cc:333] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.872052 26158 raft_consensus.cc:2243] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.872928 26158 raft_consensus.cc:2272] T a70d383f5a564baaad673830ebc1bf41 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.875304 26158 tablet_replica.cc:333] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.875875 26158 raft_consensus.cc:2243] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.876454 26158 raft_consensus.cc:2272] T 6d1f140580f943c3966975f4733f5d13 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.879410 26158 tablet_replica.cc:333] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.880177 26158 raft_consensus.cc:2243] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.880745 26158 raft_consensus.cc:2272] T 80bc5915361e46239d97a9960e0028cb P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.882015  4039 consensus_peers.cc:597] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.883496 26158 tablet_replica.cc:333] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f: stopping tablet replica
I20260709 13:13:43.884210 26158 raft_consensus.cc:2243] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.884675 26158 raft_consensus.cc:2272] T e164608b4e1843498a96d8f0c1a2c832 P aba9e4a9b8c14b4b9f8db3f9b8d0227f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:43.892686  4038 consensus_peers.cc:597] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Couldn't send request to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.926182 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
W20260709 13:13:43.940968  4039 consensus_peers.cc:597] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.959900 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
I20260709 13:13:43.989495 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:43.990275 26158 tablet_replica.cc:333] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:43.991242 26158 raft_consensus.cc:2243] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:43.992238  4038 consensus_peers.cc:597] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer aba9e4a9b8c14b4b9f8db3f9b8d0227f (127.25.139.130:46065): Couldn't send request to peer aba9e4a9b8c14b4b9f8db3f9b8d0227f. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:46065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:43.992259 26158 raft_consensus.cc:2272] T ddd830f066a74da68969f19dc20be7ae P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.994343 26158 tablet_replica.cc:333] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:43.994995 26158 raft_consensus.cc:2243] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:43.995779 26158 raft_consensus.cc:2272] T 54816fa582994d498763a814fc93f2dd P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:43.997743 26158 tablet_replica.cc:333] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:43.998318 26158 raft_consensus.cc:2243] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:43.998752 26158 raft_consensus.cc:2272] T 5b42566975eb42c2828605a69a3bcd77 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.000573 26158 tablet_replica.cc:333] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.001125 26158 raft_consensus.cc:2243] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.001551 26158 raft_consensus.cc:2272] T 0681d227da934bf984101f9369cfc8d4 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.003718 26158 tablet_replica.cc:333] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.004258 26158 raft_consensus.cc:2243] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:44.004999 26158 raft_consensus.cc:2272] T 3dc3a12b45894e08863b2c904c067778 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.006824 26158 tablet_replica.cc:333] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.007388 26158 raft_consensus.cc:2243] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.007808 26158 raft_consensus.cc:2272] T 1b166f25ed8046d6bf500a38ed7beaf9 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.009575 26158 tablet_replica.cc:333] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.010097 26158 raft_consensus.cc:2243] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:44.010818 26158 raft_consensus.cc:2272] T d3661e39f4f7452b8ecd34862d1ba641 P 2ec90502e3764edea9b2d92b64c9ab68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.012813 26158 tablet_replica.cc:333] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.013371 26158 raft_consensus.cc:2243] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.013798 26158 raft_consensus.cc:2272] T a3e252b051f24e88ae0cc0118379659e P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.015726 26158 tablet_replica.cc:333] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.016268 26158 raft_consensus.cc:2243] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:44.017096 26158 raft_consensus.cc:2272] T 80bc5915361e46239d97a9960e0028cb P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.019083 26158 tablet_replica.cc:333] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.019742 26158 raft_consensus.cc:2243] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.020195 26158 raft_consensus.cc:2272] T ace111d9adbe4f8a9bfbdef1e500df8d P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.022162 26158 tablet_replica.cc:333] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.022673 26158 raft_consensus.cc:2243] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.023099 26158 raft_consensus.cc:2272] T 26e0a1a581cb42a2803664a59fadae65 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.025295 26158 tablet_replica.cc:333] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.025894 26158 raft_consensus.cc:2243] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.026345 26158 raft_consensus.cc:2272] T 11050dd72827424f9b2b3a22f625054f P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.028576 26158 tablet_replica.cc:333] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.029202 26158 raft_consensus.cc:2243] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:44.029398  4039 consensus_peers.cc:597] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 -> Peer e80d9cbe545f430db37e3e1785b63752 (127.25.139.129:33479): Couldn't send request to peer e80d9cbe545f430db37e3e1785b63752. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:33479: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:44.029662 26158 raft_consensus.cc:2272] T 6d1f140580f943c3966975f4733f5d13 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.031701 26158 tablet_replica.cc:333] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.032205 26158 raft_consensus.cc:2243] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.032596 26158 raft_consensus.cc:2272] T a70d383f5a564baaad673830ebc1bf41 P 2ec90502e3764edea9b2d92b64c9ab68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.034466 26158 tablet_replica.cc:333] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.034973 26158 raft_consensus.cc:2243] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.035415 26158 raft_consensus.cc:2272] T 07ac7f7f63f446ccbe676b3da9549ad2 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.037159 26158 tablet_replica.cc:333] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.037645 26158 raft_consensus.cc:2243] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.038048 26158 raft_consensus.cc:2272] T 8a836cc25c084483998ab7eaae78e234 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.039904 26158 tablet_replica.cc:333] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.040381 26158 raft_consensus.cc:2243] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:44.041285 26158 raft_consensus.cc:2272] T 79eb1a52bf4f46c8b10bd29b70231ee6 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.043092 26158 tablet_replica.cc:333] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68: stopping tablet replica
I20260709 13:13:44.043634 26158 raft_consensus.cc:2243] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:44.044077 26158 raft_consensus.cc:2272] T e164608b4e1843498a96d8f0c1a2c832 P 2ec90502e3764edea9b2d92b64c9ab68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.080883 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:13:44.112382 26158 master.cc:562] Master@127.25.139.190:39493 shutting down...
I20260709 13:13:44.133458 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:44.134037 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:44.134323 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P 340bd6f2019e476d9a8678e32fee9dd9: stopping tablet replica
I20260709 13:13:44.154459 26158 master.cc:584] Master@127.25.139.190:39493 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12771 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:44.207517 26158 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.139.190:33673
I20260709 13:13:44.208582 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.213919  4400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.214226  4401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.215274  4403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.216279 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:44.217298 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.217474 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.217588 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602824217578 us; error 0 us; skew 500 ppm
I20260709 13:13:44.218086 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.220484 26158 webserver.cc:533] Webserver started at http://127.25.139.190:38525/ using document root <none> and password file <none>
I20260709 13:13:44.220913 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.221068 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.221277 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.222323 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/master-0-root/instance:
uuid: "831772deecf840848208e676b8589866"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.227113 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:44.230614  4408 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.231449 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:44.231716 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/master-0-root
uuid: "831772deecf840848208e676b8589866"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.231969 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.252220 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.253337 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.292011 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.190:33673
I20260709 13:13:44.292106  4459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.190:33673 every 8 connection(s)
I20260709 13:13:44.295769  4460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.306411  4460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: Bootstrap starting.
I20260709 13:13:44.311125  4460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.315300  4460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: No bootstrap required, opened a new log
I20260709 13:13:44.317414  4460 raft_consensus.cc:359] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER }
I20260709 13:13:44.317787  4460 raft_consensus.cc:385] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.317966  4460 raft_consensus.cc:740] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 831772deecf840848208e676b8589866, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.318436  4460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER }
I20260709 13:13:44.318833  4460 raft_consensus.cc:399] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:44.319016  4460 raft_consensus.cc:493] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:44.319300  4460 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.323935  4460 raft_consensus.cc:515] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER }
I20260709 13:13:44.324404  4460 leader_election.cc:304] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 831772deecf840848208e676b8589866; no voters: 
I20260709 13:13:44.325559  4460 leader_election.cc:290] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:44.326013  4463 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:44.327425  4463 raft_consensus.cc:697] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 1 LEADER]: Becoming Leader. State: Replica: 831772deecf840848208e676b8589866, State: Running, Role: LEADER
I20260709 13:13:44.328097  4463 consensus_queue.cc:237] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER }
I20260709 13:13:44.328456  4460 sys_catalog.cc:565] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:44.333010  4465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 831772deecf840848208e676b8589866. Latest consensus state: current_term: 1 leader_uuid: "831772deecf840848208e676b8589866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER } }
I20260709 13:13:44.333787  4465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:44.335737  4464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "831772deecf840848208e676b8589866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "831772deecf840848208e676b8589866" member_type: VOTER } }
I20260709 13:13:44.336541  4464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:44.341218  4471 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:44.346658  4471 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:44.347824 26158 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:44.355527  4471 catalog_manager.cc:1383] Generated new cluster ID: f3748c6175bb49978f1222235e4207b3
I20260709 13:13:44.355805  4471 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:44.378064  4471 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:44.379513  4471 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:44.392256  4471 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: Generated new TSK 0
I20260709 13:13:44.392913  4471 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:44.414582 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.420805  4481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.421854  4482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.423681  4484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.426175 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:44.427237 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.427464 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.427624 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602824427610 us; error 0 us; skew 500 ppm
I20260709 13:13:44.428135 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.430757 26158 webserver.cc:533] Webserver started at http://127.25.139.129:33797/ using document root <none> and password file <none>
I20260709 13:13:44.431325 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.431540 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.431813 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.432919 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-0-root/instance:
uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.437620 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:44.441468  4489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.442272 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:44.442660 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-0-root
uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.442970 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.454336 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.455770 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.457327 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.459842 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.460088 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.460348 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.460573 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.504658 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.129:44369
I20260709 13:13:44.504752  4551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.129:44369 every 8 connection(s)
I20260709 13:13:44.509912 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.517453  4556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.518510  4557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.521560  4559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.522218 26158 server_base.cc:1061] running on GCE node
I20260709 13:13:44.523818 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.524103 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.524329 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602824524308 us; error 0 us; skew 500 ppm
I20260709 13:13:44.524474  4552 heartbeater.cc:344] Connected to a master server at 127.25.139.190:33673
I20260709 13:13:44.524981  4552 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.524982 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.526013  4552 heartbeater.cc:507] Master 127.25.139.190:33673 requested a full tablet report, sending...
I20260709 13:13:44.527949 26158 webserver.cc:533] Webserver started at http://127.25.139.130:34801/ using document root <none> and password file <none>
I20260709 13:13:44.528687 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.528738  4425 ts_manager.cc:194] Registered new tserver with Master: 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369)
I20260709 13:13:44.529006 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.529399 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.530920 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-1-root/instance:
uuid: "49bcc972a6954c15b0071ed6e7008adb"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.531368  4425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46272
I20260709 13:13:44.536149 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:13:44.539623  4564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.540382 26158 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:13:44.540678 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-1-root
uuid: "49bcc972a6954c15b0071ed6e7008adb"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.540946 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.559507 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.560859 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.562429 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.564847 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.565102 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.565361 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.565557 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.607971 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.130:35355
I20260709 13:13:44.608107  4626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.130:35355 every 8 connection(s)
I20260709 13:13:44.612944 26158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:44.620555  4630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:44.621824  4631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.625134 26158 server_base.cc:1061] running on GCE node
W20260709 13:13:44.626165  4633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:44.626812  4627 heartbeater.cc:344] Connected to a master server at 127.25.139.190:33673
I20260709 13:13:44.627272  4627 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.627280 26158 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:44.627671 26158 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:44.627846 26158 hybrid_clock.cc:648] HybridClock initialized: now 1783602824627829 us; error 0 us; skew 500 ppm
I20260709 13:13:44.628129  4627 heartbeater.cc:507] Master 127.25.139.190:33673 requested a full tablet report, sending...
I20260709 13:13:44.628490 26158 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:44.630649  4425 ts_manager.cc:194] Registered new tserver with Master: 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:44.631665 26158 webserver.cc:533] Webserver started at http://127.25.139.131:42229/ using document root <none> and password file <none>
I20260709 13:13:44.632215 26158 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:44.632272  4425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46280
I20260709 13:13:44.632409 26158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:44.632929 26158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:44.634366 26158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-2-root/instance:
uuid: "cf292d9428b148369c2c83785ff142d5"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.638898 26158 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:44.642606  4638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.643705 26158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:44.644002 26158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-2-root
uuid: "cf292d9428b148369c2c83785ff142d5"
format_stamp: "Formatted at 2026-07-09 13:13:44 on dist-test-slave-v5z2"
I20260709 13:13:44.644343 26158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskKqnErv/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602475805276-26158-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:44.669770 26158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:44.670949 26158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:44.672611 26158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:44.674953 26158 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:44.675140 26158 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.675462 26158 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:44.675603 26158 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:44.721697 26158 rpc_server.cc:307] RPC server started. Bound to: 127.25.139.131:39941
I20260709 13:13:44.721827  4700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.25.139.131:39941 every 8 connection(s)
I20260709 13:13:44.737069  4701 heartbeater.cc:344] Connected to a master server at 127.25.139.190:33673
I20260709 13:13:44.737591  4701 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:44.738361  4701 heartbeater.cc:507] Master 127.25.139.190:33673 requested a full tablet report, sending...
I20260709 13:13:44.740623  4425 ts_manager.cc:194] Registered new tserver with Master: cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:44.741155 26158 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01604903s
I20260709 13:13:44.742591  4425 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46296
I20260709 13:13:44.769048  4425 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46302:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:44.771975  4425 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:44.864355  4515 tablet_service.cc:1511] Processing CreateTablet for tablet facafb6b93cb46688b169a5c892fdc45 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.865586  4517 tablet_service.cc:1511] Processing CreateTablet for tablet 4dee98a00ba0464cba88b71ee4fbf9cb (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.864355  4516 tablet_service.cc:1511] Processing CreateTablet for tablet ff2089edb7074977876c3e78460cda19 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.868803  4666 tablet_service.cc:1511] Processing CreateTablet for tablet 4dee98a00ba0464cba88b71ee4fbf9cb (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.870189  4666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dee98a00ba0464cba88b71ee4fbf9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.872282  4665 tablet_service.cc:1511] Processing CreateTablet for tablet ff2089edb7074977876c3e78460cda19 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.872501  4513 tablet_service.cc:1511] Processing CreateTablet for tablet 40808295b45547c2b12cb77ceeca2f05 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.873662  4665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2089edb7074977876c3e78460cda19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.875509  4664 tablet_service.cc:1511] Processing CreateTablet for tablet facafb6b93cb46688b169a5c892fdc45 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.875811  4511 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9f458ae32444d09070793091a2e6bf (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.877055  4664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facafb6b93cb46688b169a5c892fdc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.878167  4512 tablet_service.cc:1511] Processing CreateTablet for tablet 266b68ba75ec4ed1b8fb5c5467eca15e (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.879709  4514 tablet_service.cc:1511] Processing CreateTablet for tablet 103537ab1070436bab819689e8638b10 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.866153  4515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facafb6b93cb46688b169a5c892fdc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.880420  4663 tablet_service.cc:1511] Processing CreateTablet for tablet 103537ab1070436bab819689e8638b10 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.881291  4514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103537ab1070436bab819689e8638b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.881964  4513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40808295b45547c2b12cb77ceeca2f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.882073  4592 tablet_service.cc:1511] Processing CreateTablet for tablet 4dee98a00ba0464cba88b71ee4fbf9cb (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.883342  4662 tablet_service.cc:1511] Processing CreateTablet for tablet 40808295b45547c2b12cb77ceeca2f05 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.884405  4591 tablet_service.cc:1511] Processing CreateTablet for tablet ff2089edb7074977876c3e78460cda19 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.884518  4509 tablet_service.cc:1511] Processing CreateTablet for tablet c9f5dafbd0f640d8906547a9955911aa (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.885730  4661 tablet_service.cc:1511] Processing CreateTablet for tablet 266b68ba75ec4ed1b8fb5c5467eca15e (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.886409  4590 tablet_service.cc:1511] Processing CreateTablet for tablet facafb6b93cb46688b169a5c892fdc45 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.886675  4510 tablet_service.cc:1511] Processing CreateTablet for tablet b41b0d0d461f437698d5d6e295529809 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.888406  4589 tablet_service.cc:1511] Processing CreateTablet for tablet 103537ab1070436bab819689e8638b10 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.890234  4588 tablet_service.cc:1511] Processing CreateTablet for tablet 40808295b45547c2b12cb77ceeca2f05 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.890811  4509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f5dafbd0f640d8906547a9955911aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.892257  4658 tablet_service.cc:1511] Processing CreateTablet for tablet c9f5dafbd0f640d8906547a9955911aa (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.893505  4586 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9f458ae32444d09070793091a2e6bf (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.892273  4587 tablet_service.cc:1511] Processing CreateTablet for tablet 266b68ba75ec4ed1b8fb5c5467eca15e (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.894615  4659 tablet_service.cc:1511] Processing CreateTablet for tablet b41b0d0d461f437698d5d6e295529809 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.895558  4510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41b0d0d461f437698d5d6e295529809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.896879  4585 tablet_service.cc:1511] Processing CreateTablet for tablet b41b0d0d461f437698d5d6e295529809 (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.896878  4660 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9f458ae32444d09070793091a2e6bf (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.899260  4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2089edb7074977876c3e78460cda19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.899777  4584 tablet_service.cc:1511] Processing CreateTablet for tablet c9f5dafbd0f640d8906547a9955911aa (DEFAULT_TABLE table=test-workload [id=58948f7f94e74008ab784efb86c816f0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.900415  4592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dee98a00ba0464cba88b71ee4fbf9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.900878  4517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dee98a00ba0464cba88b71ee4fbf9cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.902042  4512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266b68ba75ec4ed1b8fb5c5467eca15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.881856  4663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103537ab1070436bab819689e8638b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.903458  4585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41b0d0d461f437698d5d6e295529809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.904681  4589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 103537ab1070436bab819689e8638b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.906708  4586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9f458ae32444d09070793091a2e6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.911862  4587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266b68ba75ec4ed1b8fb5c5467eca15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.912529  4591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff2089edb7074977876c3e78460cda19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.913209  4584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f5dafbd0f640d8906547a9955911aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.914513  4588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40808295b45547c2b12cb77ceeca2f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.919517  4590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facafb6b93cb46688b169a5c892fdc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.904708  4658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9f5dafbd0f640d8906547a9955911aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.927549  4660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9f458ae32444d09070793091a2e6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.930367  4661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266b68ba75ec4ed1b8fb5c5467eca15e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.931244  4659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41b0d0d461f437698d5d6e295529809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.932605  4662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40808295b45547c2b12cb77ceeca2f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.933693  4511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9f458ae32444d09070793091a2e6bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:45.013051  4717 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.016360  4716 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.020339  4718 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.041548  4717 tablet_bootstrap.cc:654] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.051405  4718 tablet_bootstrap.cc:654] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.053998  4716 tablet_bootstrap.cc:654] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.059123  4717 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.059674  4717 ts_tablet_manager.cc:1403] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.013s
I20260709 13:13:45.063314  4717 raft_consensus.cc:359] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.064235  4717 raft_consensus.cc:385] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.064610  4717 raft_consensus.cc:740] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.066982  4717 consensus_queue.cc:260] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.071012  4718 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.071801  4718 ts_tablet_manager.cc:1403] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.008s
I20260709 13:13:45.075588  4716 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.075793  4627 heartbeater.cc:499] Master 127.25.139.190:33673 was elected leader, sending a full tablet report...
I20260709 13:13:45.076148  4716 ts_tablet_manager.cc:1403] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.004s
I20260709 13:13:45.077145  4718 raft_consensus.cc:359] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.079584  4718 raft_consensus.cc:385] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.079978  4718 raft_consensus.cc:740] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.080399  4716 raft_consensus.cc:359] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.079200  4717 ts_tablet_manager.cc:1434] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.005s
I20260709 13:13:45.081322  4716 raft_consensus.cc:385] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.081665  4716 raft_consensus.cc:740] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.082247  4717 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.083017  4716 consensus_queue.cc:260] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.091455  4717 tablet_bootstrap.cc:654] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.080823  4718 consensus_queue.cc:260] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.093364  4716 ts_tablet_manager.cc:1434] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:13:45.093818  4552 heartbeater.cc:499] Master 127.25.139.190:33673 was elected leader, sending a full tablet report...
I20260709 13:13:45.094272  4701 heartbeater.cc:499] Master 127.25.139.190:33673 was elected leader, sending a full tablet report...
I20260709 13:13:45.101935  4718 ts_tablet_manager.cc:1434] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 13:13:45.103329  4718 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.110718  4718 tablet_bootstrap.cc:654] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.101961  4716 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.122995  4722 raft_consensus.cc:493] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.123656  4722 raft_consensus.cc:515] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.125085  4716 tablet_bootstrap.cc:654] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.137173  4722 leader_election.cc:290] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.139760  4716 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.142510  4716 ts_tablet_manager.cc:1403] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.005s
I20260709 13:13:45.145697  4718 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.145818  4716 raft_consensus.cc:359] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.146641  4718 ts_tablet_manager.cc:1403] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.044s	user 0.033s	sys 0.009s
I20260709 13:13:45.146853  4716 raft_consensus.cc:385] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.147279  4716 raft_consensus.cc:740] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.148036  4716 consensus_queue.cc:260] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.150815  4718 raft_consensus.cc:359] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.151836  4716 ts_tablet_manager.cc:1434] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:13:45.151945  4718 raft_consensus.cc:385] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.152520  4718 raft_consensus.cc:740] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.152985  4716 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.153471  4718 consensus_queue.cc:260] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.156302  4718 ts_tablet_manager.cc:1434] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:45.158416  4717 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.159122  4717 ts_tablet_manager.cc:1403] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.009s
I20260709 13:13:45.159690  4716 tablet_bootstrap.cc:654] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.162657  4717 raft_consensus.cc:359] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.164244  4717 raft_consensus.cc:385] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.164654  4717 raft_consensus.cc:740] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.165678  4717 consensus_queue.cc:260] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.168201  4717 ts_tablet_manager.cc:1434] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:45.169472  4717 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.168265  4718 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.176209  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
W20260709 13:13:45.177979  4566 leader_election.cc:343] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.180593  4717 tablet_bootstrap.cc:654] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.181893  4718 tablet_bootstrap.cc:654] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.181775  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
W20260709 13:13:45.183579  4567 leader_election.cc:343] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.184083  4567 leader_election.cc:304] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5
I20260709 13:13:45.185539  4722 raft_consensus.cc:2749] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.188560  4716 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.189055  4716 ts_tablet_manager.cc:1403] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.006s
I20260709 13:13:45.191320  4716 raft_consensus.cc:359] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.192117  4716 raft_consensus.cc:385] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.192443  4716 raft_consensus.cc:740] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.193198  4716 consensus_queue.cc:260] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.193799  4717 tablet_bootstrap.cc:492] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.194286  4718 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.194407  4717 ts_tablet_manager.cc:1403] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:13:45.194840  4718 ts_tablet_manager.cc:1403] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.001s
I20260709 13:13:45.195355  4716 ts_tablet_manager.cc:1434] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:45.196422  4716 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.197796  4718 raft_consensus.cc:359] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.198588  4718 raft_consensus.cc:385] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.198179  4717 raft_consensus.cc:359] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.198920  4718 raft_consensus.cc:740] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.199328  4717 raft_consensus.cc:385] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.200016  4717 raft_consensus.cc:740] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.199781  4718 consensus_queue.cc:260] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.201015  4717 consensus_queue.cc:260] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.203034  4716 tablet_bootstrap.cc:654] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.204926  4718 ts_tablet_manager.cc:1434] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:45.206102  4718 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.207746  4722 raft_consensus.cc:493] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.208324  4722 raft_consensus.cc:515] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.211992  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.214228  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.214774  4718 tablet_bootstrap.cc:654] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:45.216794  4567 leader_election.cc:343] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:45.217725  4566 leader_election.cc:343] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.218236  4566 leader_election.cc:304] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5
I20260709 13:13:45.219985  4722 leader_election.cc:290] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.220639  4722 raft_consensus.cc:2749] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.224025  4717 ts_tablet_manager.cc:1434] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.001s
I20260709 13:13:45.225396  4716 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.226109  4724 raft_consensus.cc:493] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.226279  4716 ts_tablet_manager.cc:1403] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.009s
I20260709 13:13:45.226641  4724 raft_consensus.cc:515] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.225600  4717 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.229477  4724 leader_election.cc:290] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.229897  4716 raft_consensus.cc:359] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.230762  4716 raft_consensus.cc:385] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.231070  4716 raft_consensus.cc:740] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.232123  4716 consensus_queue.cc:260] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.238219  4717 tablet_bootstrap.cc:654] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.244007  4718 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.244014  4716 ts_tablet_manager.cc:1434] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:13:45.244701  4718 ts_tablet_manager.cc:1403] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.039s	user 0.027s	sys 0.005s
I20260709 13:13:45.249084  4718 raft_consensus.cc:359] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.251740  4718 raft_consensus.cc:385] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.253085  4716 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.254297  4718 raft_consensus.cc:740] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.255235  4718 consensus_queue.cc:260] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.261289  4718 ts_tablet_manager.cc:1434] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.004s
I20260709 13:13:45.262073  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.262378  4718 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.262825  4602 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:45.264217  4491 leader_election.cc:304] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.265108  4724 raft_consensus.cc:2804] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.265486  4724 raft_consensus.cc:493] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.265834  4724 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.269284  4718 tablet_bootstrap.cc:654] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.274454  4724 raft_consensus.cc:515] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.279369  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:45.280223  4602 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.282460  4716 tablet_bootstrap.cc:654] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.298691  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.299746  4676 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:45.302548  4723 raft_consensus.cc:493] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.303278  4723 raft_consensus.cc:515] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.314517  4723 leader_election.cc:290] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:45.320930  4724 leader_election.cc:290] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.329487  4717 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.330950  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.331835  4676 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.338690  4676 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:45.294606  4602 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:45.340123  4492 leader_election.cc:304] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
W20260709 13:13:45.340582  4473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:45.340893  4717 ts_tablet_manager.cc:1403] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.116s	user 0.026s	sys 0.067s
I20260709 13:13:45.343075  4724 raft_consensus.cc:2804] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.344906  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.345911  4602 raft_consensus.cc:2393] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf292d9428b148369c2c83785ff142d5 in current term 1: Already voted for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in this term.
I20260709 13:13:45.348055  4717 raft_consensus.cc:359] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.348850  4718 tablet_bootstrap.cc:492] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.349025  4717 raft_consensus.cc:385] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.349476  4716 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.349740  4718 ts_tablet_manager.cc:1403] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.050s
I20260709 13:13:45.349684  4717 raft_consensus.cc:740] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.350046  4716 ts_tablet_manager.cc:1403] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.041s
I20260709 13:13:45.351254  4717 consensus_queue.cc:260] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.353375  4718 raft_consensus.cc:359] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.353790  4716 raft_consensus.cc:359] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.354295  4718 raft_consensus.cc:385] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.354674  4716 raft_consensus.cc:385] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.354748  4718 raft_consensus.cc:740] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.355181  4716 raft_consensus.cc:740] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.355768  4718 consensus_queue.cc:260] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.356055  4716 consensus_queue.cc:260] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.357241  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.359187  4716 ts_tablet_manager.cc:1434] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:13:45.359771  4735 raft_consensus.cc:493] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.360333  4735 raft_consensus.cc:515] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.361647  4724 raft_consensus.cc:697] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:45.364101  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.364944  4723 raft_consensus.cc:493] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.365510  4723 raft_consensus.cc:515] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
W20260709 13:13:45.365998  4567 leader_election.cc:343] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.366192  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.367069  4526 raft_consensus.cc:2468] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.362948  4724 consensus_queue.cc:237] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.368871  4566 leader_election.cc:304] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:45.369856  4722 raft_consensus.cc:2804] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.370255  4722 raft_consensus.cc:493] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.370608  4722 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.375062  4716 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.364421  4735 leader_election.cc:290] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.379050  4723 leader_election.cc:290] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:45.379505  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.380266  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.385567  4526 raft_consensus.cc:2468] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 0.
W20260709 13:13:45.386293  4640 leader_election.cc:343] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.387181  4640 leader_election.cc:304] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:45.388445  4723 raft_consensus.cc:2804] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.389308  4723 raft_consensus.cc:493] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.390158  4723 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.394722  4716 tablet_bootstrap.cc:654] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.398306  4717 ts_tablet_manager.cc:1434] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:13:45.383953  4722 raft_consensus.cc:515] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.404140  4722 leader_election.cc:290] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.404357  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.415571  4526 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.409159  4717 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.413511  4716 tablet_bootstrap.cc:492] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.416517  4716 ts_tablet_manager.cc:1403] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.007s
I20260709 13:13:45.416471  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.420625  4716 raft_consensus.cc:359] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.421486  4716 raft_consensus.cc:385] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.423666  4526 raft_consensus.cc:2468] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.429005  4716 raft_consensus.cc:740] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.426537  4718 ts_tablet_manager.cc:1434] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.076s	user 0.043s	sys 0.034s
I20260709 13:13:45.429759  4566 leader_election.cc:304] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.430478  4718 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.430647  4722 raft_consensus.cc:2804] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.413904  4723 raft_consensus.cc:515] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.431272  4722 raft_consensus.cc:697] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:45.430893  4425 catalog_manager.cc:5697] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.432175  4722 consensus_queue.cc:237] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.433025  4723 leader_election.cc:290] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:45.428615  4717 tablet_bootstrap.cc:654] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.430174  4640 leader_election.cc:304] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:45.437811  4723 raft_consensus.cc:2749] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.439286  4718 tablet_bootstrap.cc:654] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.439527  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.440395  4527 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.446273  4717 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.447062  4717 ts_tablet_manager.cc:1403] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:13:45.450363  4527 raft_consensus.cc:2468] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 1.
I20260709 13:13:45.431272  4716 consensus_queue.cc:260] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:45.451141  4676 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.452577  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
W20260709 13:13:45.454186  4640 leader_election.cc:343] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.454859  4640 leader_election.cc:304] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:45.455675  4723 raft_consensus.cc:2804] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.456161  4723 raft_consensus.cc:697] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:45.456975  4723 consensus_queue.cc:237] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.458799  4676 raft_consensus.cc:2468] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.462069  4716 ts_tablet_manager.cc:1434] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:13:45.468216  4716 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.475260  4716 tablet_bootstrap.cc:654] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.450167  4717 raft_consensus.cc:359] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.476260  4717 raft_consensus.cc:385] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.476639  4717 raft_consensus.cc:740] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.476924  4724 raft_consensus.cc:493] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.477820  4746 raft_consensus.cc:493] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.477628  4724 raft_consensus.cc:515] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.478407  4746 raft_consensus.cc:515] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.480983  4746 leader_election.cc:290] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:45.482180  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.482724  4717 consensus_queue.cc:260] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
W20260709 13:13:45.484354  4491 leader_election.cc:343] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.485404  4717 ts_tablet_manager.cc:1434] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 13:13:45.484633  4424 catalog_manager.cc:5697] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.486493  4717 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.487469  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.488413  4527 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 0.
I20260709 13:13:45.489328  4422 catalog_manager.cc:5697] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.490198  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.491143  4602 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 0.
I20260709 13:13:45.492486  4724 leader_election.cc:290] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.494451  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.494266  4640 leader_election.cc:304] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.495227  4676 raft_consensus.cc:2468] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:45.495622  4746 raft_consensus.cc:2804] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.496423  4746 raft_consensus.cc:493] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.496788  4717 tablet_bootstrap.cc:654] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.496809  4746 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.497891  4492 leader_election.cc:304] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:45.499536  4724 raft_consensus.cc:2804] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.500051  4724 raft_consensus.cc:493] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.500432  4724 raft_consensus.cc:3060] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.504369  4716 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.504966  4716 ts_tablet_manager.cc:1403] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.007s
I20260709 13:13:45.508037  4724 raft_consensus.cc:515] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.508188  4716 raft_consensus.cc:359] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.509253  4716 raft_consensus.cc:385] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.510766  4716 raft_consensus.cc:740] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.513284  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:45.513561  4716 consensus_queue.cc:260] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.511459  4718 tablet_bootstrap.cc:492] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
W20260709 13:13:45.514740  4491 leader_election.cc:343] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.509963  4746 raft_consensus.cc:515] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.514783  4724 leader_election.cc:290] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.516836  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.517565  4716 ts_tablet_manager.cc:1434] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:13:45.517632  4746 leader_election.cc:290] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:45.518702  4716 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.519639  4717 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.519508  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:45.520200  4717 ts_tablet_manager.cc:1403] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260709 13:13:45.517678  4718 ts_tablet_manager.cc:1403] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.032s
I20260709 13:13:45.517661  4676 raft_consensus.cc:3060] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.523761  4718 raft_consensus.cc:359] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.524015  4717 raft_consensus.cc:359] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.524582  4718 raft_consensus.cc:385] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.524742  4717 raft_consensus.cc:385] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.525118  4718 raft_consensus.cc:740] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.525120  4717 raft_consensus.cc:740] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.525538  4716 tablet_bootstrap.cc:654] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.526261  4718 consensus_queue.cc:260] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.526418  4717 consensus_queue.cc:260] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.520196  4602 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.519531  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.529170  4717 ts_tablet_manager.cc:1434] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:45.529182  4718 ts_tablet_manager.cc:1434] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:45.530362  4717 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.530519  4718 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.529476  4527 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.537407  4676 raft_consensus.cc:2468] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:45.537686  4717 tablet_bootstrap.cc:654] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.537686  4718 tablet_bootstrap.cc:654] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.535036  4602 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 1.
I20260709 13:13:45.540690  4492 leader_election.cc:304] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:45.541489  4724 raft_consensus.cc:2804] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.541971  4724 raft_consensus.cc:697] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:45.542491  4640 leader_election.cc:304] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.543345  4746 raft_consensus.cc:2804] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.542825  4724 consensus_queue.cc:237] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.543869  4746 raft_consensus.cc:697] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:45.544705  4746 consensus_queue.cc:237] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.568161  4744 raft_consensus.cc:493] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.568979  4744 raft_consensus.cc:515] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.571765  4744 leader_election.cc:290] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.572683  4527 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 1.
I20260709 13:13:45.574018  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:45.575233  4602 raft_consensus.cc:2468] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:45.577610  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.579823  4676 raft_consensus.cc:2468] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:45.581210  4492 leader_election.cc:304] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.583616  4724 raft_consensus.cc:2804] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.584182  4724 raft_consensus.cc:493] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.584704  4724 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.595180  4724 raft_consensus.cc:515] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.598094  4724 leader_election.cc:290] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.601815  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.603789  4717 tablet_bootstrap.cc:492] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.604355  4717 ts_tablet_manager.cc:1403] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.002s
I20260709 13:13:45.604540  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:45.605134  4602 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.605350  4422 catalog_manager.cc:5697] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.607069  4717 raft_consensus.cc:359] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.607811  4717 raft_consensus.cc:385] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.608048  4717 raft_consensus.cc:740] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.609237  4717 consensus_queue.cc:260] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.609200  4425 catalog_manager.cc:5697] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.611786  4717 ts_tablet_manager.cc:1434] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:45.603968  4676 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.612874  4717 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.613544  4602 raft_consensus.cc:2468] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:45.618001  4491 leader_election.cc:304] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.619251  4717 tablet_bootstrap.cc:654] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.620842  4716 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.621383  4716 ts_tablet_manager.cc:1403] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.103s	user 0.040s	sys 0.024s
I20260709 13:13:45.622916  4724 raft_consensus.cc:2804] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.623741  4724 raft_consensus.cc:697] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:45.624624  4724 consensus_queue.cc:237] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.627409  4716 raft_consensus.cc:359] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.628398  4716 raft_consensus.cc:385] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.628767  4716 raft_consensus.cc:740] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.629958  4716 consensus_queue.cc:260] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.633745  4716 ts_tablet_manager.cc:1434] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:45.634743  4716 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:45.636296  4718 tablet_bootstrap.cc:492] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.636859  4718 ts_tablet_manager.cc:1403] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.107s	user 0.030s	sys 0.028s
I20260709 13:13:45.636945  4717 tablet_bootstrap.cc:492] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.637576  4717 ts_tablet_manager.cc:1403] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:13:45.640736  4716 tablet_bootstrap.cc:654] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.640499  4717 raft_consensus.cc:359] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.641292  4717 raft_consensus.cc:385] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.641595  4717 raft_consensus.cc:740] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.642423  4717 consensus_queue.cc:260] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.642803  4676 raft_consensus.cc:2468] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:45.640326  4718 raft_consensus.cc:359] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.644065  4718 raft_consensus.cc:385] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.644482  4718 raft_consensus.cc:740] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.647678  4717 ts_tablet_manager.cc:1434] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:45.646121  4718 consensus_queue.cc:260] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.648802  4717 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:45.650115  4718 ts_tablet_manager.cc:1434] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:13:45.652194  4425 catalog_manager.cc:5697] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.654161  4718 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.655213  4717 tablet_bootstrap.cc:654] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.661454  4718 tablet_bootstrap.cc:654] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.663399  4717 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:45.663935  4717 ts_tablet_manager.cc:1403] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.003s
I20260709 13:13:45.665047  4716 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:45.665688  4716 ts_tablet_manager.cc:1403] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:13:45.666640  4717 raft_consensus.cc:359] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.667435  4717 raft_consensus.cc:385] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.667749  4717 raft_consensus.cc:740] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.668565  4717 consensus_queue.cc:260] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.669193  4716 raft_consensus.cc:359] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.670142  4716 raft_consensus.cc:385] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.670475  4716 raft_consensus.cc:740] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.671397  4716 consensus_queue.cc:260] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.674160  4716 ts_tablet_manager.cc:1434] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:13:45.675812  4717 ts_tablet_manager.cc:1434] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:45.680001  4718 tablet_bootstrap.cc:492] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.680553  4718 ts_tablet_manager.cc:1403] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.012s
I20260709 13:13:45.682683  4718 raft_consensus.cc:359] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.683221  4718 raft_consensus.cc:385] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.683451  4718 raft_consensus.cc:740] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.684042  4718 consensus_queue.cc:260] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.686048  4718 ts_tablet_manager.cc:1434] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:45.686882  4718 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:45.691771  4718 tablet_bootstrap.cc:654] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.697376  4718 tablet_bootstrap.cc:492] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:45.697881  4718 ts_tablet_manager.cc:1403] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:45.699965  4718 raft_consensus.cc:359] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.700423  4718 raft_consensus.cc:385] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.700587  4718 raft_consensus.cc:740] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.701057  4718 consensus_queue.cc:260] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.702796  4718 ts_tablet_manager.cc:1434] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:13:45.704460  4722 raft_consensus.cc:493] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.704978  4722 raft_consensus.cc:515] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.706821  4722 leader_election.cc:290] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.707626  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.708016  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.708390  4527 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.708678  4676 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.709690  4566 leader_election.cc:304] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.710489  4722 raft_consensus.cc:2804] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.710851  4722 raft_consensus.cc:493] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.711221  4722 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.716778  4722 raft_consensus.cc:515] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.718464  4722 leader_election.cc:290] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.719331  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.719518  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.720018  4527 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.720140  4676 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.720744  4722 raft_consensus.cc:493] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.721261  4722 raft_consensus.cc:515] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.724380  4722 leader_election.cc:290] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.724310  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.724766  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.725068  4526 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.725502  4675 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.726640  4567 leader_election.cc:304] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.727185  4676 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.727537  4735 raft_consensus.cc:2804] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.727985  4735 raft_consensus.cc:493] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.728322  4735 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.728475  4567 leader_election.cc:304] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.728926  4527 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.729324  4722 raft_consensus.cc:2804] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.730921  4722 raft_consensus.cc:697] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:45.731841  4722 consensus_queue.cc:237] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.735859  4735 raft_consensus.cc:515] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.738093  4735 leader_election.cc:290] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.739194  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.739228  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.739872  4527 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.740003  4676 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.740934  4422 catalog_manager.cc:5697] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.746857  4527 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.748298  4676 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.748513  4566 leader_election.cc:304] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.750676  4735 raft_consensus.cc:2804] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.751260  4735 raft_consensus.cc:697] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:45.752204  4735 consensus_queue.cc:237] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.761116  4422 catalog_manager.cc:5697] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.768636  4735 raft_consensus.cc:493] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.769270  4735 raft_consensus.cc:515] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.771136  4735 leader_election.cc:290] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.771934  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.772188  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.772567  4527 raft_consensus.cc:2468] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.772842  4676 raft_consensus.cc:2468] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:45.773594  4566 leader_election.cc:304] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:45.774238  4735 raft_consensus.cc:2804] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.774549  4735 raft_consensus.cc:493] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.774802  4735 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.780795  4735 raft_consensus.cc:515] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.782433  4735 leader_election.cc:290] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.783455  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:45.783455  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:45.784348  4676 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.784439  4527 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.791596  4527 raft_consensus.cc:2468] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.791596  4676 raft_consensus.cc:2468] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:45.793033  4567 leader_election.cc:304] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:45.793828  4735 raft_consensus.cc:2804] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.794246  4735 raft_consensus.cc:697] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:45.795011  4735 consensus_queue.cc:237] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.801923  4422 catalog_manager.cc:5697] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.844238  4735 raft_consensus.cc:493] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.844955  4735 raft_consensus.cc:515] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:45.846907  4735 leader_election.cc:290] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:45.847831  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:45.848115  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "103537ab1070436bab819689e8638b10" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:45.848955  4676 raft_consensus.cc:2393] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49bcc972a6954c15b0071ed6e7008adb in current term 1: Already voted for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in this term.
I20260709 13:13:45.849888  4567 leader_election.cc:304] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5
I20260709 13:13:45.850529  4735 raft_consensus.cc:3060] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.855803  4735 raft_consensus.cc:2749] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.859241  4602 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.865773  4746 consensus_queue.cc:1048] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.881397  4746 consensus_queue.cc:1048] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.954833  4724 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.967923  4778 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.969719  4735 consensus_queue.cc:1048] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.972131  4735 consensus_queue.cc:1048] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.982575  4744 consensus_queue.cc:1048] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.988452  4746 consensus_queue.cc:1048] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.002656  4746 consensus_queue.cc:1048] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.017858  4724 consensus_queue.cc:1048] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:46.059327  4602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
mode: GRACEFUL
new_leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:13:46.060061  4602 raft_consensus.cc:606] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Received request to transfer leadership to TS 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:46.067334  4602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff2089edb7074977876c3e78460cda19"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
mode: GRACEFUL
new_leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:13:46.068033  4602 raft_consensus.cc:606] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Received request to transfer leadership to TS 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:46.073626  4602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
mode: GRACEFUL
new_leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:13:46.074111  4602 raft_consensus.cc:606] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Received request to transfer leadership to TS 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:46.090185  4676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:43812
I20260709 13:13:46.090740  4676 raft_consensus.cc:606] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:46.103590  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:13:46.104082  4526 raft_consensus.cc:606] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:46.109175  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:13:46.109658  4526 raft_consensus.cc:606] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:46.114362  4676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:43812
I20260709 13:13:46.114831  4676 raft_consensus.cc:606] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:46.119632  4602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
mode: GRACEFUL
new_leader_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:38286
I20260709 13:13:46.120154  4602 raft_consensus.cc:606] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Received request to transfer leadership to TS cf292d9428b148369c2c83785ff142d5
I20260709 13:13:46.136897  4768 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.148296  4722 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.149727  4735 consensus_queue.cc:1048] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.156317  4735 raft_consensus.cc:993] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: : Instructing follower 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.156772  4768 raft_consensus.cc:1081] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Signalling peer 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.161398  4722 consensus_queue.cc:1048] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.165151  4527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:13:46.165769  4527 raft_consensus.cc:493] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.166174  4527 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.172086  4735 raft_consensus.cc:993] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: : Instructing follower cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:46.172703  4735 raft_consensus.cc:1081] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Signalling peer cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:46.175320  4527 raft_consensus.cc:515] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.176728  4676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:43806
I20260709 13:13:46.177493  4676 raft_consensus.cc:493] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.177815  4676 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.180635  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:46.181303  4602 raft_consensus.cc:3055] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.181634  4602 raft_consensus.cc:740] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.181994  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.182636  4675 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.182458  4602 consensus_queue.cc:260] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.183732  4602 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.184752  4527 leader_election.cc:290] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.185623  4676 raft_consensus.cc:515] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.187865  4676 leader_election.cc:290] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:46.189106  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:46.189761  4527 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.190436  4675 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:46.190660  4602 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:46.191710  4492 leader_election.cc:304] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:46.191941  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9f5dafbd0f640d8906547a9955911aa" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:46.192628  4602 raft_consensus.cc:3055] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.192924  4744 raft_consensus.cc:2804] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.193554  4744 raft_consensus.cc:697] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:46.192960  4602 raft_consensus.cc:740] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.194460  4744 consensus_queue.cc:237] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.195282  4768 consensus_queue.cc:1048] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.195086  4602 consensus_queue.cc:260] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.196606  4602 raft_consensus.cc:3060] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.198196  4527 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 2.
I20260709 13:13:46.199577  4640 leader_election.cc:304] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:46.200567  4746 raft_consensus.cc:2804] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.201058  4746 raft_consensus.cc:697] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 2 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:46.201849  4746 consensus_queue.cc:237] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.204123  4602 raft_consensus.cc:2468] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 2.
I20260709 13:13:46.206672  4421 catalog_manager.cc:5697] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 1 to 2, leader changed from 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130) to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 2 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.209630  4735 raft_consensus.cc:993] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: : Instructing follower 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.210130  4735 raft_consensus.cc:1081] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Signalling peer 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.210357  4423 catalog_manager.cc:5697] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 1 to 2, leader changed from 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130) to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 2 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.210996  4724 consensus_queue.cc:1048] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.211833  4527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff2089edb7074977876c3e78460cda19"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:13:46.212400  4527 raft_consensus.cc:493] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.212762  4527 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.220233  4527 raft_consensus.cc:515] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.221240  4526 raft_consensus.cc:1240] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Rejecting Update request from peer 49bcc972a6954c15b0071ed6e7008adb for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:46.222052  4722 consensus_queue.cc:1048] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.224879  4722 consensus_queue.cc:1059] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.225666  4722 raft_consensus.cc:3055] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.225993  4722 raft_consensus.cc:740] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.226672  4724 consensus_queue.cc:1048] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.226907  4722 consensus_queue.cc:260] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.228565  4722 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.232178  4778 raft_consensus.cc:993] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.232695  4778 raft_consensus.cc:1081] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.234856  4527 leader_election.cc:290] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.235087  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.236352  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff2089edb7074977876c3e78460cda19" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:46.237890  4599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38260
I20260709 13:13:46.238543  4599 raft_consensus.cc:493] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.238919  4599 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.254333  4600 raft_consensus.cc:2468] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:46.256532  4599 raft_consensus.cc:515] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.257099  4491 leader_election.cc:304] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:46.258384  4744 raft_consensus.cc:2804] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.258900  4744 raft_consensus.cc:697] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:46.259917  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:46.259821  4744 consensus_queue.cc:237] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.260504  4527 raft_consensus.cc:3055] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.260833  4527 raft_consensus.cc:740] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:46.261749  4527 consensus_queue.cc:260] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.262636  4527 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.266865  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9f458ae32444d09070793091a2e6bf" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.268677  4599 leader_election.cc:290] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.278275  4527 raft_consensus.cc:2468] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.279493  4566 leader_election.cc:304] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:46.280650  4722 raft_consensus.cc:2804] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.281152  4722 raft_consensus.cc:697] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.281286  4422 catalog_manager.cc:5697] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 1 to 2, leader changed from 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130) to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 2 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.281993  4722 consensus_queue.cc:237] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.293479  4421 catalog_manager.cc:5697] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.296895  4723 raft_consensus.cc:993] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.297459  4746 raft_consensus.cc:1081] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.298979  4600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38272
I20260709 13:13:46.299530  4600 raft_consensus.cc:493] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.299880  4600 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.305413  4600 raft_consensus.cc:515] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.307217  4600 leader_election.cc:290] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.307986  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:46.308387  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40808295b45547c2b12cb77ceeca2f05" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.308673  4527 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.309062  4675 raft_consensus.cc:3055] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.309370  4675 raft_consensus.cc:740] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:46.310086  4675 consensus_queue.cc:260] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.311044  4675 raft_consensus.cc:3060] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.314284  4527 raft_consensus.cc:2468] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.315485  4566 leader_election.cc:304] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:46.316285  4722 raft_consensus.cc:2804] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.316243  4675 raft_consensus.cc:2468] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.317088  4722 raft_consensus.cc:697] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.317939  4722 consensus_queue.cc:237] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.324389  4421 catalog_manager.cc:5697] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from cf292d9428b148369c2c83785ff142d5 (127.25.139.131) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.386032  4724 raft_consensus.cc:993] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.386467  4744 raft_consensus.cc:1081] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.388013  4600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38260
I20260709 13:13:46.388556  4600 raft_consensus.cc:493] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.388872  4600 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.393677  4600 raft_consensus.cc:515] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.395319  4600 leader_election.cc:290] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.396166  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:46.396337  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.396831  4527 raft_consensus.cc:3055] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.396840  4675 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.397351  4527 raft_consensus.cc:740] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:46.398182  4527 consensus_queue.cc:260] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.399441  4527 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.404271  4675 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.405603  4567 leader_election.cc:304] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:46.406425  4722 raft_consensus.cc:2804] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.406668  4527 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.406912  4722 raft_consensus.cc:697] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.407985  4722 consensus_queue.cc:237] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.414395  4421 catalog_manager.cc:5697] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.551308  4723 raft_consensus.cc:993] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.551780  4746 raft_consensus.cc:1081] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:46.553285  4600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38272
I20260709 13:13:46.553778  4600 raft_consensus.cc:493] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.554033  4600 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.561008  4600 raft_consensus.cc:515] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.563796  4600 leader_election.cc:290] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:46.564616  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:46.564851  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b41b0d0d461f437698d5d6e295529809" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.565243  4527 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.565457  4675 raft_consensus.cc:3055] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.565864  4675 raft_consensus.cc:740] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:46.566516  4675 consensus_queue.cc:260] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.567514  4675 raft_consensus.cc:3060] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.570997  4527 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.572242  4566 leader_election.cc:304] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:46.572494  4675 raft_consensus.cc:2468] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:46.573037  4722 raft_consensus.cc:2804] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.573585  4722 raft_consensus.cc:697] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.574393  4722 consensus_queue.cc:237] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:46.581291  4421 catalog_manager.cc:5697] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from cf292d9428b148369c2c83785ff142d5 (127.25.139.131) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.589991  4600 raft_consensus.cc:1275] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.591259  4744 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.596022  4600 raft_consensus.cc:1275] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.597582  4746 consensus_queue.cc:1048] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.601326  4735 raft_consensus.cc:993] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: : Instructing follower 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.601909  4722 raft_consensus.cc:1081] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Signalling peer 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:46.603631  4527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:42858
I20260709 13:13:46.604223  4527 raft_consensus.cc:493] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.604580  4527 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.604727  4675 raft_consensus.cc:1275] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.610853  4744 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.612211  4527 raft_consensus.cc:515] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:46.614737  4527 leader_election.cc:290] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Requested vote from peers cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:46.615199  4526 raft_consensus.cc:1275] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.616909  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:46.617487  4600 raft_consensus.cc:3055] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.617815  4600 raft_consensus.cc:740] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:46.618911  4798 consensus_queue.cc:1048] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:46.619908  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dee98a00ba0464cba88b71ee4fbf9cb" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:46.620529  4674 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.620852  4600 consensus_queue.cc:260] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:46.622610  4600 raft_consensus.cc:3060] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.633070  4674 raft_consensus.cc:2468] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:46.633154  4600 raft_consensus.cc:2468] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:46.634780  4492 leader_election.cc:304] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:46.635897  4744 raft_consensus.cc:2804] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.636562  4744 raft_consensus.cc:697] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:46.637413  4744 consensus_queue.cc:237] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } }
I20260709 13:13:46.644352  4422 catalog_manager.cc:5697] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 1 to 2, leader changed from 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130) to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 2 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.714417  4600 raft_consensus.cc:1275] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.715845  4744 consensus_queue.cc:1048] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.722601  4674 raft_consensus.cc:3060] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.727428  4676 raft_consensus.cc:3060] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.733217  4674 raft_consensus.cc:1275] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.734822  4722 consensus_queue.cc:1048] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.735235  4676 raft_consensus.cc:1275] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.736644  4744 consensus_queue.cc:1048] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.744699  4526 raft_consensus.cc:1275] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.746372  4768 consensus_queue.cc:1048] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.839856  4674 raft_consensus.cc:1275] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.841132  4768 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.849052  4526 raft_consensus.cc:1275] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.850622  4722 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.851420  4526 raft_consensus.cc:1275] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.852921  4722 consensus_queue.cc:1048] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.863335  4674 raft_consensus.cc:1275] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.864886  4735 consensus_queue.cc:1048] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.989527  4526 raft_consensus.cc:1275] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.990928  4735 consensus_queue.cc:1048] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:46.998831  4674 raft_consensus.cc:1275] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.001202  4800 consensus_queue.cc:1048] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.128328  4676 raft_consensus.cc:1275] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.130095  4744 consensus_queue.cc:1048] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:47.143944  4600 raft_consensus.cc:1275] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.149237  4778 consensus_queue.cc:1048] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:49.153060  4422 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46308:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:49.155805  4422 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:49.214658  4515 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce95d39416847948dff6c4a610facdc (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:49.215785  4590 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce95d39416847948dff6c4a610facdc (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:49.216760  4515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce95d39416847948dff6c4a610facdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.217581  4590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce95d39416847948dff6c4a610facdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.219726  4509 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c42c7bafa49b68207c62e03e1705b (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:49.221299  4509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c42c7bafa49b68207c62e03e1705b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.226442  4588 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c42c7bafa49b68207c62e03e1705b (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:49.228056  4588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c42c7bafa49b68207c62e03e1705b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.237879  4516 tablet_service.cc:1511] Processing CreateTablet for tablet c2ebf9aa0a3344eea3129b2e21f8510a (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:49.241737  4511 tablet_service.cc:1511] Processing CreateTablet for tablet 13ca7db6a29742c8a318fd4242d7b262 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:49.244496  4587 tablet_service.cc:1511] Processing CreateTablet for tablet 13ca7db6a29742c8a318fd4242d7b262 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:49.246140  4587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ca7db6a29742c8a318fd4242d7b262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.245729  4517 tablet_service.cc:1511] Processing CreateTablet for tablet 780877fcb97d4bdcb1d9b58f91f6988c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:49.249040  4591 tablet_service.cc:1511] Processing CreateTablet for tablet c93a3ac21d2d45debd4e28969863e45c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:49.244495  4589 tablet_service.cc:1511] Processing CreateTablet for tablet c2ebf9aa0a3344eea3129b2e21f8510a (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:49.250581  4591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a3ac21d2d45debd4e28969863e45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.217200  4658 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce95d39416847948dff6c4a610facdc (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:49.252028  4658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce95d39416847948dff6c4a610facdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.252589  4586 tablet_service.cc:1511] Processing CreateTablet for tablet 35e905426ab647bdb4aea32104650770 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:49.254058  4586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e905426ab647bdb4aea32104650770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.249235  4584 tablet_service.cc:1511] Processing CreateTablet for tablet 780877fcb97d4bdcb1d9b58f91f6988c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:49.256697  4511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ca7db6a29742c8a318fd4242d7b262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.257006  4512 tablet_service.cc:1511] Processing CreateTablet for tablet c93a3ac21d2d45debd4e28969863e45c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:49.258409  4512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a3ac21d2d45debd4e28969863e45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.259635  4517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780877fcb97d4bdcb1d9b58f91f6988c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.260887  4510 tablet_service.cc:1511] Processing CreateTablet for tablet 35e905426ab647bdb4aea32104650770 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:49.261442  4516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ebf9aa0a3344eea3129b2e21f8510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.262280  4510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e905426ab647bdb4aea32104650770. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.265102  4513 tablet_service.cc:1511] Processing CreateTablet for tablet b95529c1dc744e399f025c30c55d73a4 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:49.266727  4513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95529c1dc744e399f025c30c55d73a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.268371  4589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ebf9aa0a3344eea3129b2e21f8510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.269250  4584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780877fcb97d4bdcb1d9b58f91f6988c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.275238  4592 tablet_service.cc:1511] Processing CreateTablet for tablet b95529c1dc744e399f025c30c55d73a4 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:49.277377  4592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95529c1dc744e399f025c30c55d73a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.288937  4514 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f84a51ea34e9c84704fb5daebfa92 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:49.290622  4514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f84a51ea34e9c84704fb5daebfa92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.297148  4585 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f84a51ea34e9c84704fb5daebfa92 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:49.298715  4585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f84a51ea34e9c84704fb5daebfa92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.325512  4665 tablet_service.cc:1511] Processing CreateTablet for tablet 7a1c42c7bafa49b68207c62e03e1705b (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:49.329825  4816 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.334095  4665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1c42c7bafa49b68207c62e03e1705b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.336012  4660 tablet_service.cc:1511] Processing CreateTablet for tablet 13ca7db6a29742c8a318fd4242d7b262 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:49.337634  4660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ca7db6a29742c8a318fd4242d7b262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.337388  4664 tablet_service.cc:1511] Processing CreateTablet for tablet c2ebf9aa0a3344eea3129b2e21f8510a (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:49.338873  4664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ebf9aa0a3344eea3129b2e21f8510a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.342543  4663 tablet_service.cc:1511] Processing CreateTablet for tablet b95529c1dc744e399f025c30c55d73a4 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:49.340605  4659 tablet_service.cc:1511] Processing CreateTablet for tablet 35e905426ab647bdb4aea32104650770 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:49.344067  4663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b95529c1dc744e399f025c30c55d73a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.340942  4666 tablet_service.cc:1511] Processing CreateTablet for tablet 780877fcb97d4bdcb1d9b58f91f6988c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:49.352415  4662 tablet_service.cc:1511] Processing CreateTablet for tablet c93a3ac21d2d45debd4e28969863e45c (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:49.336056  4661 tablet_service.cc:1511] Processing CreateTablet for tablet 7a2f84a51ea34e9c84704fb5daebfa92 (DEFAULT_TABLE table=soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:49.375301  4659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e905426ab647bdb4aea32104650770. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:49.383400  4473 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:49.429070  4816 tablet_bootstrap.cc:654] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.430274  4662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93a3ac21d2d45debd4e28969863e45c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.436179  4666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 780877fcb97d4bdcb1d9b58f91f6988c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.459910  4661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a2f84a51ea34e9c84704fb5daebfa92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:49.501787  4814 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.525156  4816 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.525882  4816 ts_tablet_manager.cc:1403] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.197s	user 0.010s	sys 0.007s
I20260709 13:13:49.531692  4816 raft_consensus.cc:359] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.532827  4816 raft_consensus.cc:385] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.533289  4816 raft_consensus.cc:740] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.534286  4816 consensus_queue.cc:260] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.538552  4816 ts_tablet_manager.cc:1434] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 13:13:49.540400  4816 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.551347  4816 tablet_bootstrap.cc:654] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.574962  4821 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.575289  4814 tablet_bootstrap.cc:654] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.581903  4816 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.582352  4816 ts_tablet_manager.cc:1403] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.004s
I20260709 13:13:49.582854  4821 tablet_bootstrap.cc:654] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.585383  4814 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.585914  4814 ts_tablet_manager.cc:1403] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.001s
I20260709 13:13:49.585529  4816 raft_consensus.cc:359] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.586354  4816 raft_consensus.cc:385] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.586855  4816 raft_consensus.cc:740] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.587693  4816 consensus_queue.cc:260] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.588343  4821 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.588944  4821 ts_tablet_manager.cc:1403] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:13:49.589043  4814 raft_consensus.cc:359] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.589844  4814 raft_consensus.cc:385] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.590041  4816 ts_tablet_manager.cc:1434] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:49.590137  4814 raft_consensus.cc:740] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.591149  4816 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.591120  4814 consensus_queue.cc:260] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.593941  4814 ts_tablet_manager.cc:1434] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:49.593758  4821 raft_consensus.cc:359] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.594676  4821 raft_consensus.cc:385] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.595063  4814 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.595044  4821 raft_consensus.cc:740] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.596287  4821 consensus_queue.cc:260] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.599386  4821 ts_tablet_manager.cc:1434] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:13:49.600509  4821 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.602245  4816 tablet_bootstrap.cc:654] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.602651  4814 tablet_bootstrap.cc:654] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:49.605373  4553 tablet.cc:2406] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:49.607451  4821 tablet_bootstrap.cc:654] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.615530  4814 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.616278  4814 ts_tablet_manager.cc:1403] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:13:49.619881  4814 raft_consensus.cc:359] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.620540  4816 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.621330  4816 ts_tablet_manager.cc:1403] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.004s
I20260709 13:13:49.620663  4814 raft_consensus.cc:385] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.622097  4814 raft_consensus.cc:740] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.622989  4814 consensus_queue.cc:260] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.623767  4821 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.624678  4821 ts_tablet_manager.cc:1403] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 13:13:49.624593  4816 raft_consensus.cc:359] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.625545  4816 raft_consensus.cc:385] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.625877  4816 raft_consensus.cc:740] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.626031  4814 ts_tablet_manager.cc:1434] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:49.626698  4816 consensus_queue.cc:260] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.627390  4814 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.628130  4821 raft_consensus.cc:359] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.628963  4821 raft_consensus.cc:385] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.629256  4821 raft_consensus.cc:740] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.630278  4821 consensus_queue.cc:260] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.631937  4816 ts_tablet_manager.cc:1434] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:49.632783  4821 ts_tablet_manager.cc:1434] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:49.633206  4816 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.633821  4821 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.635389  4814 tablet_bootstrap.cc:654] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.640928  4821 tablet_bootstrap.cc:654] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.640928  4816 tablet_bootstrap.cc:654] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.649382  4723 raft_consensus.cc:493] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.651592  4723 raft_consensus.cc:515] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.656175  4814 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.657006  4814 ts_tablet_manager.cc:1403] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 13:13:49.659094  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
W20260709 13:13:49.661437  4640 leader_election.cc:343] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.663497  4816 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.664747  4816 ts_tablet_manager.cc:1403] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:13:49.665833  4723 leader_election.cc:290] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:49.666810  4814 raft_consensus.cc:359] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.667613  4814 raft_consensus.cc:385] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.667879  4814 raft_consensus.cc:740] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.668339  4816 raft_consensus.cc:359] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.668612  4814 consensus_queue.cc:260] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.669147  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.669332  4816 raft_consensus.cc:385] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.669752  4816 raft_consensus.cc:740] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
W20260709 13:13:49.670800  4640 leader_election.cc:343] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.670604  4816 consensus_queue.cc:260] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.671324  4640 leader_election.cc:304] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:49.671581  4814 ts_tablet_manager.cc:1434] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:13:49.672537  4723 raft_consensus.cc:2749] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:49.672644  4814 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.673159  4816 ts_tablet_manager.cc:1434] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:49.674201  4816 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.681177  4816 tablet_bootstrap.cc:654] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.681283  4814 tablet_bootstrap.cc:654] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.689960  4814 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.690464  4814 ts_tablet_manager.cc:1403] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:13:49.693641  4814 raft_consensus.cc:359] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.694119  4816 tablet_bootstrap.cc:492] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.694365  4821 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.694410  4814 raft_consensus.cc:385] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.694703  4816 ts_tablet_manager.cc:1403] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:13:49.695011  4821 ts_tablet_manager.cc:1403] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.015s
I20260709 13:13:49.694936  4814 raft_consensus.cc:740] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.696055  4814 consensus_queue.cc:260] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.698508  4816 raft_consensus.cc:359] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.698736  4821 raft_consensus.cc:359] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.699599  4816 raft_consensus.cc:385] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.699656  4821 raft_consensus.cc:385] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.700141  4821 raft_consensus.cc:740] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.700090  4816 raft_consensus.cc:740] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.701198  4816 consensus_queue.cc:260] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.701289  4821 consensus_queue.cc:260] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.703472  4814 ts_tablet_manager.cc:1434] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:13:49.704041  4816 ts_tablet_manager.cc:1434] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:13:49.704725  4814 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.705423  4816 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.714202  4816 tablet_bootstrap.cc:654] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.715577  4814 tablet_bootstrap.cc:654] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.723630  4821 ts_tablet_manager.cc:1434] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 13:13:49.724907  4821 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.727294  4816 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.727264  4814 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.728147  4816 ts_tablet_manager.cc:1403] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:13:49.728147  4814 ts_tablet_manager.cc:1403] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:13:49.731602  4818 raft_consensus.cc:493] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.731916  4814 raft_consensus.cc:359] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.732086  4818 raft_consensus.cc:515] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.732117  4816 raft_consensus.cc:359] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.732908  4814 raft_consensus.cc:385] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.733207  4816 raft_consensus.cc:385] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.733296  4814 raft_consensus.cc:740] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.733497  4821 tablet_bootstrap.cc:654] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.733707  4816 raft_consensus.cc:740] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.734342  4814 consensus_queue.cc:260] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.734700  4816 consensus_queue.cc:260] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.736346  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.737267  4600 raft_consensus.cc:2468] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.737524  4816 ts_tablet_manager.cc:1434] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:13:49.737598  4814 ts_tablet_manager.cc:1434] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:49.738968  4816 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.738968  4814 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.740413  4818 leader_election.cc:290] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.740859  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.741508  4723 raft_consensus.cc:493] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:49.743137  4492 leader_election.cc:343] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.749202  4821 tablet_bootstrap.cc:492] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.746719  4723 raft_consensus.cc:515] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.749817  4821 ts_tablet_manager.cc:1403] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:13:49.752797  4816 tablet_bootstrap.cc:654] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.753299  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:49.754465  4821 raft_consensus.cc:359] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
W20260709 13:13:49.755141  4640 leader_election.cc:343] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.755262  4821 raft_consensus.cc:385] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.755757  4821 raft_consensus.cc:740] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.756309  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.757175  4600 raft_consensus.cc:2468] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 0.
I20260709 13:13:49.756743  4821 consensus_queue.cc:260] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.758428  4640 leader_election.cc:304] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:49.759450  4833 raft_consensus.cc:2804] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.759738  4814 tablet_bootstrap.cc:654] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.759811  4833 raft_consensus.cc:493] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.760536  4833 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.761333  4491 leader_election.cc:304] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:49.762600  4818 raft_consensus.cc:2804] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.762993  4818 raft_consensus.cc:493] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.763406  4818 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.765961  4816 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.766748  4816 ts_tablet_manager.cc:1403] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 13:13:49.770185  4833 raft_consensus.cc:515] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.771092  4816 raft_consensus.cc:359] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.772185  4816 raft_consensus.cc:385] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.772501  4816 raft_consensus.cc:740] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.772553  4833 leader_election.cc:290] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:49.773483  4814 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.774222  4814 ts_tablet_manager.cc:1403] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.004s
I20260709 13:13:49.773528  4816 consensus_queue.cc:260] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.774595  4821 ts_tablet_manager.cc:1434] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:13:49.775925  4821 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.776515  4816 ts_tablet_manager.cc:1434] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:13:49.777719  4816 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.778023  4814 raft_consensus.cc:359] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.778882  4814 raft_consensus.cc:385] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.779227  4814 raft_consensus.cc:740] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.780318  4814 consensus_queue.cc:260] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.773226  4833 raft_consensus.cc:493] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.783051  4814 ts_tablet_manager.cc:1434] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:49.783077  4833 raft_consensus.cc:515] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.784350  4814 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.785682  4833 leader_election.cc:290] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:49.785985  4816 tablet_bootstrap.cc:654] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.788309  4821 tablet_bootstrap.cc:654] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.795616  4723 leader_election.cc:290] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:49.798573  4816 tablet_bootstrap.cc:492] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.799197  4816 ts_tablet_manager.cc:1403] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.014s
I20260709 13:13:49.800149  4821 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.800668  4821 ts_tablet_manager.cc:1403] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 13:13:49.801411  4815 raft_consensus.cc:493] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.801956  4815 raft_consensus.cc:515] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.802340  4816 raft_consensus.cc:359] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.803130  4816 raft_consensus.cc:385] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.803491  4816 raft_consensus.cc:740] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.803609  4821 raft_consensus.cc:359] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.804364  4821 raft_consensus.cc:385] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.804296  4816 consensus_queue.cc:260] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.805223  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95529c1dc744e399f025c30c55d73a4" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:49.804773  4821 raft_consensus.cc:740] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.805766  4815 leader_election.cc:290] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
W20260709 13:13:49.806804  4566 leader_election.cc:343] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.807139  4814 tablet_bootstrap.cc:654] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.806804  4816 ts_tablet_manager.cc:1434] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:13:49.807041  4821 consensus_queue.cc:260] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.808670  4816 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Bootstrap starting.
I20260709 13:13:49.809571  4821 ts_tablet_manager.cc:1434] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 13:13:49.810592  4821 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.813162  4778 raft_consensus.cc:493] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.813762  4778 raft_consensus.cc:515] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.816275  4778 leader_election.cc:290] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.817456  4821 tablet_bootstrap.cc:654] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.817823  4816 tablet_bootstrap.cc:654] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.820838  4778 raft_consensus.cc:493] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.821513  4778 raft_consensus.cc:515] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.825265  4814 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.825910  4814 ts_tablet_manager.cc:1403] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.012s
I20260709 13:13:49.827071  4778 leader_election.cc:290] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.827744  4816 tablet_bootstrap.cc:492] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: No bootstrap required, opened a new log
I20260709 13:13:49.829732  4821 tablet_bootstrap.cc:492] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.829497  4814 raft_consensus.cc:359] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.830840  4778 raft_consensus.cc:493] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.831130  4816 ts_tablet_manager.cc:1403] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:13:49.831130  4814 raft_consensus.cc:385] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.831918  4814 raft_consensus.cc:740] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.831427  4778 raft_consensus.cc:515] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.832950  4814 consensus_queue.cc:260] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.834574  4816 raft_consensus.cc:359] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.835390  4816 raft_consensus.cc:385] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.835686  4816 raft_consensus.cc:740] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.836171  4814 ts_tablet_manager.cc:1434] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:13:49.836547  4816 consensus_queue.cc:260] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.837453  4814 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.845911  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.847034  4600 raft_consensus.cc:2468] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.847368  4815 raft_consensus.cc:493] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.847827  4814 tablet_bootstrap.cc:654] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.847899  4815 raft_consensus.cc:515] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.848451  4816 ts_tablet_manager.cc:1434] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:13:49.850216  4815 leader_election.cc:290] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.851074  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:49.851624  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ebf9aa0a3344eea3129b2e21f8510a" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.851787  4526 raft_consensus.cc:2468] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:49.852249  4600 raft_consensus.cc:2468] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.853205  4566 leader_election.cc:304] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.853396  4491 leader_election.cc:304] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.854194  4815 raft_consensus.cc:2804] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.854436  4846 raft_consensus.cc:2804] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.854593  4815 raft_consensus.cc:493] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.854837  4491 leader_election.cc:304] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.854997  4846 raft_consensus.cc:493] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.855096  4815 raft_consensus.cc:3060] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.855647  4846 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.856889  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:49.857683  4814 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.858238  4814 ts_tablet_manager.cc:1403] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:13:49.861510  4814 raft_consensus.cc:359] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.862217  4814 raft_consensus.cc:385] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.862516  4814 raft_consensus.cc:740] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.863374  4814 consensus_queue.cc:260] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.864516  4846 raft_consensus.cc:515] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.865813  4526 raft_consensus.cc:2393] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf292d9428b148369c2c83785ff142d5 in current term 1: Already voted for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in this term.
I20260709 13:13:49.865916  4814 ts_tablet_manager.cc:1434] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:49.867808  4814 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: Bootstrap starting.
I20260709 13:13:49.868736  4818 raft_consensus.cc:515] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.872927  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:49.873646  4526 raft_consensus.cc:2468] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 0.
I20260709 13:13:49.873878  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.875411  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.866966  4846 leader_election.cc:290] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.876825  4846 raft_consensus.cc:493] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.877720  4814 tablet_bootstrap.cc:654] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.877552  4815 raft_consensus.cc:515] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.876012  4600 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.879261  4599 raft_consensus.cc:2393] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf292d9428b148369c2c83785ff142d5 in current term 1: Already voted for candidate 49bcc972a6954c15b0071ed6e7008adb in this term.
I20260709 13:13:49.877334  4846 raft_consensus.cc:515] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.883246  4848 raft_consensus.cc:493] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.884080  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:49.884500  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.886161  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.886539  4599 raft_consensus.cc:2468] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.886181  4526 raft_consensus.cc:3060] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.887619  4848 raft_consensus.cc:515] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.885237  4846 leader_election.cc:290] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.885375  4815 leader_election.cc:290] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.890872  4848 leader_election.cc:290] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.895350  4778 leader_election.cc:290] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.895869  4526 raft_consensus.cc:2468] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:49.896128  4821 ts_tablet_manager.cc:1403] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.028s
I20260709 13:13:49.897065  4599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.897275  4566 leader_election.cc:304] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.897740  4599 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.898463  4817 raft_consensus.cc:2804] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.899035  4817 raft_consensus.cc:697] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:49.900218  4839 raft_consensus.cc:493] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:49.899950  4821 raft_consensus.cc:359] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.900115  4817 consensus_queue.cc:237] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.900985  4821 raft_consensus.cc:385] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.900959  4839 raft_consensus.cc:515] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.902319  4814 tablet_bootstrap.cc:492] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: No bootstrap required, opened a new log
I20260709 13:13:49.902884  4814 ts_tablet_manager.cc:1403] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.003s
I20260709 13:13:49.904098  4839 leader_election.cc:290] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:49.909184  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.906100  4599 raft_consensus.cc:2468] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:49.909965  4598 raft_consensus.cc:2468] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.901621  4821 raft_consensus.cc:740] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.910311  4491 leader_election.cc:304] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.911301  4821 consensus_queue.cc:260] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.857496  4843 raft_consensus.cc:2804] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.907310  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:49.911568  4846 raft_consensus.cc:2804] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.913964  4821 ts_tablet_manager.cc:1434] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:49.906821  4814 raft_consensus.cc:359] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.914136  4846 raft_consensus.cc:493] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.914466  4814 raft_consensus.cc:385] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.914558  4846 raft_consensus.cc:3060] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.914722  4814 raft_consensus.cc:740] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.915040  4821 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.915501  4491 leader_election.cc:304] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.915683  4814 consensus_queue.cc:260] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.916529  4778 raft_consensus.cc:2804] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.916733  4602 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.916953  4778 raft_consensus.cc:493] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.917451  4778 raft_consensus.cc:3060] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.918123  4814 ts_tablet_manager.cc:1434] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:13:49.922643  4821 tablet_bootstrap.cc:654] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:49.923380  4843 raft_consensus.cc:493] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.923895  4843 raft_consensus.cc:3060] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.925112  4846 raft_consensus.cc:515] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.926362  4491 leader_election.cc:304] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.927784  4848 raft_consensus.cc:2804] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:49.931396  4846 leader_election.cc:290] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.934698  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95529c1dc744e399f025c30c55d73a4" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.935731  4673 raft_consensus.cc:2468] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:49.937546  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.938300  4673 raft_consensus.cc:2468] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 0.
I20260709 13:13:49.939951  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ca7db6a29742c8a318fd4242d7b262" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:49.940315  4848 raft_consensus.cc:697] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:49.940585  4673 raft_consensus.cc:3060] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.941391  4848 consensus_queue.cc:237] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.945070  4422 catalog_manager.cc:5697] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.946604  4491 leader_election.cc:304] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:49.950440  4850 raft_consensus.cc:2804] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:49.950843  4850 raft_consensus.cc:493] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:49.951226  4850 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.952101  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.952989  4602 raft_consensus.cc:3060] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.953282  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ebf9aa0a3344eea3129b2e21f8510a" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.954043  4674 raft_consensus.cc:2468] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.948194  4778 raft_consensus.cc:515] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.957118  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.957446  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.957810  4674 raft_consensus.cc:2468] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:49.958542  4778 leader_election.cc:290] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.959386  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:49.959973  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.960827  4596 raft_consensus.cc:3060] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.958603  4675 raft_consensus.cc:2393] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74acd5ea6a0f492ab7b702cc2f6701ec in current term 1: Already voted for candidate cf292d9428b148369c2c83785ff142d5 in this term.
I20260709 13:13:49.967155  4850 raft_consensus.cc:515] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.971011  4597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.971910  4597 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.973137  4850 leader_election.cc:290] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.982005  4673 raft_consensus.cc:2468] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:49.983011  4818 leader_election.cc:290] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:49.985512  4821 tablet_bootstrap.cc:492] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:49.986063  4821 ts_tablet_manager.cc:1403] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.071s	user 0.018s	sys 0.038s
I20260709 13:13:49.987675  4421 catalog_manager.cc:5697] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:49.989015  4843 raft_consensus.cc:515] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.989131  4821 raft_consensus.cc:359] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.989934  4821 raft_consensus.cc:385] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:49.990217  4821 raft_consensus.cc:740] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:49.990949  4821 consensus_queue.cc:260] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:49.991971  4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ebf9aa0a3344eea3129b2e21f8510a" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:49.993089  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.993491  4821 ts_tablet_manager.cc:1434] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:49.994655  4821 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:49.994755  4672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:49.992718  4601 raft_consensus.cc:3060] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.995554  4672 raft_consensus.cc:3060] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:49.996956  4600 raft_consensus.cc:2468] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 1.
I20260709 13:13:49.998188  4671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:49.992642  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:49.999396  4670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ebf9aa0a3344eea3129b2e21f8510a" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.000031  4675 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:50.000140  4670 raft_consensus.cc:3060] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.001777  4821 tablet_bootstrap.cc:654] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.002544  4674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.003334  4674 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.009348  4670 raft_consensus.cc:2468] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.011252  4601 raft_consensus.cc:2468] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.011462  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:50.019809  4843 leader_election.cc:290] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.016954  4492 leader_election.cc:304] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5
I20260709 13:13:50.019914  4526 raft_consensus.cc:2393] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf292d9428b148369c2c83785ff142d5 in current term 1: Already voted for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in this term.
I20260709 13:13:50.012359  4567 leader_election.cc:304] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.020972  4818 raft_consensus.cc:2749] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:13:50.022158  4492 leader_election.cc:343] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:49.998315  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.025979  4640 leader_election.cc:304] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:50.026626  4602 raft_consensus.cc:2468] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.027667  4640 leader_election.cc:304] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:50.030182  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce95d39416847948dff6c4a610facdc" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:50.031227  4597 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.028327  4839 raft_consensus.cc:2804] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.023051  4815 raft_consensus.cc:2804] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.029006  4843 raft_consensus.cc:493] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:50.029031  4492 leader_election.cc:343] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.033742  4815 raft_consensus.cc:493] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.034845  4815 raft_consensus.cc:3060] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.036332  4492 leader_election.cc:304] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:50.036808  4839 raft_consensus.cc:697] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:50.031790  4723 raft_consensus.cc:2764] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:50.034495  4491 leader_election.cc:304] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:50.029282  4596 raft_consensus.cc:2468] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.038125  4839 consensus_queue.cc:237] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.039002  4843 raft_consensus.cc:515] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.042680  4843 leader_election.cc:290] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.042436  4640 leader_election.cc:304] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.032262  4673 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.043521  4818 raft_consensus.cc:2804] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.050940  4672 raft_consensus.cc:2468] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.046324  4491 leader_election.cc:304] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:50.047469  4670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5" is_pre_election: true
I20260709 13:13:50.061599  4843 raft_consensus.cc:2804] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:50.063076  4492 leader_election.cc:343] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.064224  4843 raft_consensus.cc:697] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.062631  4491 leader_election.cc:304] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:50.044772  4850 raft_consensus.cc:2804] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.045593  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:50.069205  4596 raft_consensus.cc:2468] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 0.
I20260709 13:13:50.067714  4723 raft_consensus.cc:2749] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.038074  4674 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.069288  4850 raft_consensus.cc:697] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.067714  4818 raft_consensus.cc:697] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.072142  4850 consensus_queue.cc:237] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.073007  4818 consensus_queue.cc:237] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.073800  4848 raft_consensus.cc:2804] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.074436  4848 raft_consensus.cc:697] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.072060  4843 consensus_queue.cc:237] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.077204  4821 tablet_bootstrap.cc:492] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:50.077620  4821 ts_tablet_manager.cc:1403] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.036s
I20260709 13:13:50.075418  4848 consensus_queue.cc:237] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.075870  4815 raft_consensus.cc:515] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.081959  4491 leader_election.cc:304] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:50.082854  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95529c1dc744e399f025c30c55d73a4" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:50.082580  4821 raft_consensus.cc:359] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.084438  4821 raft_consensus.cc:385] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.084848  4821 raft_consensus.cc:740] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.085794  4778 raft_consensus.cc:2804] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:50.086153  4821 consensus_queue.cc:260] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.086899  4778 raft_consensus.cc:493] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:50.085716  4526 raft_consensus.cc:3060] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.087844  4778 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.099445  4821 ts_tablet_manager.cc:1434] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:13:50.100461  4821 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: Bootstrap starting.
I20260709 13:13:50.088434  4673 raft_consensus.cc:2468] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.104627  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b95529c1dc744e399f025c30c55d73a4" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.105304  4673 raft_consensus.cc:3060] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.105391  4778 raft_consensus.cc:515] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.106933  4526 raft_consensus.cc:2468] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:50.108886  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:50.109520  4596 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.111020  4821 tablet_bootstrap.cc:654] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:50.111428  4566 leader_election.cc:304] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:50.112519  4819 raft_consensus.cc:2804] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.113035  4819 raft_consensus.cc:697] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:50.114224  4819 consensus_queue.cc:237] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.116680  4673 raft_consensus.cc:2468] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 1.
I20260709 13:13:50.103055  4815 leader_election.cc:290] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 1 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.127496  4778 leader_election.cc:290] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.129910  4723 raft_consensus.cc:493] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.130518  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.130636  4723 raft_consensus.cc:515] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.133121  4723 leader_election.cc:290] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
W20260709 13:13:50.133677  4492 leader_election.cc:343] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:50.135232  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:50.135279  4601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "780877fcb97d4bdcb1d9b58f91f6988c" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:50.136302  4601 raft_consensus.cc:2393] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf292d9428b148369c2c83785ff142d5 in current term 1: Already voted for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in this term.
I20260709 13:13:50.137460  4640 leader_election.cc:304] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.139050  4723 raft_consensus.cc:3060] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.139213  4596 raft_consensus.cc:2468] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 1.
I20260709 13:13:50.143225  4491 leader_election.cc:304] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: cf292d9428b148369c2c83785ff142d5
I20260709 13:13:50.144516  4778 raft_consensus.cc:2804] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:50.145041  4778 raft_consensus.cc:697] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.145929  4778 consensus_queue.cc:237] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.146507  4821 tablet_bootstrap.cc:492] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: No bootstrap required, opened a new log
I20260709 13:13:50.147048  4821 ts_tablet_manager.cc:1403] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.013s
I20260709 13:13:50.150002  4821 raft_consensus.cc:359] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.150727  4821 raft_consensus.cc:385] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:50.151008  4821 raft_consensus.cc:740] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Initialized, Role: FOLLOWER
I20260709 13:13:50.155557  4821 consensus_queue.cc:260] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.157704  4821 ts_tablet_manager.cc:1434] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:13:50.159404  4723 raft_consensus.cc:2749] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:50.170192  4424 catalog_manager.cc:5697] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 1 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.173231  4422 catalog_manager.cc:5697] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 0 to 1, leader changed from <none> to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 1 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.183650  4423 catalog_manager.cc:5697] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.185392  4423 catalog_manager.cc:5697] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.186779  4423 catalog_manager.cc:5697] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.188271  4423 catalog_manager.cc:5697] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.189652  4423 catalog_manager.cc:5697] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 1 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.299401  4819 consensus_queue.cc:1048] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.303032  4673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
mode: GRACEFUL
new_leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:43812
I20260709 13:13:50.303750  4673 raft_consensus.cc:606] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Received request to transfer leadership to TS 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.324846  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:13:50.325614  4526 raft_consensus.cc:606] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:50.326977  4815 consensus_queue.cc:1048] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.341379  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e905426ab647bdb4aea32104650770"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:13:50.342015  4526 raft_consensus.cc:606] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Received request to transfer leadership to TS 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:50.350662  4526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:42878
I20260709 13:13:50.351279  4526 raft_consensus.cc:606] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Received request to transfer leadership to TS cf292d9428b148369c2c83785ff142d5
I20260709 13:13:50.478854  4818 consensus_queue.cc:1048] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.482142  4818 consensus_queue.cc:1048] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.489641  4850 consensus_queue.cc:1048] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.490025  4818 raft_consensus.cc:993] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:50.490540  4818 raft_consensus.cc:1081] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:50.494717  4602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e905426ab647bdb4aea32104650770"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38260
I20260709 13:13:50.496577  4602 raft_consensus.cc:493] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.497040  4602 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.506920  4848 consensus_queue.cc:1048] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.511559  4848 consensus_queue.cc:1048] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.519976  4602 raft_consensus.cc:515] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.529422  4850 consensus_queue.cc:1048] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.537209  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.537868  4673 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.538146  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e905426ab647bdb4aea32104650770" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:50.538865  4526 raft_consensus.cc:3055] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.539354  4526 raft_consensus.cc:740] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.540366  4526 consensus_queue.cc:260] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.541611  4526 raft_consensus.cc:3060] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.541766  4723 consensus_queue.cc:1048] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.553399  4526 raft_consensus.cc:2468] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:50.554297  4602 leader_election.cc:290] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.554980  4673 raft_consensus.cc:2468] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:50.556044  4566 leader_election.cc:304] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:50.556456  4672 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:50.557003  4815 raft_consensus.cc:2804] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.557575  4815 raft_consensus.cc:697] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:50.558369  4815 consensus_queue.cc:237] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.563256  4843 consensus_queue.cc:1048] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.567658  4723 raft_consensus.cc:993] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: : Instructing follower 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:50.568195  4839 raft_consensus.cc:1081] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Signalling peer 74acd5ea6a0f492ab7b702cc2f6701ec to start an election
I20260709 13:13:50.571208  4843 consensus_queue.cc:1048] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.577546  4527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
 from {username='slave'} at 127.0.0.1:42866
I20260709 13:13:50.578325  4527 raft_consensus.cc:493] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.578750  4527 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.583922  4881 raft_consensus.cc:493] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:50.584642  4881 raft_consensus.cc:515] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.585659  4423 catalog_manager.cc:5697] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.587961  4839 consensus_queue.cc:1048] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.594530  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" is_pre_election: true
I20260709 13:13:50.595804  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb" is_pre_election: true
I20260709 13:13:50.596624  4596 raft_consensus.cc:2468] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 1.
I20260709 13:13:50.604444  4850 raft_consensus.cc:993] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:50.605018  4850 raft_consensus.cc:1081] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Signalling peer cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:50.610096  4881 leader_election.cc:290] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:50.611714  4818 consensus_queue.cc:1048] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.616770  4640 leader_election.cc:304] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.616189  4527 raft_consensus.cc:515] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.617914  4881 raft_consensus.cc:2804] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:50.618381  4881 raft_consensus.cc:493] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74acd5ea6a0f492ab7b702cc2f6701ec)
I20260709 13:13:50.618804  4881 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.619187  4673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:13:50.623941  4600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:50.625049  4527 leader_election.cc:290] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Requested vote from peers 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.627424  4672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a1c42c7bafa49b68207c62e03e1705b" candidate_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.628059  4672 raft_consensus.cc:3055] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.628396  4672 raft_consensus.cc:740] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:50.630780  4672 consensus_queue.cc:260] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.631898  4672 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.638490  4843 consensus_queue.cc:1048] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.639362  4672 raft_consensus.cc:2468] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74acd5ea6a0f492ab7b702cc2f6701ec in term 2.
I20260709 13:13:50.643007  4881 raft_consensus.cc:515] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.643903  4492 leader_election.cc:304] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74acd5ea6a0f492ab7b702cc2f6701ec, cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb
I20260709 13:13:50.645422  4673 raft_consensus.cc:493] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.645876  4673 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.646948  4881 leader_election.cc:290] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:50.648236  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:50.648453  4848 raft_consensus.cc:2804] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.649026  4848 raft_consensus.cc:697] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Becoming Leader. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.649420  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:50.649880  4848 consensus_queue.cc:237] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.649300  4818 consensus_queue.cc:1048] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:50.654461  4815 consensus_queue.cc:1048] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.661464  4640 leader_election.cc:304] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf292d9428b148369c2c83785ff142d5; no voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec
I20260709 13:13:50.662312  4424 catalog_manager.cc:5697] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec reported cstate change: term changed from 1 to 2, leader changed from cf292d9428b148369c2c83785ff142d5 (127.25.139.131) to 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129). New cstate: current_term: 2 leader_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:50.661895  4673 raft_consensus.cc:515] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.666370  4674 raft_consensus.cc:1240] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Rejecting Update request from peer 74acd5ea6a0f492ab7b702cc2f6701ec for earlier term 1. Current term is 3. Ops: []
I20260709 13:13:50.668043  4881 raft_consensus.cc:2749] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:50.669934  4848 consensus_queue.cc:1059] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.671444  4848 raft_consensus.cc:3055] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.671901  4848 raft_consensus.cc:740] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.672331  4526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:50.672749  4673 leader_election.cc:290] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:50.672987  4848 consensus_queue.cc:260] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.675408  4848 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.675769  4596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a2f84a51ea34e9c84704fb5daebfa92" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:50.676698  4596 raft_consensus.cc:3060] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.681623  4843 raft_consensus.cc:993] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:50.682152  4843 raft_consensus.cc:1081] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Signalling peer 49bcc972a6954c15b0071ed6e7008adb to start an election
I20260709 13:13:50.687565  4602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
 from {username='slave'} at 127.0.0.1:38260
I20260709 13:13:50.688273  4602 raft_consensus.cc:493] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.688938  4602 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.693423  4815 consensus_queue.cc:1048] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.697003  4602 raft_consensus.cc:515] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.698292  4600 raft_consensus.cc:1240] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Rejecting Update request from peer 74acd5ea6a0f492ab7b702cc2f6701ec for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:50.686725  4596 raft_consensus.cc:2468] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:50.701985  4602 leader_election.cc:290] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), cf292d9428b148369c2c83785ff142d5 (127.25.139.131:39941)
I20260709 13:13:50.703819  4843 consensus_queue.cc:1048] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:50.704421  4640 leader_election.cc:304] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:50.705263  4881 raft_consensus.cc:2804] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.705753  4881 raft_consensus.cc:697] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:50.706569  4881 consensus_queue.cc:237] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.706828  4673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf292d9428b148369c2c83785ff142d5"
I20260709 13:13:50.707660  4673 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.708165  4818 consensus_queue.cc:1059] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:50.709041  4818 raft_consensus.cc:3055] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.709388  4818 raft_consensus.cc:740] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:50.710098  4818 consensus_queue.cc:260] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.710904  4818 raft_consensus.cc:3060] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.715348  4527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93a3ac21d2d45debd4e28969863e45c" candidate_uuid: "49bcc972a6954c15b0071ed6e7008adb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:50.721953  4526 raft_consensus.cc:2468] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:50.725100  4527 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:50.727291  4566 leader_election.cc:304] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, 74acd5ea6a0f492ab7b702cc2f6701ec; no voters: 
I20260709 13:13:50.728500  4819 raft_consensus.cc:2804] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.728978  4819 raft_consensus.cc:697] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Leader. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:50.729753  4819 consensus_queue.cc:237] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:50.731309  4422 catalog_manager.cc:5697] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 1 to 3, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.734073  4673 raft_consensus.cc:2468] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49bcc972a6954c15b0071ed6e7008adb in term 2.
I20260709 13:13:50.734809  4672 raft_consensus.cc:1240] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Rejecting Update request from peer 74acd5ea6a0f492ab7b702cc2f6701ec for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:50.747527  4422 catalog_manager.cc:5697] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb reported cstate change: term changed from 1 to 2, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130). New cstate: current_term: 2 leader_uuid: "49bcc972a6954c15b0071ed6e7008adb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:51.043555  4673 raft_consensus.cc:1275] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.044953  4817 consensus_queue.cc:1048] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.046087  4527 raft_consensus.cc:1275] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.047466  4817 consensus_queue.cc:1048] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.105504  4673 raft_consensus.cc:1275] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.106920  4843 consensus_queue.cc:1048] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.115706  4596 raft_consensus.cc:3060] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:51.123888  4596 raft_consensus.cc:1275] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Refusing update from remote peer 74acd5ea6a0f492ab7b702cc2f6701ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.125255  4843 consensus_queue.cc:1048] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.141608  4596 raft_consensus.cc:1275] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:51.143091  4881 consensus_queue.cc:1048] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.156919  4527 raft_consensus.cc:1275] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:51.158455  4839 consensus_queue.cc:1048] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.228437  4527 raft_consensus.cc:1275] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.229820  4815 consensus_queue.cc:1048] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:51.238391  4673 raft_consensus.cc:1275] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Refusing update from remote peer 49bcc972a6954c15b0071ed6e7008adb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:51.240618  4815 consensus_queue.cc:1048] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:53.354653  4423 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46308:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:53.374635  4423 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46308:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:53.419975 26158 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:53.609647  4937 tablet.cc:1724] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.609980  4940 tablet.cc:1724] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.595314  4938 tablet.cc:1724] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.582995  4939 tablet.cc:1724] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.659896  4953 tablet.cc:1724] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:53.719869  4942 log.cc:927] Time spent T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:13:53.720721  4948 log.cc:927] Time spent T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:13:53.736686  4951 log.cc:927] Time spent T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:13:53.747920  4958 tablet.cc:1724] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:53.770695  4949 log.cc:927] Time spent T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Append to log took a long time: real 0.114s	user 0.004s	sys 0.000s
I20260709 13:13:53.765923  4960 tablet.cc:1724] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.756734  4963 tablet.cc:1724] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:53.810374  4959 log.cc:927] Time spent T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 13:13:53.781766  4962 tablet.cc:1724] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.815719  4940 tablet.cc:1724] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.823347  4596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e"
dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
mode: GRACEFUL
new_leader_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:50610
I20260709 13:13:53.784698  4937 tablet.cc:1724] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.826828  4938 tablet.cc:1724] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.753160  4957 tablet.cc:1724] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.833160  4596 raft_consensus.cc:606] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Received request to transfer leadership to TS cf292d9428b148369c2c83785ff142d5
W20260709 13:13:53.861202  4492 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:39941, user_credentials={real_user=slave}} blocked reactor thread for 101142us
W20260709 13:13:53.875195  4491 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.130:35355, user_credentials={real_user=slave}} blocked reactor thread for 109540us
I20260709 13:13:53.906704  4962 tablet.cc:1724] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.912335  4953 tablet.cc:1724] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.892676  4939 tablet.cc:1724] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.938310  4964 tablet.cc:1724] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.947317  4937 tablet.cc:1724] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.979539  4937 tablet.cc:1724] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:53.980211  4566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.129:44369, user_credentials={real_user=slave}} blocked reactor thread for 84774.9us
W20260709 13:13:53.980000  4567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.139.131:39941, user_credentials={real_user=slave}} blocked reactor thread for 99660.1us
I20260709 13:13:53.988768  4968 tablet.cc:1724] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.991643  4957 tablet.cc:1724] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.994861  4958 tablet.cc:1724] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:53.998580  4523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45"
dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
mode: GRACEFUL
new_leader_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:35336
I20260709 13:13:54.003391  4523 raft_consensus.cc:606] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Received request to transfer leadership to TS cf292d9428b148369c2c83785ff142d5
I20260709 13:13:54.004964 26158 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:54.004508  4963 tablet.cc:1724] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:54.005731 26158 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:53.998787  4937 tablet.cc:1724] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:54.000612  4940 tablet.cc:1724] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:54.001356  4970 raft_consensus.cc:993] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: : Instructing follower cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:54.008255  4970 raft_consensus.cc:1081] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Signalling peer cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:54.010846  4939 tablet.cc:1724] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:54.021917  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:43806
I20260709 13:13:54.022631  4675 raft_consensus.cc:493] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.023132  4675 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.022652  4953 tablet.cc:1724] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:54.046030  4675 raft_consensus.cc:515] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.049244  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:54.049244  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266b68ba75ec4ed1b8fb5c5467eca15e" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:54.049950  4523 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.049988  4602 raft_consensus.cc:3055] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.050500  4602 raft_consensus.cc:740] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49bcc972a6954c15b0071ed6e7008adb, State: Running, Role: LEADER
I20260709 13:13:54.051397  4602 consensus_queue.cc:260] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.052572  4602 raft_consensus.cc:3060] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.053221  4675 leader_election.cc:290] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:54.059458  4523 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:54.059671  4602 raft_consensus.cc:2468] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:54.060745  4640 leader_election.cc:304] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:54.061539  4918 raft_consensus.cc:2804] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.062017  4918 raft_consensus.cc:697] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:54.062917  4918 consensus_queue.cc:237] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.064149  4422 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: soft_deleted_table [id=5eebae093ef24bc59c125a0668443f41] alter complete (version 1)
I20260709 13:13:54.075531  4422 catalog_manager.cc:5697] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 2 to 3, leader changed from 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130) to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.352221  4965 raft_consensus.cc:993] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: : Instructing follower cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:54.352798  4966 raft_consensus.cc:1081] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Signalling peer cf292d9428b148369c2c83785ff142d5 to start an election
I20260709 13:13:54.354223  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45"
dest_uuid: "cf292d9428b148369c2c83785ff142d5"
 from {username='slave'} at 127.0.0.1:43808
I20260709 13:13:54.354737  4675 raft_consensus.cc:493] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.355074  4675 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.360128  4675 raft_consensus.cc:515] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.361663  4675 leader_election.cc:290] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Requested vote from peers 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369), 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355)
I20260709 13:13:54.362525  4523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec"
I20260709 13:13:54.362815  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facafb6b93cb46688b169a5c892fdc45" candidate_uuid: "cf292d9428b148369c2c83785ff142d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49bcc972a6954c15b0071ed6e7008adb"
I20260709 13:13:54.363126  4523 raft_consensus.cc:3055] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:54.363529  4523 raft_consensus.cc:740] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74acd5ea6a0f492ab7b702cc2f6701ec, State: Running, Role: LEADER
I20260709 13:13:54.363541  4602 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.364286  4523 consensus_queue.cc:260] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.365291  4523 raft_consensus.cc:3060] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:54.368991  4602 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:54.370280  4640 leader_election.cc:304] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49bcc972a6954c15b0071ed6e7008adb, cf292d9428b148369c2c83785ff142d5; no voters: 
I20260709 13:13:54.371054  4523 raft_consensus.cc:2468] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf292d9428b148369c2c83785ff142d5 in term 3.
I20260709 13:13:54.371105  4918 raft_consensus.cc:2804] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:54.371821  4918 raft_consensus.cc:697] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Becoming Leader. State: Replica: cf292d9428b148369c2c83785ff142d5, State: Running, Role: LEADER
I20260709 13:13:54.372763  4918 consensus_queue.cc:237] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } }
I20260709 13:13:54.381148  4422 catalog_manager.cc:5697] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 reported cstate change: term changed from 2 to 3, leader changed from 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129) to cf292d9428b148369c2c83785ff142d5 (127.25.139.131). New cstate: current_term: 3 leader_uuid: "cf292d9428b148369c2c83785ff142d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf292d9428b148369c2c83785ff142d5" member_type: VOTER last_known_addr { host: "127.25.139.131" port: 39941 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.552496  4523 raft_consensus.cc:1275] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.553666  4918 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.565215  4602 raft_consensus.cc:1275] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.569185  4918 consensus_queue.cc:1048] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.836213  4523 raft_consensus.cc:1275] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.837453  4918 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74acd5ea6a0f492ab7b702cc2f6701ec" member_type: VOTER last_known_addr { host: "127.25.139.129" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:54.850926  4602 raft_consensus.cc:1275] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Refusing update from remote peer cf292d9428b148369c2c83785ff142d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:54.852362  4985 consensus_queue.cc:1048] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49bcc972a6954c15b0071ed6e7008adb" member_type: VOTER last_known_addr { host: "127.25.139.130" port: 35355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:55.061458 26158 tablet_server.cc:179] TabletServer@127.25.139.129:0 shutting down...
W20260709 13:13:55.077877  4566 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:13:55.081059  4566 consensus_peers.cc:597] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.085888 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:55.086730 26158 tablet_replica.cc:333] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.087563 26158 raft_consensus.cc:2243] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.088050 26158 raft_consensus.cc:2272] T c93a3ac21d2d45debd4e28969863e45c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.090355 26158 tablet_replica.cc:333] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.091132 26158 raft_consensus.cc:2243] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.091738 26158 raft_consensus.cc:2272] T 7a2f84a51ea34e9c84704fb5daebfa92 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.091784  4640 consensus_peers.cc:597] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.093735 26158 tablet_replica.cc:333] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.094316 26158 raft_consensus.cc:2243] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.095010 26158 raft_consensus.cc:2272] T 780877fcb97d4bdcb1d9b58f91f6988c P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.096870 26158 tablet_replica.cc:333] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.097391 26158 raft_consensus.cc:2243] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.098054 26158 raft_consensus.cc:2272] T 7a1c42c7bafa49b68207c62e03e1705b P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.099932 26158 tablet_replica.cc:333] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.100445 26158 raft_consensus.cc:2243] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.101130 26158 raft_consensus.cc:2272] T c2ebf9aa0a3344eea3129b2e21f8510a P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.102844 26158 tablet_replica.cc:333] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.103399 26158 raft_consensus.cc:2243] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.104115 26158 raft_consensus.cc:2272] T 103537ab1070436bab819689e8638b10 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.105960 26158 tablet_replica.cc:333] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.106417 26158 raft_consensus.cc:2243] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.106784 26158 raft_consensus.cc:2272] T 35e905426ab647bdb4aea32104650770 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.108511 26158 tablet_replica.cc:333] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.109128 26158 raft_consensus.cc:2243] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.109643 26158 raft_consensus.cc:2272] T b95529c1dc744e399f025c30c55d73a4 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.111305 26158 tablet_replica.cc:333] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.111773 26158 raft_consensus.cc:2243] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.112129 26158 raft_consensus.cc:2272] T c9f5dafbd0f640d8906547a9955911aa P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.113909 26158 tablet_replica.cc:333] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.114377 26158 raft_consensus.cc:2243] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.114758 26158 raft_consensus.cc:2272] T 6e9f458ae32444d09070793091a2e6bf P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.116572 26158 tablet_replica.cc:333] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.117074 26158 raft_consensus.cc:2243] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.117403 26158 raft_consensus.cc:2272] T facafb6b93cb46688b169a5c892fdc45 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.120296 26158 tablet_replica.cc:333] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.120774 26158 raft_consensus.cc:2243] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.121131 26158 raft_consensus.cc:2272] T 13ca7db6a29742c8a318fd4242d7b262 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.122709 26158 tablet_replica.cc:333] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.123126 26158 raft_consensus.cc:2243] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.123886 26158 raft_consensus.cc:2272] T ff2089edb7074977876c3e78460cda19 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.125743 26158 tablet_replica.cc:333] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.126178 26158 raft_consensus.cc:2243] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.126538 26158 raft_consensus.cc:2272] T b41b0d0d461f437698d5d6e295529809 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.128301 26158 tablet_replica.cc:333] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.128744 26158 raft_consensus.cc:2243] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.129382 26158 raft_consensus.cc:2272] T 4dee98a00ba0464cba88b71ee4fbf9cb P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.131392 26158 tablet_replica.cc:333] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.131868 26158 raft_consensus.cc:2243] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.132599 26158 raft_consensus.cc:2272] T 5ce95d39416847948dff6c4a610facdc P 74acd5ea6a0f492ab7b702cc2f6701ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.134449 26158 tablet_replica.cc:333] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.135000 26158 raft_consensus.cc:2243] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.135461 26158 raft_consensus.cc:2272] T 40808295b45547c2b12cb77ceeca2f05 P 74acd5ea6a0f492ab7b702cc2f6701ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.137418 26158 tablet_replica.cc:333] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec: stopping tablet replica
I20260709 13:13:55.138065 26158 raft_consensus.cc:2243] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.138557 26158 raft_consensus.cc:2272] T 266b68ba75ec4ed1b8fb5c5467eca15e P 74acd5ea6a0f492ab7b702cc2f6701ec [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:55.142392  4640 consensus_peers.cc:597] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.178820 26158 tablet_server.cc:196] TabletServer@127.25.139.129:0 shutdown complete.
I20260709 13:13:55.209708 26158 tablet_server.cc:179] TabletServer@127.25.139.130:0 shutting down...
W20260709 13:13:55.226410  4566 consensus_peers.cc:597] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:55.227154  4566 consensus_peers.cc:597] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.240731 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:55.241613 26158 tablet_replica.cc:333] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.242561 26158 raft_consensus.cc:2243] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.243558 26158 raft_consensus.cc:2272] T c93a3ac21d2d45debd4e28969863e45c P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.245491 26158 tablet_replica.cc:333] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.246111 26158 raft_consensus.cc:2243] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.246557 26158 raft_consensus.cc:2272] T 7a2f84a51ea34e9c84704fb5daebfa92 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.248349 26158 tablet_replica.cc:333] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.248883 26158 raft_consensus.cc:2243] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.249307 26158 raft_consensus.cc:2272] T 780877fcb97d4bdcb1d9b58f91f6988c P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.251004 26158 tablet_replica.cc:333] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.251539 26158 raft_consensus.cc:2243] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.251946 26158 raft_consensus.cc:2272] T 7a1c42c7bafa49b68207c62e03e1705b P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.253577 26158 tablet_replica.cc:333] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.254184 26158 raft_consensus.cc:2243] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.254594 26158 raft_consensus.cc:2272] T c2ebf9aa0a3344eea3129b2e21f8510a P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.256337 26158 tablet_replica.cc:333] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.256834 26158 raft_consensus.cc:2243] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.257280 26158 raft_consensus.cc:2272] T 103537ab1070436bab819689e8638b10 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.259213 26158 tablet_replica.cc:333] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.259728 26158 raft_consensus.cc:2243] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.260462 26158 raft_consensus.cc:2272] T 35e905426ab647bdb4aea32104650770 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.262135 26158 tablet_replica.cc:333] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.262657 26158 raft_consensus.cc:2243] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.263084 26158 raft_consensus.cc:2272] T 4dee98a00ba0464cba88b71ee4fbf9cb P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.264999 26158 tablet_replica.cc:333] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.265516 26158 raft_consensus.cc:2243] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.265930 26158 raft_consensus.cc:2272] T 5ce95d39416847948dff6c4a610facdc P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.267680 26158 tablet_replica.cc:333] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.268218 26158 raft_consensus.cc:2243] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.268976 26158 raft_consensus.cc:2272] T 40808295b45547c2b12cb77ceeca2f05 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.270946 26158 tablet_replica.cc:333] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.271533 26158 raft_consensus.cc:2243] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.272255 26158 raft_consensus.cc:2272] T b95529c1dc744e399f025c30c55d73a4 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.273922 26158 tablet_replica.cc:333] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.274439 26158 raft_consensus.cc:2243] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.274874 26158 raft_consensus.cc:2272] T c9f5dafbd0f640d8906547a9955911aa P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.276701 26158 tablet_replica.cc:333] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.277220 26158 raft_consensus.cc:2243] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.277657 26158 raft_consensus.cc:2272] T facafb6b93cb46688b169a5c892fdc45 P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.280126 26158 tablet_replica.cc:333] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.280699 26158 raft_consensus.cc:2243] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.281450 26158 raft_consensus.cc:2272] T b41b0d0d461f437698d5d6e295529809 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.283530 26158 tablet_replica.cc:333] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.284035 26158 raft_consensus.cc:2243] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.284758 26158 raft_consensus.cc:2272] T 13ca7db6a29742c8a318fd4242d7b262 P 49bcc972a6954c15b0071ed6e7008adb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.286491 26158 tablet_replica.cc:333] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.287026 26158 raft_consensus.cc:2243] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.287536 26158 raft_consensus.cc:2272] T ff2089edb7074977876c3e78460cda19 P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.289489 26158 tablet_replica.cc:333] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.290019 26158 raft_consensus.cc:2243] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.290354 26158 raft_consensus.cc:2272] T 266b68ba75ec4ed1b8fb5c5467eca15e P 49bcc972a6954c15b0071ed6e7008adb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.292733 26158 tablet_replica.cc:333] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb: stopping tablet replica
I20260709 13:13:55.293126 26158 raft_consensus.cc:2243] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.293790 26158 raft_consensus.cc:2272] T 6e9f458ae32444d09070793091a2e6bf P 49bcc972a6954c15b0071ed6e7008adb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.331872 26158 tablet_server.cc:196] TabletServer@127.25.139.130:0 shutdown complete.
W20260709 13:13:55.342397  4640 consensus_peers.cc:597] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 -> Peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Couldn't send request to peer 49bcc972a6954c15b0071ed6e7008adb. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.363329 26158 tablet_server.cc:179] TabletServer@127.25.139.131:0 shutting down...
W20260709 13:13:55.390802  4640 consensus_peers.cc:597] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 -> Peer 74acd5ea6a0f492ab7b702cc2f6701ec (127.25.139.129:44369): Couldn't send request to peer 74acd5ea6a0f492ab7b702cc2f6701ec. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.129:44369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.393594 26158 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:55.394258 26158 tablet_replica.cc:333] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.394874 26158 raft_consensus.cc:2243] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.395694 26158 raft_consensus.cc:2272] T 7a2f84a51ea34e9c84704fb5daebfa92 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.397490 26158 tablet_replica.cc:333] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.398028 26158 raft_consensus.cc:2243] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.398442 26158 raft_consensus.cc:2272] T 780877fcb97d4bdcb1d9b58f91f6988c P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.400240 26158 tablet_replica.cc:333] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.400763 26158 raft_consensus.cc:2243] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.401188 26158 raft_consensus.cc:2272] T ff2089edb7074977876c3e78460cda19 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.403040 26158 tablet_replica.cc:333] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.403604 26158 raft_consensus.cc:2243] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.404016 26158 raft_consensus.cc:2272] T 13ca7db6a29742c8a318fd4242d7b262 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.405722 26158 tablet_replica.cc:333] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.406325 26158 raft_consensus.cc:2243] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.406828 26158 raft_consensus.cc:2272] T b95529c1dc744e399f025c30c55d73a4 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.409138 26158 tablet_replica.cc:333] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.409826 26158 raft_consensus.cc:2243] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:55.410233  4640 consensus_peers.cc:597] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 -> Peer 49bcc972a6954c15b0071ed6e7008adb (127.25.139.130:35355): Couldn't send request to peer 49bcc972a6954c15b0071ed6e7008adb. Status: Network error: Client connection negotiation failed: client connection to 127.25.139.130:35355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:55.410807 26158 raft_consensus.cc:2272] T c9f5dafbd0f640d8906547a9955911aa P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.412895 26158 tablet_replica.cc:333] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.413416 26158 raft_consensus.cc:2243] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.413805 26158 raft_consensus.cc:2272] T 5ce95d39416847948dff6c4a610facdc P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.415560 26158 tablet_replica.cc:333] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.416059 26158 raft_consensus.cc:2243] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.416402 26158 raft_consensus.cc:2272] T 4dee98a00ba0464cba88b71ee4fbf9cb P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.418150 26158 tablet_replica.cc:333] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.418632 26158 raft_consensus.cc:2243] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.418983 26158 raft_consensus.cc:2272] T c93a3ac21d2d45debd4e28969863e45c P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.420647 26158 tablet_replica.cc:333] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.421154 26158 raft_consensus.cc:2243] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.421865 26158 raft_consensus.cc:2272] T facafb6b93cb46688b169a5c892fdc45 P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.424113 26158 tablet_replica.cc:333] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.424582 26158 raft_consensus.cc:2243] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.424966 26158 raft_consensus.cc:2272] T b41b0d0d461f437698d5d6e295529809 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.426872 26158 tablet_replica.cc:333] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.427443 26158 raft_consensus.cc:2243] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.427858 26158 raft_consensus.cc:2272] T 6e9f458ae32444d09070793091a2e6bf P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.429672 26158 tablet_replica.cc:333] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.430224 26158 raft_consensus.cc:2243] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.430627 26158 raft_consensus.cc:2272] T 35e905426ab647bdb4aea32104650770 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.432294 26158 tablet_replica.cc:333] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.432782 26158 raft_consensus.cc:2243] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.433182 26158 raft_consensus.cc:2272] T c2ebf9aa0a3344eea3129b2e21f8510a P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.434898 26158 tablet_replica.cc:333] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.435415 26158 raft_consensus.cc:2243] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.435842 26158 raft_consensus.cc:2272] T 7a1c42c7bafa49b68207c62e03e1705b P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.437476 26158 tablet_replica.cc:333] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.437961 26158 raft_consensus.cc:2243] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.438381 26158 raft_consensus.cc:2272] T 103537ab1070436bab819689e8638b10 P cf292d9428b148369c2c83785ff142d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.440255 26158 tablet_replica.cc:333] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.440762 26158 raft_consensus.cc:2243] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:55.441207 26158 raft_consensus.cc:2272] T 40808295b45547c2b12cb77ceeca2f05 P cf292d9428b148369c2c83785ff142d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.443146 26158 tablet_replica.cc:333] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5: stopping tablet replica
I20260709 13:13:55.443696 26158 raft_consensus.cc:2243] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.444463 26158 raft_consensus.cc:2272] T 266b68ba75ec4ed1b8fb5c5467eca15e P cf292d9428b148369c2c83785ff142d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.473562 26158 tablet_server.cc:196] TabletServer@127.25.139.131:0 shutdown complete.
I20260709 13:13:55.501240 26158 master.cc:562] Master@127.25.139.190:33673 shutting down...
I20260709 13:13:55.522184 26158 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:55.522756 26158 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:55.523057 26158 tablet_replica.cc:333] T 00000000000000000000000000000000 P 831772deecf840848208e676b8589866: stopping tablet replica
I20260709 13:13:55.544204 26158 master.cc:584] Master@127.25.139.190:33673 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11388 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24159 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (359618 ms total)
[  PASSED  ] 8 tests.
I20260709 13:13:55.598399 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 413 messages since previous log ~14 seconds ago
I20260709 13:13:55.598608 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 413 messages since previous log ~14 seconds ago
I20260709 13:13:55.598743 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 412 messages since previous log ~14 seconds ago
I20260709 13:13:55.598891 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:55.599030 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:55.599265 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~186 seconds ago
I20260709 13:13:55.599499 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:13:55.599781 26158 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~5 seconds ago
